-- Logs begin at Thu 2022-05-12 08:51:35 UTC, end at Thu 2022-05-12 10:02:08 UTC. -- May 12 09:19:10.500829 dv-cinder-837699-5-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 12 09:19:10.511640 dv-cinder-837699-5-iscsi devstack@keystone.service[79804]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 12 09:19:10.514221 dv-cinder-837699-5-iscsi devstack@keystone.service[79804]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 09:19:10 2022] *** May 12 09:19:10.514221 dv-cinder-837699-5-iscsi devstack@keystone.service[79804]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 09:19:10.514221 dv-cinder-837699-5-iscsi devstack@keystone.service[79804]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 09:19:10.514221 dv-cinder-837699-5-iscsi devstack@keystone.service[79804]: nodename: dv-cinder-837699-5-iscsi May 12 09:19:10.514221 dv-cinder-837699-5-iscsi devstack@keystone.service[79804]: machine: x86_64 May 12 09:19:10.514221 dv-cinder-837699-5-iscsi devstack@keystone.service[79804]: clock source: unix May 12 09:19:10.514221 dv-cinder-837699-5-iscsi devstack@keystone.service[79804]: pcre jit disabled May 12 09:19:10.514221 dv-cinder-837699-5-iscsi devstack@keystone.service[79804]: detected number of CPU cores: 4 May 12 09:19:10.514221 dv-cinder-837699-5-iscsi devstack@keystone.service[79804]: current working directory: / May 12 09:19:10.514221 dv-cinder-837699-5-iscsi devstack@keystone.service[79804]: detected binary path: /usr/bin/uwsgi-core May 12 09:19:10.514221 dv-cinder-837699-5-iscsi devstack@keystone.service[79804]: your processes number limit is 47680 May 12 09:19:10.514221 dv-cinder-837699-5-iscsi devstack@keystone.service[79804]: your memory page size is 4096 bytes May 12 09:19:10.514221 dv-cinder-837699-5-iscsi devstack@keystone.service[79804]: detected max file descriptor number: 2048 May 12 09:19:10.514221 dv-cinder-837699-5-iscsi devstack@keystone.service[79804]: lock engine: pthread robust mutexes May 12 09:19:10.514963 dv-cinder-837699-5-iscsi devstack@keystone.service[79804]: thunder lock: enabled May 12 09:19:10.514963 dv-cinder-837699-5-iscsi devstack@keystone.service[79804]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 12 09:19:10.514963 dv-cinder-837699-5-iscsi devstack@keystone.service[79804]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 09:19:10.558325 dv-cinder-837699-5-iscsi devstack@keystone.service[79804]: Python main interpreter initialized at 0x5558acfd29c0 May 12 09:19:10.558325 dv-cinder-837699-5-iscsi devstack@keystone.service[79804]: python threads support enabled May 12 09:19:10.558325 dv-cinder-837699-5-iscsi devstack@keystone.service[79804]: your server socket listen backlog is limited to 100 connections May 12 09:19:10.558325 dv-cinder-837699-5-iscsi devstack@keystone.service[79804]: your mercy for graceful operations on workers is 90 seconds May 12 09:19:10.558672 dv-cinder-837699-5-iscsi devstack@keystone.service[79804]: mapped 403077 bytes (393 KB) for 2 cores May 12 09:19:10.558741 dv-cinder-837699-5-iscsi devstack@keystone.service[79804]: *** Operational MODE: preforking *** May 12 09:19:10.559033 dv-cinder-837699-5-iscsi devstack@keystone.service[79804]: *** uWSGI is running in multiple interpreter mode *** May 12 09:19:10.559033 dv-cinder-837699-5-iscsi devstack@keystone.service[79804]: spawned uWSGI master process (pid: 79804) May 12 09:19:10.559230 dv-cinder-837699-5-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 12 09:19:10.561254 dv-cinder-837699-5-iscsi devstack@keystone.service[79804]: spawned uWSGI worker 1 (pid: 79815, cores: 1) May 12 09:19:10.561254 dv-cinder-837699-5-iscsi devstack@keystone.service[79804]: spawned uWSGI worker 2 (pid: 79816, cores: 1) May 12 09:19:10.561254 dv-cinder-837699-5-iscsi devstack@keystone.service[79804]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 09:19:16.293376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 09:19:16.293376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: from cryptography.utils import int_from_bytes May 12 09:19:16.294170 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 09:19:16.294170 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: from cryptography.utils import int_from_bytes May 12 09:19:16.294751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 09:19:16.294751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: from cryptography.utils import int_from_bytes May 12 09:19:16.294896 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 09:19:16.294896 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: from cryptography.utils import int_from_bytes May 12 09:19:16.343704 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 09:19:16.343859 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 09:19:16.343932 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 09:19:16.344007 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 09:19:16.344075 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] command line args: [] {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 09:19:16.344289 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] command line args: [] {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 09:19:16.344381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 09:19:16.344520 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 09:19:16.344606 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ================================================================================ {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 09:19:16.344674 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ================================================================================ {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 09:19:16.344745 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] admin_token = **** {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.344909 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] admin_token = **** {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.344996 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] config_dir = [] {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.345125 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] config_dir = [] {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.345204 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.345337 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] config_source = [] {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.345427 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.345491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] config_source = [] {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.345554 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] debug = True {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.345706 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] debug = True {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.345793 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.348138 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.348138 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.348294 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.348356 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.348422 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.348483 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.348547 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.348611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.348676 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.348739 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] list_limit = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.348809 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] list_limit = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.348874 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] log_config_append = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.348938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] log_config_append = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.349002 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.349062 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.349125 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] log_dir = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.349200 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] log_dir = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.349265 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] log_file = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.349325 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] log_file = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.349382 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.349445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.349508 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.349577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.349642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.349701 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.349758 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.349818 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.349878 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.349979 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.350052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.350119 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.350179 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.350236 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.350294 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.350371 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.350431 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.350488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.350545 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.350607 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.350672 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.350737 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.350796 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.350854 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.350911 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.351626 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.351864 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.352033 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.352224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.352424 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.352619 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.352863 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.353075 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] publish_errors = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.353242 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] publish_errors = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.353509 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.353735 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.353946 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.353946 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.354285 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.354285 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.354711 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.355007 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.355205 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.355377 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.355569 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] standard_threads = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.355793 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] standard_threads = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.356004 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.356170 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.356367 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.356367 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.356673 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.356843 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] use_journal = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.356982 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.357240 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] use_json = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.357378 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] use_journal = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.357513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] use_stderr = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.357643 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] use_json = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.357780 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] use_syslog = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.357960 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] use_stderr = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.357960 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] use_syslog = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.358305 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.358451 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:19:16.358589 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.358731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.358990 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.359141 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.359307 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.359465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.359598 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.359738 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.359868 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.359996 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.360125 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.360263 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.360471 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.360603 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.360731 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.360859 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.360987 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.361116 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.361263 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.361395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.361529 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.361664 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.361793 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.361985 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.362151 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.362295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.362424 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.362559 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.362695 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.362824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.362961 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.363097 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.363235 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.363364 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.363493 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.363621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.363758 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.363888 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.364026 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.364162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.364299 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.364428 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.364567 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.364697 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.364825 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.364953 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.365081 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.365219 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.365358 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.365488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.365623 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.365769 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.365955 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.366093 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.366232 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.366370 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.366505 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.366634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.366768 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.366898 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.367099 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.367237 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.367371 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.367501 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.367629 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.367629 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.367897 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.368027 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.368160 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.368295 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.368423 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.368558 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.368694 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.368911 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.369075 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.369206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.369334 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.369470 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.369616 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.369745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.369880 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.370052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.370180 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.370322 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.370451 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.370580 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.370707 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.370835 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.370962 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.371107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.371237 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.371364 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.372577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.372787 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.372984 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.373309 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.373517 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.373681 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.373874 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.374098 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.374289 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.374519 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.374684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.374941 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.375142 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.375318 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.375510 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.375743 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.375911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.376103 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.376296 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.376487 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.376679 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.376907 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.377075 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.377267 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.377466 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.377466 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.377811 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.377811 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.378160 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.378297 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.378468 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.378601 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.378739 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.378739 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.378991 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.378991 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.379282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.379411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.379539 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.379921 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.380061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.380199 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.380329 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.380329 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.380609 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.380737 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.380865 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.381013 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.381145 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.381274 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.381408 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.381408 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.381652 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.381797 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.381982 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.382120 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.382249 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.382249 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.382502 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.382502 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.382755 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.382883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.383018 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.383181 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.383350 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.383553 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.383686 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.383828 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.383957 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.384085 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.384214 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.384351 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.384481 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.384616 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.384745 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.384745 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.384995 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.384995 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.385241 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.385241 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.385484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.385484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.385744 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.385744 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.386112 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.386112 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.386387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.386518 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.386655 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.386794 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.386935 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.387065 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.387193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.387328 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.387457 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.387596 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.387733 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.387862 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.387990 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.388118 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.388247 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.388881 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.389022 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.389153 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.389281 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.389281 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.389525 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.389525 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.389790 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.389790 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.390088 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.390218 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.390356 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.390356 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.390609 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.390739 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] auth.external = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.390878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.391008 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.391142 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] auth.external = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.391142 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.391396 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.391396 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.391691 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.391824 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] auth.password = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.391958 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.392095 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] auth.token = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.392226 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] auth.password = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.392355 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.392493 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] auth.token = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.392624 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.392753 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.392881 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.393009 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.393145 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.393276 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.393414 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.393544 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.393674 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.393803 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.393975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.394170 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.394374 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] credential.caching = True {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.394515 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.394647 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.394778 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] credential.caching = True {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.394916 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.395048 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.395178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.395307 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.395447 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.395577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.395716 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.395847 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.395976 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.396106 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.396106 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.396350 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.396488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.396620 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.396620 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.396866 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.396866 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.397126 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.397265 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.397396 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.397396 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.397641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.397641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.397886 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.397886 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.398215 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.398215 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.398460 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.398460 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] federation.caching = True {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.398705 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.398843 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.398986 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] federation.caching = True {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.399124 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.399254 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.399384 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.399514 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.399722 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.399855 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.399988 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.400133 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.400264 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.400398 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.400537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.400668 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.400816 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.400952 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.401084 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.401216 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.401356 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.401493 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.401625 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.401762 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.401924 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] identity.caching = True {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.402065 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.402209 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.402341 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] identity.caching = True {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.402478 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.402610 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.402750 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.402882 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.403021 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.403154 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.403286 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.403415 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.403545 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.403675 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.403813 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.403944 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.404629 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.404770 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.404901 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.405048 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.405190 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.405322 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.405452 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.405582 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.405712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.405850 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.406048 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.406180 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.406311 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.406451 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.406583 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.406721 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.406852 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.406999 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.407130 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.407262 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.407392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.407531 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.407663 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.407793 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.407923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.408052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.408182 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.408321 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.408453 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.408584 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.408723 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.408854 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.408983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.409129 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.409261 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.409392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.409521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.409651 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.409781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.409954 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.410093 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.410224 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.410354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.410486 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.410626 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.410766 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.410909 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.411040 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.411170 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.411300 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.411431 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.411569 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.411701 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.411830 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.411960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.412098 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.412229 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.412374 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.412525 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.412662 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.412793 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.412923 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.413052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.413191 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.413323 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.413453 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.413590 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.413721 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.413850 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.414040 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.414183 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.414326 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.414457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.414588 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.414720 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.414858 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.414989 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.415118 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.415302 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.415433 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.415563 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.415703 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.415834 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.415964 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.416102 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.416241 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.416371 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.user = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.416509 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.416640 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.416777 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.user = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.416908 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.417038 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.417168 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.417307 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.417438 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.417568 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.417698 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.417828 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.418022 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.418176 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.418308 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.418438 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.418567 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.418697 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.418836 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.418968 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.419098 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.419228 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.419358 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.419489 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.419665 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.419799 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.419940 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.420070 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.420201 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.420331 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.420470 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.420601 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.420732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.420873 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.421005 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.421135 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.421274 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.421405 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.421535 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.421665 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.421805 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.421980 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.422130 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.422262 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.422393 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.422524 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.422654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.422784 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.422924 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.423057 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.423188 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.423318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.423449 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.423579 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.423728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.423860 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.423991 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.424123 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.424253 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.424385 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.424525 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.424657 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.424788 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.425048 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.425201 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.425336 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.425475 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.425618 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.425750 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.425881 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.426088 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.426220 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.426429 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.426563 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.426701 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] resource.caching = True {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.426839 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.426971 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.427101 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] resource.caching = True {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.427240 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.427372 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.427509 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.427651 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.427782 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.427912 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.428051 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.428182 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.428314 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.428444 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.428574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.428704 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.428843 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.428975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.429106 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.429237 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.429369 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] role.caching = True {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.429509 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.429652 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] role.driver = sql {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.429784 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] role.caching = True {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.429932 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.430069 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] role.driver = sql {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.430200 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.430331 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.430473 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.430605 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.430736 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.430875 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.431007 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.431136 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.431289 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.431422 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.431553 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.431683 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.431813 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.431943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.432081 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.432212 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.432343 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.432473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.432603 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.432733 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.432872 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.433003 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.433149 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.433280 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.433675 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.433860 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.433860 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.434099 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.434099 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.434235 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.434307 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.434387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.434460 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.434531 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.434602 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.434673 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.434673 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.434810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.434810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.434941 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.434941 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.435069 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.435140 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.435743 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.435743 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.435868 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.435940 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.436012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.436084 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.436159 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.436238 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.436310 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.436310 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.436435 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.436506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.436586 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.436660 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.436731 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.436731 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.436856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.436856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.436988 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.437061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.437132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.437203 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.437274 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] token.caching = True {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.437345 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] token.caching = True {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.437424 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.437497 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.437568 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.437640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.437710 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.437788 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.437861 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.437992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.438067 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.438138 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.438209 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.438292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.438366 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.438438 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.438508 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.438579 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.438650 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.438729 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.438802 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.438873 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.438949 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.439021 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.439092 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.439165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.439238 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.439315 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.439387 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.439458 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.439529 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.439607 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.439679 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.439750 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.439821 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.439891 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.439961 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] database.connection = **** {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.440054 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] database.connection = **** {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.440140 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.440221 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.440300 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.440373 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.440444 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.440515 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.440586 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.440658 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.440736 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.440736 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.440861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.440932 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.441004 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.441075 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.441154 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.441228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.441303 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.441374 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.441445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.441516 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.441595 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.441668 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.441739 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.441810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.441881 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.441971 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.442119 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.442119 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.442232 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.442232 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.442344 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.442454 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.442530 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.442593 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.442653 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.442713 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 09:19:16.442773 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:19:16.442773 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 09:19:16.460217 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79815) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.460449 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79815) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.460656 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79815) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.469936 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79815) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.471336 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79816) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.471567 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79816) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.471791 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79816) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.480637 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79816) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.498370 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79815) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.498631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79815) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.499433 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79816) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.499663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79816) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.551849 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79815) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.552174 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79816) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.604855 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79815) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.605163 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79815) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.605325 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79816) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.605540 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79816) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.670612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79815) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.670890 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79815) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.671046 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79816) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.671216 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79815) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.671380 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79816) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.671530 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79815) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.671677 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79816) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.671823 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79815) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.671977 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79816) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.672123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79815) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.672267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79816) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.672267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79816) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.695009 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79815) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.695227 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79815) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.695377 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79816) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.695537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79815) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.695684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79816) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.695829 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79815) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.695972 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79816) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.696125 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79815) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.696270 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79816) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.696413 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79815) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.696556 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79816) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.696699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79815) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.696851 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79816) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.696851 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79816) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.707990 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79815) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.708357 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79816) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.722525 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79815) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.722769 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79816) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.722924 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79815) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.723068 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79816) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.723210 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79815) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.723350 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79816) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.723489 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79815) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.723637 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79816) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.723792 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79815) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.723932 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79816) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.724071 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79815) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.724209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79816) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.724356 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79815) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.724497 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79816) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 09:19:16.740928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.741142 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 09:19:16.741337 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.741515 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.741667 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 09:19:16.741827 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 09:19:16.742027 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.742176 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.742318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 09:19:16.742754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.742905 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.743048 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.743190 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.743331 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.743481 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.743481 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.754158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.754432 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.754939 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.755096 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.755254 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.755400 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.755543 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.755724 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.763295 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79815) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.764393 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79816) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.767135 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79815) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.767417 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.767696 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.767846 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79816) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.768002 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.768145 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.768294 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.768437 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.768578 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.768718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.768869 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.769013 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.769166 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.769309 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.769451 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.769602 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.769745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.769887 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.770062 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.770205 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.770205 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.770486 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.796747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.797425 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.798375 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79815) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.798656 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.799061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79816) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.799341 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.803906 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79815) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.804182 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.804458 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.804620 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79816) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.804847 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.805124 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.812282 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79815) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.812562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.812951 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79816) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.813233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.817194 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79815) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.817478 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.817754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.817936 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79816) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.818100 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.818244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.818398 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.818541 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.818683 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.818834 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.818977 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.819119 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.819261 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.819405 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.819555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.819698 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.837674 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.837965 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.838374 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.838649 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.842492 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79815) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.843186 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79816) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.846107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.846401 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.846809 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.847108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.851353 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79815) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.852054 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79816) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.854997 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79815) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.855615 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79816) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.859186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.859480 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.859759 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.859910 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.860054 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.860282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.860430 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.860586 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.860729 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.860872 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.861023 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.861196 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.880234 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79815) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.880602 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.880870 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.881033 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79816) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.881178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.881333 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.881514 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.881778 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.889037 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.889677 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.890781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.891052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.891410 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.891680 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.894110 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79815) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.894389 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.894671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.894824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79816) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.894968 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.895111 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.895265 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.895410 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.895552 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.895811 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.908668 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79815) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.908946 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.909221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.909383 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79816) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.909528 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.909679 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.909824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.909999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.910144 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.910287 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.910442 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.910588 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.910731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.910885 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.928833 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79815) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.929355 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79816) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.932126 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79815) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.932639 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79816) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.935995 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.936497 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.937604 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.938120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.939257 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79815) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.939535 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.939746 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79816) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.939898 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.940056 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.940302 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.947254 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.947766 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.948854 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79815) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.949367 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79816) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.952143 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.952425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.952642 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.952807 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.952951 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.953106 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.953286 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.953465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.962192 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79815) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.962482 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.962765 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.963542 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79816) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.963844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.964261 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.970833 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79815) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.971112 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.971386 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.971660 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.971928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.972214 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.972399 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79816) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 09:19:16.972498 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.972682 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.972769 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.972961 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.973049 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.973240 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.973327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.973512 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.973622 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.973781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.973859 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.974064 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.974288 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.974377 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79815) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.974592 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.974863 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.975157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.975430 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.975709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.975976 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:16.976247 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79816) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 09:19:17.014471 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5558acfd29c0 pid: 79815 (default app) May 12 09:19:17.017342 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5558acfd29c0 pid: 79816 (default app) May 12 09:19:17.018163 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bff88e-b9b0-4136-ae1d-a0cd32a8caf1 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:17.018464 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bff88e-b9b0-4136-ae1d-a0cd32a8caf1 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:17.018750 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bff88e-b9b0-4136-ae1d-a0cd32a8caf1 None None] PATH_INFO: `/v3` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:17.023085 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 791 bytes} [Thu May 12 09:19:17 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:24.978327 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2958d26-688c-433d-8c77-f2c935dda5f1 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:24.978899 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2958d26-688c-433d-8c77-f2c935dda5f1 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:24.978899 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2958d26-688c-433d-8c77-f2c935dda5f1 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:24.983785 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1/2] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:19:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:19:24.988839 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839def19-ec27-4592-a9a3-c86909974c57 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:24.989248 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839def19-ec27-4592-a9a3-c86909974c57 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:24.989517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839def19-ec27-4592-a9a3-c86909974c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:25.019898 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG oslo_db.sqlalchemy.engines [None req-839def19-ec27-4592-a9a3-c86909974c57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 09:19:25.200357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG passlib.handlers.bcrypt [None req-839def19-ec27-4592-a9a3-c86909974c57 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79815) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 12 09:19:25.201288 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG passlib.handlers.bcrypt [None req-839def19-ec27-4592-a9a3-c86909974c57 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79815) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 12 09:19:25.256051 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-839def19-ec27-4592-a9a3-c86909974c57 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:19:25.257580 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-839def19-ec27-4592-a9a3-c86909974c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:19:25.380815 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:19:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 12 09:19:25.502847 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2958d26-688c-433d-8c77-f2c935dda5f1 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:25.536466 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG oslo_db.sqlalchemy.engines [None req-a2958d26-688c-433d-8c77-f2c935dda5f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79816) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 09:19:25.666718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2958d26-688c-433d-8c77-f2c935dda5f1 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:25.671519 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af080689-23d2-407c-8644-6af67e652e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:25.672176 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af080689-23d2-407c-8644-6af67e652e29 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:25.672456 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af080689-23d2-407c-8644-6af67e652e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:25.672725 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af080689-23d2-407c-8644-6af67e652e29 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:25.680602 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af080689-23d2-407c-8644-6af67e652e29 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:25.733016 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: WARNING keystone.common.rbac_enforcer.enforcer [None req-af080689-23d2-407c-8644-6af67e652e29 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 12 09:19:25.733353 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af080689-23d2-407c-8644-6af67e652e29 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:25.742766 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 2/4] 10.222.0.60 () {58 vars in 1324 bytes} [Thu May 12 09:19:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 09:19:25.748599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839def19-ec27-4592-a9a3-c86909974c57 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:25.762946 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839def19-ec27-4592-a9a3-c86909974c57 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:25.767376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70931d1-0dbe-42d5-980e-d2d94d2a1e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:25.768484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70931d1-0dbe-42d5-980e-d2d94d2a1e82 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:25.768766 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70931d1-0dbe-42d5-980e-d2d94d2a1e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:25.769039 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70931d1-0dbe-42d5-980e-d2d94d2a1e82 admin admin] PATH_INFO: `/v3/projects/796065237e2244ba911db9225d3aa52c` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:25.770578 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70931d1-0dbe-42d5-980e-d2d94d2a1e82 admin admin] RBAC: Authorizing `identity:get_project(project_id=796065237e2244ba911db9225d3aa52c)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:25.821162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f70931d1-0dbe-42d5-980e-d2d94d2a1e82 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 12 09:19:25.821456 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70931d1-0dbe-42d5-980e-d2d94d2a1e82 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:25.834180 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 3/5] 10.222.0.60 () {56 vars in 1207 bytes} [Thu May 12 09:19:25 2022] GET /identity/v3/projects/796065237e2244ba911db9225d3aa52c => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:28.022285 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fda7d-9eee-4eda-a7b5-d839d03d9b08 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:28.022847 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fda7d-9eee-4eda-a7b5-d839d03d9b08 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:28.022847 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fda7d-9eee-4eda-a7b5-d839d03d9b08 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:28.026953 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 3/6] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:19:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:19:28.032932 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968def2-b4a3-45c4-a7ad-188cd3b91972 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:28.033377 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968def2-b4a3-45c4-a7ad-188cd3b91972 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:28.033477 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968def2-b4a3-45c4-a7ad-188cd3b91972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:28.053922 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-8968def2-b4a3-45c4-a7ad-188cd3b91972 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:19:28.055471 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-8968def2-b4a3-45c4-a7ad-188cd3b91972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:19:28.063357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 4/7] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:19:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 12 09:19:28.085432 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7fda7d-9eee-4eda-a7b5-d839d03d9b08 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:28.097730 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7fda7d-9eee-4eda-a7b5-d839d03d9b08 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:28.102038 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1def15-0059-457a-8a00-bafabc243851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:28.102662 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1def15-0059-457a-8a00-bafabc243851 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:28.102940 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1def15-0059-457a-8a00-bafabc243851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:28.103210 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1def15-0059-457a-8a00-bafabc243851 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:28.110834 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1def15-0059-457a-8a00-bafabc243851 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:28.112569 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1def15-0059-457a-8a00-bafabc243851 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:28.121069 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 4/8] 10.222.0.60 () {58 vars in 1324 bytes} [Thu May 12 09:19:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 09:19:28.126713 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968def2-b4a3-45c4-a7ad-188cd3b91972 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:28.135800 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968def2-b4a3-45c4-a7ad-188cd3b91972 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:28.140883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da6458-4539-4f2b-b21a-c5f3ae6f0afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:28.141742 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da6458-4539-4f2b-b21a-c5f3ae6f0afd admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:28.142150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da6458-4539-4f2b-b21a-c5f3ae6f0afd admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:28.142432 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da6458-4539-4f2b-b21a-c5f3ae6f0afd admin admin] PATH_INFO: `/v3/users/025f1b162f424dda98fae8e2f23a6180` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:28.143919 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da6458-4539-4f2b-b21a-c5f3ae6f0afd admin admin] RBAC: Authorizing `identity:get_user(user_id=025f1b162f424dda98fae8e2f23a6180)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:28.145891 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da6458-4539-4f2b-b21a-c5f3ae6f0afd admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:28.147470 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 5/9] 10.222.0.60 () {56 vars in 1198 bytes} [Thu May 12 09:19:28 2022] GET /identity/v3/users/025f1b162f424dda98fae8e2f23a6180 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:19:30.444464 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd88b26-f2a2-4fad-8f58-5c7d67321168 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:30.444991 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd88b26-f2a2-4fad-8f58-5c7d67321168 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:30.445084 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259ad9a-241f-4f3f-a7ef-3f3b64cce8ca None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:30.445433 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd88b26-f2a2-4fad-8f58-5c7d67321168 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:30.445506 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259ad9a-241f-4f3f-a7ef-3f3b64cce8ca None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:30.445506 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259ad9a-241f-4f3f-a7ef-3f3b64cce8ca None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:30.446292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 5/10] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:19:30.447336 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 6/11] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:19:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:19:30.451771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc4eff-2d4e-4b7a-9119-1722e907215d None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:30.452057 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc4eff-2d4e-4b7a-9119-1722e907215d None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:30.452336 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc4eff-2d4e-4b7a-9119-1722e907215d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:30.455018 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a478c-e9b0-4c60-85e7-049e505548c4 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:30.455315 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a478c-e9b0-4c60-85e7-049e505548c4 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:30.455599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a478c-e9b0-4c60-85e7-049e505548c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:30.493358 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG passlib.handlers.bcrypt [None req-4dfc4eff-2d4e-4b7a-9119-1722e907215d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79816) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 12 09:19:30.493767 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG passlib.handlers.bcrypt [None req-4dfc4eff-2d4e-4b7a-9119-1722e907215d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79816) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 12 09:19:30.541509 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-4dfc4eff-2d4e-4b7a-9119-1722e907215d None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:19:30.543162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-4dfc4eff-2d4e-4b7a-9119-1722e907215d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:19:30.579688 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-e28a478c-e9b0-4c60-85e7-049e505548c4 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:19:30.580885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-e28a478c-e9b0-4c60-85e7-049e505548c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:19:30.652928 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 6/12] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:19:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:19:30.653141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 7/13] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:19:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:19:30.674447 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc4eff-2d4e-4b7a-9119-1722e907215d None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:30.676682 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a478c-e9b0-4c60-85e7-049e505548c4 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:30.773053 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc4eff-2d4e-4b7a-9119-1722e907215d None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:30.773272 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a478c-e9b0-4c60-85e7-049e505548c4 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:30.804295 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae658ba-9511-4711-b459-39c20d0be15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:30.804517 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940953e-81c8-4e60-813c-6e0264671fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:30.805095 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae658ba-9511-4711-b459-39c20d0be15b None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:30.805378 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae658ba-9511-4711-b459-39c20d0be15b None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:30.805477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940953e-81c8-4e60-813c-6e0264671fe5 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:30.805653 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae658ba-9511-4711-b459-39c20d0be15b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:30.805751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940953e-81c8-4e60-813c-6e0264671fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:30.805975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940953e-81c8-4e60-813c-6e0264671fe5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:30.816903 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae658ba-9511-4711-b459-39c20d0be15b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:19:30.831905 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-2ae658ba-9511-4711-b459-39c20d0be15b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:19:30.831905 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:19:30.831905 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:19:30.831905 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:19:30.831905 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:19:30.831905 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:19:30.831905 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:19:30.831905 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:19:30.831905 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:19:30.831905 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:19:30.831905 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:19:30.831905 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:19:30.831905 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:19:30.831905 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:19:30.831905 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:19:30.831905 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:19:30.833141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:19:30.833141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:19:30.833141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:19:30.833141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:19:30.833141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:19:30.833141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:19:30.833141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:19:30.833141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:19:30.833141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:19:30.833141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:19:30.833141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:19:30.833141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:19:30.833141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:19:30.833141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:19:30.833141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:19:30.833141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:19:30.834252 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:19:30.834252 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:19:30.834252 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:19:30.834252 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:19:30.834252 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:19:30.834252 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:19:30.834252 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:19:30.834252 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:19:30.834252 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:19:30.834252 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:19:30.834252 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:19:30.834252 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:19:30.834252 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 8/14] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:19:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:19:30.839867 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae658ba-9511-4711-b459-39c20d0be15b None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:30.876743 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940953e-81c8-4e60-813c-6e0264671fe5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:30.878281 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940953e-81c8-4e60-813c-6e0264671fe5 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:30.932984 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae658ba-9511-4711-b459-39c20d0be15b None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:30.966757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61c88c-8680-496e-8c36-7f062a8d2a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:30.967443 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61c88c-8680-496e-8c36-7f062a8d2a59 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:30.967729 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61c88c-8680-496e-8c36-7f062a8d2a59 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:30.968005 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61c88c-8680-496e-8c36-7f062a8d2a59 None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:30.968768 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61c88c-8680-496e-8c36-7f062a8d2a59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:19:30.969076 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61c88c-8680-496e-8c36-7f062a8d2a59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:30.970559 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61c88c-8680-496e-8c36-7f062a8d2a59 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:30.983941 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 9/15] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:19:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:19:30.989752 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61c88c-8680-496e-8c36-7f062a8d2a59 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:31.079756 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 7/16] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:19:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:19:31.085276 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940953e-81c8-4e60-813c-6e0264671fe5 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:31.089977 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61c88c-8680-496e-8c36-7f062a8d2a59 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:31.124641 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102eecc9-0821-40a9-b95f-adf4a5441f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:31.125517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102eecc9-0821-40a9-b95f-adf4a5441f94 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:31.125799 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102eecc9-0821-40a9-b95f-adf4a5441f94 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:31.126111 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102eecc9-0821-40a9-b95f-adf4a5441f94 None admin] PATH_INFO: `/v3/users/025f1b162f424dda98fae8e2f23a6180` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:31.127321 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102eecc9-0821-40a9-b95f-adf4a5441f94 None admin] RBAC: Authorizing `identity:get_user(user_id=025f1b162f424dda98fae8e2f23a6180)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:31.128797 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102eecc9-0821-40a9-b95f-adf4a5441f94 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:31.130684 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 10/17] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:19:30 2022] GET /identity/v3/users/025f1b162f424dda98fae8e2f23a6180 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:31.135947 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102eecc9-0821-40a9-b95f-adf4a5441f94 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:31.181573 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940953e-81c8-4e60-813c-6e0264671fe5 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:31.213704 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63d880-46b6-4205-80d7-f7a30c44d14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:31.214522 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63d880-46b6-4205-80d7-f7a30c44d14f None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:31.214809 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63d880-46b6-4205-80d7-f7a30c44d14f None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:31.215085 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63d880-46b6-4205-80d7-f7a30c44d14f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:31.229545 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102eecc9-0821-40a9-b95f-adf4a5441f94 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:31.233454 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63d880-46b6-4205-80d7-f7a30c44d14f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:31.234952 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63d880-46b6-4205-80d7-f7a30c44d14f None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:31.255641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-ca63d880-46b6-4205-80d7-f7a30c44d14f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:19:31.255641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:19:31.255641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:19:31.255641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:19:31.255641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:19:31.255641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:19:31.255641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:19:31.255641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:19:31.255641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:19:31.255641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:19:31.255641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:19:31.255641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:19:31.255641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:19:31.255641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:19:31.255641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:19:31.256477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:19:31.256477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:19:31.256477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:19:31.256477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:19:31.256477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:19:31.256477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:19:31.256477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:19:31.256477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:19:31.256477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:19:31.256477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:19:31.256477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:19:31.256477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:19:31.256477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:19:31.256477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:19:31.256477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:19:31.256477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:19:31.256477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:19:31.257333 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:19:31.257333 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:19:31.257333 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:19:31.257333 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:19:31.257333 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 8/18] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:19:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:19:31.262599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4ec5c-961e-4880-bf52-ca78d52c7ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:31.262796 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63d880-46b6-4205-80d7-f7a30c44d14f None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:31.263433 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4ec5c-961e-4880-bf52-ca78d52c7ed5 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:31.263731 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4ec5c-961e-4880-bf52-ca78d52c7ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:31.264004 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4ec5c-961e-4880-bf52-ca78d52c7ed5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:31.265172 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e4ec5c-961e-4880-bf52-ca78d52c7ed5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:31.266632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e4ec5c-961e-4880-bf52-ca78d52c7ed5 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:31.268213 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 11/19] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:19:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:19:31.273595 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4ec5c-961e-4880-bf52-ca78d52c7ed5 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:31.356251 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63d880-46b6-4205-80d7-f7a30c44d14f None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:31.365858 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4ec5c-961e-4880-bf52-ca78d52c7ed5 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:31.389665 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6cd04-578b-4fc0-a92f-e9a48191f5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:31.390353 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6cd04-578b-4fc0-a92f-e9a48191f5a2 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:31.390635 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6cd04-578b-4fc0-a92f-e9a48191f5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:31.390908 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6cd04-578b-4fc0-a92f-e9a48191f5a2 None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:31.391623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6cd04-578b-4fc0-a92f-e9a48191f5a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:19:31.391927 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6cd04-578b-4fc0-a92f-e9a48191f5a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:31.393302 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6cd04-578b-4fc0-a92f-e9a48191f5a2 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:31.398478 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4294102-06a5-4c32-84a3-bf0c3a29911c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:31.399123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4294102-06a5-4c32-84a3-bf0c3a29911c None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:31.399403 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4294102-06a5-4c32-84a3-bf0c3a29911c None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:31.399676 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4294102-06a5-4c32-84a3-bf0c3a29911c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:31.400494 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4294102-06a5-4c32-84a3-bf0c3a29911c None admin] RBAC: Adding query filter params (role.id=8f01c4c38fa44034a54c1f8cd2d2db1a, scope.domain.id=default, user.id=025f1b162f424dda98fae8e2f23a6180) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:19:31.400802 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4294102-06a5-4c32-84a3-bf0c3a29911c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:31.402243 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4294102-06a5-4c32-84a3-bf0c3a29911c None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:31.409504 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 12/20] 10.222.0.60 () {56 vars in 1322 bytes} [Thu May 12 09:19:31 2022] GET /identity/v3/role_assignments?user.id=025f1b162f424dda98fae8e2f23a6180&scope.domain.id=default&role.id=8f01c4c38fa44034a54c1f8cd2d2db1a => generated 233 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:19:31.413021 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 9/21] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:19:33.909108 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912c247-294a-4fc0-8818-8fd3de607123 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:33.909108 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912c247-294a-4fc0-8818-8fd3de607123 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:33.909108 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912c247-294a-4fc0-8818-8fd3de607123 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:33.910280 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 13/22] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:19:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:19:33.914399 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b80da-5051-4a6a-8652-fc7aacae1b72 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:33.915186 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b80da-5051-4a6a-8652-fc7aacae1b72 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:33.915663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b80da-5051-4a6a-8652-fc7aacae1b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:33.937684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-2b1b80da-5051-4a6a-8652-fc7aacae1b72 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:19:33.939202 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-2b1b80da-5051-4a6a-8652-fc7aacae1b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:19:34.040946 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 10/23] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:19:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:19:34.075328 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912c247-294a-4fc0-8818-8fd3de607123 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:34.189883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912c247-294a-4fc0-8818-8fd3de607123 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:34.224160 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2bce7a-c01a-476d-9c6e-51b9e18a6bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:34.225354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bce7a-c01a-476d-9c6e-51b9e18a6bb4 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:34.225840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bce7a-c01a-476d-9c6e-51b9e18a6bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:34.226360 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bce7a-c01a-476d-9c6e-51b9e18a6bb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:34.238027 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2bce7a-c01a-476d-9c6e-51b9e18a6bb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:34.239789 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2bce7a-c01a-476d-9c6e-51b9e18a6bb4 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:34.258912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-0a2bce7a-c01a-476d-9c6e-51b9e18a6bb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:19:34.258912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:19:34.258912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:19:34.258912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:19:34.258912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:19:34.258912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:19:34.258912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:19:34.258912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:19:34.258912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:19:34.258912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:19:34.258912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:19:34.258912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:19:34.258912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:19:34.258912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:19:34.258912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:19:34.259781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:19:34.259781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:19:34.259781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:19:34.259781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:19:34.259781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:19:34.259781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:19:34.259781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:19:34.259781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:19:34.259781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:19:34.259781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:19:34.259781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:19:34.259781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:19:34.259781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:19:34.259781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:19:34.259781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:19:34.259781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:19:34.259781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:19:34.260598 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:19:34.260598 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:19:34.260598 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:19:34.260598 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:19:34.262889 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 14/24] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:19:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:19:34.270975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b80da-5051-4a6a-8652-fc7aacae1b72 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:34.340427 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c825d-de0a-432d-aaa2-2c89d49613e4 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:34.341051 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c825d-de0a-432d-aaa2-2c89d49613e4 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:34.341560 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c825d-de0a-432d-aaa2-2c89d49613e4 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:34.343191 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 15/25] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:19:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:19:34.349366 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c486b-5054-402c-8041-f42cb61b221b None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:34.350157 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c486b-5054-402c-8041-f42cb61b221b None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:34.350763 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c486b-5054-402c-8041-f42cb61b221b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:34.370863 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-0f6c486b-5054-402c-8041-f42cb61b221b None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:19:34.373380 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-0f6c486b-5054-402c-8041-f42cb61b221b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:19:34.449393 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 16/26] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:19:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:19:34.451668 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60ac2f-0402-4a5d-9cf0-d5627e79d5bf None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:34.452164 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60ac2f-0402-4a5d-9cf0-d5627e79d5bf None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:34.452642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60ac2f-0402-4a5d-9cf0-d5627e79d5bf None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:34.454162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 17/27] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:19:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:19:34.459854 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba0d26-a6f0-4368-a073-6a4f2598ee07 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:34.460393 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba0d26-a6f0-4368-a073-6a4f2598ee07 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:34.460870 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba0d26-a6f0-4368-a073-6a4f2598ee07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:34.480006 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b80da-5051-4a6a-8652-fc7aacae1b72 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:34.492749 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-95ba0d26-a6f0-4368-a073-6a4f2598ee07 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:19:34.493980 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-95ba0d26-a6f0-4368-a073-6a4f2598ee07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:19:34.517310 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57a2f0-50fc-4272-b7fb-720b50b262ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:34.518347 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57a2f0-50fc-4272-b7fb-720b50b262ee None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:34.518833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57a2f0-50fc-4272-b7fb-720b50b262ee None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:34.519314 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57a2f0-50fc-4272-b7fb-720b50b262ee None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:34.520231 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae57a2f0-50fc-4272-b7fb-720b50b262ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:19:34.520759 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae57a2f0-50fc-4272-b7fb-720b50b262ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:34.522365 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae57a2f0-50fc-4272-b7fb-720b50b262ee None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:34.534806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 11/28] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:34.535853 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57a2f0-50fc-4272-b7fb-720b50b262ee None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:34.623698 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 18/29] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:19:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:19:34.624663 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba0d26-a6f0-4368-a073-6a4f2598ee07 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:34.675515 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57a2f0-50fc-4272-b7fb-720b50b262ee None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:34.708915 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6666a83-51f3-4d85-bd63-b8fe0257861e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:34.709944 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6666a83-51f3-4d85-bd63-b8fe0257861e None admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:34.710432 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6666a83-51f3-4d85-bd63-b8fe0257861e None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:34.710926 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6666a83-51f3-4d85-bd63-b8fe0257861e None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:34.711885 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6666a83-51f3-4d85-bd63-b8fe0257861e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:34.713477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6666a83-51f3-4d85-bd63-b8fe0257861e None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:34.777115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba0d26-a6f0-4368-a073-6a4f2598ee07 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:34.827660 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fe208-4e0e-4298-a2ab-23c30770594e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:34.828332 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fe208-4e0e-4298-a2ab-23c30770594e None admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:34.828618 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fe208-4e0e-4298-a2ab-23c30770594e None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:34.828896 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fe208-4e0e-4298-a2ab-23c30770594e None admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:34.829611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8fe208-4e0e-4298-a2ab-23c30770594e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:34.831112 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8fe208-4e0e-4298-a2ab-23c30770594e None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:34.843514 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 12/30] 10.222.0.60 () {60 vars in 1131 bytes} [Thu May 12 09:19:34 2022] POST /identity/v3/roles => generated 225 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:19:34.844834 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6666a83-51f3-4d85-bd63-b8fe0257861e None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:34.999297 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 19/31] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 12 09:19:34 2022] POST /identity/v3/projects => generated 301 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:19:35.000881 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608b643-89a0-4121-942e-60de737e6d18 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:35.001176 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608b643-89a0-4121-942e-60de737e6d18 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:35.001450 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608b643-89a0-4121-942e-60de737e6d18 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:35.003287 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 20/32] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:19:35.021447 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587305a-372b-4686-814c-a904e20efe00 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:35.021992 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587305a-372b-4686-814c-a904e20efe00 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:35.022417 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587305a-372b-4686-814c-a904e20efe00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:35.049110 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-f587305a-372b-4686-814c-a904e20efe00 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:19:35.051024 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-f587305a-372b-4686-814c-a904e20efe00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:19:35.076631 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6666a83-51f3-4d85-bd63-b8fe0257861e None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:35.133247 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 21/33] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:19:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:19:35.180163 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c49c59-3a7e-4bd9-9a1c-82c9cda55519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:35.181019 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c49c59-3a7e-4bd9-9a1c-82c9cda55519 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:35.181302 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c49c59-3a7e-4bd9-9a1c-82c9cda55519 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:35.181586 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c49c59-3a7e-4bd9-9a1c-82c9cda55519 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:35.189017 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587305a-372b-4686-814c-a904e20efe00 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:35.219097 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c49c59-3a7e-4bd9-9a1c-82c9cda55519 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:19:35.236277 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-a8c49c59-3a7e-4bd9-9a1c-82c9cda55519 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:19:35.236277 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:19:35.236277 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:19:35.236277 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:19:35.236277 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:19:35.236277 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:19:35.236277 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:19:35.236277 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:19:35.236277 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:19:35.236277 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:19:35.236277 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:19:35.236277 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:19:35.236277 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:19:35.236277 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:19:35.236277 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:19:35.236277 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:19:35.237209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:19:35.237209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:19:35.237209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:19:35.237209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:19:35.237209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:19:35.237209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:19:35.237209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:19:35.237209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:19:35.237209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:19:35.237209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:19:35.237209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:19:35.237209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:19:35.237209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:19:35.237209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:19:35.237209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:19:35.237209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:19:35.238000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:19:35.238000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:19:35.238000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:19:35.238000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:19:35.238000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:19:35.238000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:19:35.238000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:19:35.238000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:19:35.238000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:19:35.238000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:19:35.238000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:19:35.238000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:19:35.238000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 13/34] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:19:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:19:35.244902 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c49c59-3a7e-4bd9-9a1c-82c9cda55519 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:35.315645 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587305a-372b-4686-814c-a904e20efe00 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:35.355931 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e7bb2-fc6e-4ab5-beae-7d2499fb7554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:35.356613 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e7bb2-fc6e-4ab5-beae-7d2499fb7554 None admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:35.356944 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e7bb2-fc6e-4ab5-beae-7d2499fb7554 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:35.357739 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e7bb2-fc6e-4ab5-beae-7d2499fb7554 None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:35.358533 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e7bb2-fc6e-4ab5-beae-7d2499fb7554 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:35.360288 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e7bb2-fc6e-4ab5-beae-7d2499fb7554 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:35.383658 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 22/35] 10.222.0.60 () {60 vars in 1131 bytes} [Thu May 12 09:19:35 2022] POST /identity/v3/roles => generated 219 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:19:35.414597 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c49c59-3a7e-4bd9-9a1c-82c9cda55519 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:35.459652 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544ba93-5976-4ad1-ad3b-e8f7e0d51f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:35.460788 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544ba93-5976-4ad1-ad3b-e8f7e0d51f87 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:35.461294 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544ba93-5976-4ad1-ad3b-e8f7e0d51f87 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:35.461773 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544ba93-5976-4ad1-ad3b-e8f7e0d51f87 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:35.462869 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544ba93-5976-4ad1-ad3b-e8f7e0d51f87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:19:35.463402 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544ba93-5976-4ad1-ad3b-e8f7e0d51f87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:35.465295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544ba93-5976-4ad1-ad3b-e8f7e0d51f87 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:35.480206 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 14/36] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:19:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:19:35.486734 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e7bb2-fc6e-4ab5-beae-7d2499fb7554 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:35.604974 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e7bb2-fc6e-4ab5-beae-7d2499fb7554 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:35.611758 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c6596-3e6a-4c5a-8344-14bfeaf24c74 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:35.612041 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c6596-3e6a-4c5a-8344-14bfeaf24c74 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:35.612324 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c6596-3e6a-4c5a-8344-14bfeaf24c74 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:35.613688 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 15/37] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:19:35.618951 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d5ffe-82a9-4347-9d25-6a921cf912ab None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:35.619364 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d5ffe-82a9-4347-9d25-6a921cf912ab None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:35.619738 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d5ffe-82a9-4347-9d25-6a921cf912ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:35.642027 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-436d5ffe-82a9-4347-9d25-6a921cf912ab None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:19:35.644334 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-436d5ffe-82a9-4347-9d25-6a921cf912ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:19:35.644718 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e72b6b-eeb2-4df5-b463-cb1c1a37c7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:35.645791 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e72b6b-eeb2-4df5-b463-cb1c1a37c7b4 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:35.646259 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e72b6b-eeb2-4df5-b463-cb1c1a37c7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:35.646664 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e72b6b-eeb2-4df5-b463-cb1c1a37c7b4 None admin] PATH_INFO: `/v3/users/025f1b162f424dda98fae8e2f23a6180` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:35.648091 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e72b6b-eeb2-4df5-b463-cb1c1a37c7b4 None admin] RBAC: Authorizing `identity:get_user(user_id=025f1b162f424dda98fae8e2f23a6180)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:35.649714 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e72b6b-eeb2-4df5-b463-cb1c1a37c7b4 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:35.651563 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 23/38] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:19:35 2022] GET /identity/v3/users/025f1b162f424dda98fae8e2f23a6180 => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:19:35.660270 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e72b6b-eeb2-4df5-b463-cb1c1a37c7b4 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:35.720349 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 16/39] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:19:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:19:35.742682 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d5ffe-82a9-4347-9d25-6a921cf912ab None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:35.759498 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e72b6b-eeb2-4df5-b463-cb1c1a37c7b4 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:35.791774 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69dbe3-f0a0-4525-a5ce-a221f6069a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:35.792568 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69dbe3-f0a0-4525-a5ce-a221f6069a8f None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:35.792852 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69dbe3-f0a0-4525-a5ce-a221f6069a8f None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:35.793127 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69dbe3-f0a0-4525-a5ce-a221f6069a8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:35.794366 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69dbe3-f0a0-4525-a5ce-a221f6069a8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:35.795876 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69dbe3-f0a0-4525-a5ce-a221f6069a8f None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:35.797517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 24/40] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:19:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:35.798732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdaeb2c-acdd-4e36-bcad-7dd64cb98f60 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:35.799020 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdaeb2c-acdd-4e36-bcad-7dd64cb98f60 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:35.799299 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdaeb2c-acdd-4e36-bcad-7dd64cb98f60 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:35.800513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 25/41] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:19:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:19:35.802896 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdaeb2c-acdd-4e36-bcad-7dd64cb98f60 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:35.840832 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d5ffe-82a9-4347-9d25-6a921cf912ab None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:35.872209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741aaadd-3ed5-4c8e-b757-2ec1ec09bd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:35.872845 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aaadd-3ed5-4c8e-b757-2ec1ec09bd1c None admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:35.873128 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aaadd-3ed5-4c8e-b757-2ec1ec09bd1c None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:35.873405 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aaadd-3ed5-4c8e-b757-2ec1ec09bd1c None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:35.874184 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741aaadd-3ed5-4c8e-b757-2ec1ec09bd1c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:35.875554 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741aaadd-3ed5-4c8e-b757-2ec1ec09bd1c None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:35.901927 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 17/42] 10.222.0.60 () {60 vars in 1131 bytes} [Thu May 12 09:19:35 2022] POST /identity/v3/roles => generated 223 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:19:35.901927 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934bd9b-c503-4327-ae21-72d04086bbc4 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:35.901927 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934bd9b-c503-4327-ae21-72d04086bbc4 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:35.901927 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934bd9b-c503-4327-ae21-72d04086bbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:35.902391 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdaeb2c-acdd-4e36-bcad-7dd64cb98f60 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:35.909127 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-7934bd9b-c503-4327-ae21-72d04086bbc4 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:19:35.910418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-7934bd9b-c503-4327-ae21-72d04086bbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:19:35.938834 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3f3d1-c83b-4a2b-ba5b-7312ce62cb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:35.939722 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3f3d1-c83b-4a2b-ba5b-7312ce62cb39 None admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:35.940016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3f3d1-c83b-4a2b-ba5b-7312ce62cb39 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:35.940296 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3f3d1-c83b-4a2b-ba5b-7312ce62cb39 None admin] PATH_INFO: `/v3/domains/default/users/025f1b162f424dda98fae8e2f23a6180/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:35.942436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce3f3d1-c83b-4a2b-ba5b-7312ce62cb39 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=025f1b162f424dda98fae8e2f23a6180, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:35.943939 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce3f3d1-c83b-4a2b-ba5b-7312ce62cb39 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:35.960211 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 26/43] 10.222.0.60 () {58 vars in 1361 bytes} [Thu May 12 09:19:35 2022] PUT /identity/v3/domains/default/users/025f1b162f424dda98fae8e2f23a6180/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:19:35.983444 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 18/44] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:19:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:19:36.007719 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3f3d1-c83b-4a2b-ba5b-7312ce62cb39 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:36.119741 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3f3d1-c83b-4a2b-ba5b-7312ce62cb39 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:36.156761 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d50a4f-4528-41c7-be89-bce003cd4aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:36.157508 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d50a4f-4528-41c7-be89-bce003cd4aad None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:36.157792 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d50a4f-4528-41c7-be89-bce003cd4aad None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:36.158111 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d50a4f-4528-41c7-be89-bce003cd4aad None admin] PATH_INFO: `/v3/domains/default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:36.159321 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d50a4f-4528-41c7-be89-bce003cd4aad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:36.160801 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d50a4f-4528-41c7-be89-bce003cd4aad None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:36.162487 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 27/45] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:19:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:36.168457 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934bd9b-c503-4327-ae21-72d04086bbc4 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:36.261962 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934bd9b-c503-4327-ae21-72d04086bbc4 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:36.295427 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15ca2b-ad9f-4e34-8457-19565c541bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:36.296081 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15ca2b-ad9f-4e34-8457-19565c541bf4 None admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:36.296518 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15ca2b-ad9f-4e34-8457-19565c541bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:36.296791 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15ca2b-ad9f-4e34-8457-19565c541bf4 None admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:36.299179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15ca2b-ad9f-4e34-8457-19565c541bf4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:36.302007 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15ca2b-ad9f-4e34-8457-19565c541bf4 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:36.335062 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 19/46] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 12 09:19:36 2022] POST /identity/v3/projects => generated 312 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:19:38.175855 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62334011-138f-4326-b8c1-72c97f481548 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:38.176400 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62334011-138f-4326-b8c1-72c97f481548 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:38.176400 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62334011-138f-4326-b8c1-72c97f481548 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:38.177748 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 28/47] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:19:38.183085 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24386ada-c0a3-496b-9399-2cb4916a1963 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:38.183491 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24386ada-c0a3-496b-9399-2cb4916a1963 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:38.183763 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24386ada-c0a3-496b-9399-2cb4916a1963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:38.201276 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-24386ada-c0a3-496b-9399-2cb4916a1963 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:19:38.202487 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-24386ada-c0a3-496b-9399-2cb4916a1963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:19:38.264751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 20/48] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:19:38.286850 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62334011-138f-4326-b8c1-72c97f481548 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:38.398040 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62334011-138f-4326-b8c1-72c97f481548 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:38.430828 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d712c-0dd0-4d15-bde7-171f44e2e9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:38.431616 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d712c-0dd0-4d15-bde7-171f44e2e9f2 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:38.431903 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d712c-0dd0-4d15-bde7-171f44e2e9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:38.432183 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d712c-0dd0-4d15-bde7-171f44e2e9f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:38.442371 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d712c-0dd0-4d15-bde7-171f44e2e9f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:19:38.449983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-480d712c-0dd0-4d15-bde7-171f44e2e9f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:19:38.449983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:19:38.449983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:19:38.449983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:19:38.449983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:19:38.449983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:19:38.449983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:19:38.449983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:19:38.449983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:19:38.449983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:19:38.449983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:19:38.449983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:19:38.449983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:19:38.449983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:19:38.449983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:19:38.449983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:19:38.451649 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:19:38.451649 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:19:38.451649 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:19:38.451649 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:19:38.451649 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:19:38.451649 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:19:38.451649 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:19:38.451649 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:19:38.451649 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:19:38.451649 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:19:38.451649 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:19:38.451649 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:19:38.451649 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:19:38.451649 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:19:38.451649 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:19:38.451649 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:19:38.452611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:19:38.452611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:19:38.452611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:19:38.452611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:19:38.452611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:19:38.452611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:19:38.452611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:19:38.452611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:19:38.452611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:19:38.452611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:19:38.452611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:19:38.452611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:19:38.452611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 29/49] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:19:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:19:38.459183 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24386ada-c0a3-496b-9399-2cb4916a1963 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:38.551092 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24386ada-c0a3-496b-9399-2cb4916a1963 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:38.562283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd158eb0-0e5a-4d63-a90c-d13e39e0a539 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:38.562574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd158eb0-0e5a-4d63-a90c-d13e39e0a539 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:38.563443 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd158eb0-0e5a-4d63-a90c-d13e39e0a539 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:38.564801 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 30/50] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:19:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:19:38.569709 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4efefb-43f0-48e2-9c57-685cc12714d5 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:38.570023 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4efefb-43f0-48e2-9c57-685cc12714d5 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:38.570299 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4efefb-43f0-48e2-9c57-685cc12714d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:38.584834 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edb553-df08-4197-b046-7dde222739cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:38.585508 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edb553-df08-4197-b046-7dde222739cd None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:38.585791 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edb553-df08-4197-b046-7dde222739cd None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:38.586087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-cb4efefb-43f0-48e2-9c57-685cc12714d5 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:19:38.586180 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edb553-df08-4197-b046-7dde222739cd None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:38.586842 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20edb553-df08-4197-b046-7dde222739cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:19:38.587156 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20edb553-df08-4197-b046-7dde222739cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:38.587291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-cb4efefb-43f0-48e2-9c57-685cc12714d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:19:38.588623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20edb553-df08-4197-b046-7dde222739cd None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:38.597397 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 21/51] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:19:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:38.602848 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edb553-df08-4197-b046-7dde222739cd None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:38.651523 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 31/52] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:19:38.674294 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4efefb-43f0-48e2-9c57-685cc12714d5 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:38.698493 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edb553-df08-4197-b046-7dde222739cd None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:38.730542 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f8145-63b7-4237-9f46-9e3b60922283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:38.731413 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f8145-63b7-4237-9f46-9e3b60922283 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:38.732211 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f8145-63b7-4237-9f46-9e3b60922283 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:38.732486 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f8145-63b7-4237-9f46-9e3b60922283 None admin] PATH_INFO: `/v3/users/025f1b162f424dda98fae8e2f23a6180` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:38.733946 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f8145-63b7-4237-9f46-9e3b60922283 None admin] RBAC: Authorizing `identity:get_user(user_id=025f1b162f424dda98fae8e2f23a6180)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:38.735391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f8145-63b7-4237-9f46-9e3b60922283 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:38.737215 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 22/53] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:19:38 2022] GET /identity/v3/users/025f1b162f424dda98fae8e2f23a6180 => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:19:38.742443 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f8145-63b7-4237-9f46-9e3b60922283 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:38.767612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4efefb-43f0-48e2-9c57-685cc12714d5 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:38.799429 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc96d83-2223-4519-a911-10f415e0fff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:38.800216 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc96d83-2223-4519-a911-10f415e0fff8 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:38.800500 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc96d83-2223-4519-a911-10f415e0fff8 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:38.800776 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc96d83-2223-4519-a911-10f415e0fff8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:38.801991 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc96d83-2223-4519-a911-10f415e0fff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:38.803445 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc96d83-2223-4519-a911-10f415e0fff8 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:38.805055 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 32/54] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:19:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:19:38.811008 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc96d83-2223-4519-a911-10f415e0fff8 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:38.834684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f8145-63b7-4237-9f46-9e3b60922283 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:38.866628 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360de0e-6e8b-4760-8eef-a48fdb54c592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:38.867428 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360de0e-6e8b-4760-8eef-a48fdb54c592 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:38.867717 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360de0e-6e8b-4760-8eef-a48fdb54c592 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:38.867997 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360de0e-6e8b-4760-8eef-a48fdb54c592 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:38.869193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360de0e-6e8b-4760-8eef-a48fdb54c592 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:38.870688 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360de0e-6e8b-4760-8eef-a48fdb54c592 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:38.872295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 23/55] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:19:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:19:38.878477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360de0e-6e8b-4760-8eef-a48fdb54c592 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:38.903273 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc96d83-2223-4519-a911-10f415e0fff8 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:38.935583 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775af39-6080-4591-8daf-0c867af3bb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:38.936242 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775af39-6080-4591-8daf-0c867af3bb71 None admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:38.936533 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775af39-6080-4591-8daf-0c867af3bb71 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:38.936808 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775af39-6080-4591-8daf-0c867af3bb71 None admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:38.937511 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775af39-6080-4591-8daf-0c867af3bb71 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:38.938974 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775af39-6080-4591-8daf-0c867af3bb71 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:38.963623 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 33/56] 10.222.0.60 () {60 vars in 1140 bytes} [Thu May 12 09:19:38 2022] POST /identity/v3/projects => generated 298 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:19:38.972549 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360de0e-6e8b-4760-8eef-a48fdb54c592 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:39.009551 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a7ead-8f56-417f-8c35-bfcf32b31353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:39.010255 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a7ead-8f56-417f-8c35-bfcf32b31353 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:39.010536 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a7ead-8f56-417f-8c35-bfcf32b31353 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:39.010808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a7ead-8f56-417f-8c35-bfcf32b31353 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:39.011638 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a7ead-8f56-417f-8c35-bfcf32b31353 None admin] RBAC: Adding query filter params (role.id=8f01c4c38fa44034a54c1f8cd2d2db1a, scope.domain.id=default, user.id=025f1b162f424dda98fae8e2f23a6180) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:19:39.011948 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a7ead-8f56-417f-8c35-bfcf32b31353 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:39.013488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a7ead-8f56-417f-8c35-bfcf32b31353 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:39.023075 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 24/57] 10.222.0.60 () {56 vars in 1322 bytes} [Thu May 12 09:19:38 2022] GET /identity/v3/role_assignments?user.id=025f1b162f424dda98fae8e2f23a6180&scope.domain.id=default&role.id=8f01c4c38fa44034a54c1f8cd2d2db1a => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:19:41.175013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db04ae-ea45-4a05-95b9-9f650fa0c7a9 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:41.175481 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db04ae-ea45-4a05-95b9-9f650fa0c7a9 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:41.175597 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db04ae-ea45-4a05-95b9-9f650fa0c7a9 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:41.176925 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 34/58] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:19:41.182117 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebdc03-b846-4a67-b996-c00bc07bfa04 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:41.182512 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebdc03-b846-4a67-b996-c00bc07bfa04 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:41.182679 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebdc03-b846-4a67-b996-c00bc07bfa04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:41.199339 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-60ebdc03-b846-4a67-b996-c00bc07bfa04 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:19:41.201124 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-60ebdc03-b846-4a67-b996-c00bc07bfa04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:19:41.262842 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 25/59] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:19:41.286465 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db04ae-ea45-4a05-95b9-9f650fa0c7a9 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:41.382285 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db04ae-ea45-4a05-95b9-9f650fa0c7a9 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:41.413271 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1ee30-d09c-417c-95a2-38497764515f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:41.414075 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1ee30-d09c-417c-95a2-38497764515f None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:41.414365 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1ee30-d09c-417c-95a2-38497764515f None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:41.414641 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1ee30-d09c-417c-95a2-38497764515f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:41.415814 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1ee30-d09c-417c-95a2-38497764515f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:41.417254 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1ee30-d09c-417c-95a2-38497764515f None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:41.418860 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 35/60] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:19:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:41.424804 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebdc03-b846-4a67-b996-c00bc07bfa04 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:41.516961 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebdc03-b846-4a67-b996-c00bc07bfa04 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:41.548819 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127b7f4-f8b5-4419-94b7-9bfbbd12cf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:41.549474 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127b7f4-f8b5-4419-94b7-9bfbbd12cf0d None admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:41.549758 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127b7f4-f8b5-4419-94b7-9bfbbd12cf0d None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:41.550136 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127b7f4-f8b5-4419-94b7-9bfbbd12cf0d None admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:41.550846 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127b7f4-f8b5-4419-94b7-9bfbbd12cf0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:41.552266 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127b7f4-f8b5-4419-94b7-9bfbbd12cf0d None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:41.576832 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 26/61] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 12 09:19:41 2022] POST /identity/v3/users => generated 275 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:19:44.834662 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecf8cf-bbbd-4eae-a8d2-2f20fbc1b9f5 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:44.835682 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecf8cf-bbbd-4eae-a8d2-2f20fbc1b9f5 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:44.836187 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecf8cf-bbbd-4eae-a8d2-2f20fbc1b9f5 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:44.838002 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 36/62] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:19:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:19:44.844067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8534c42-3c76-4a79-991f-af7ec9e6b443 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:44.844902 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8534c42-3c76-4a79-991f-af7ec9e6b443 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:44.845409 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8534c42-3c76-4a79-991f-af7ec9e6b443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:44.866960 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-b8534c42-3c76-4a79-991f-af7ec9e6b443 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:19:44.868147 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-b8534c42-3c76-4a79-991f-af7ec9e6b443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:19:44.925633 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28703d26-010c-4141-a723-e7eab6390b06 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:44.926286 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28703d26-010c-4141-a723-e7eab6390b06 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:44.926768 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28703d26-010c-4141-a723-e7eab6390b06 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:44.928599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 37/63] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:19:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:19:44.933850 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d33db-cb13-43be-9d48-f52257eb5f61 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:44.934393 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d33db-cb13-43be-9d48-f52257eb5f61 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:44.935381 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d33db-cb13-43be-9d48-f52257eb5f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:44.946440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 27/64] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:19:44.966975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-a37d33db-cb13-43be-9d48-f52257eb5f61 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:19:44.968162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-a37d33db-cb13-43be-9d48-f52257eb5f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:19:44.968277 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8534c42-3c76-4a79-991f-af7ec9e6b443 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:45.074262 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8534c42-3c76-4a79-991f-af7ec9e6b443 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:45.078925 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 38/65] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:19:45.117678 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300afff-441a-4414-814a-d8a7fa2a994a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:45.118545 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300afff-441a-4414-814a-d8a7fa2a994a None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:45.118829 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300afff-441a-4414-814a-d8a7fa2a994a None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:45.119103 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300afff-441a-4414-814a-d8a7fa2a994a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:45.127029 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d33db-cb13-43be-9d48-f52257eb5f61 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:45.131927 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300afff-441a-4414-814a-d8a7fa2a994a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:19:45.140233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-a300afff-441a-4414-814a-d8a7fa2a994a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:19:45.140233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:19:45.140233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:19:45.140233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:19:45.140233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:19:45.140233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:19:45.140233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:19:45.140233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:19:45.140233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:19:45.140233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:19:45.140233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:19:45.140233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:19:45.140233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:19:45.140233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:19:45.140233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:19:45.140233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:19:45.141173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:19:45.141173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:19:45.141173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:19:45.141173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:19:45.141173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:19:45.141173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:19:45.141173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:19:45.141173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:19:45.141173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:19:45.141173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:19:45.141173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:19:45.141173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:19:45.141173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:19:45.141173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:19:45.141173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:19:45.141173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:19:45.142048 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:19:45.142048 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:19:45.142048 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:19:45.142048 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:19:45.142048 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:19:45.142048 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:19:45.142048 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:19:45.142048 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:19:45.142048 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:19:45.142048 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:19:45.142048 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:19:45.142048 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:19:45.144840 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 28/66] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:19:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:19:45.150985 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300afff-441a-4414-814a-d8a7fa2a994a None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:45.231261 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d33db-cb13-43be-9d48-f52257eb5f61 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:45.272333 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b7a93-543e-48ff-b05f-d29788618467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:45.273545 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b7a93-543e-48ff-b05f-d29788618467 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:45.274046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b7a93-543e-48ff-b05f-d29788618467 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:45.274546 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b7a93-543e-48ff-b05f-d29788618467 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:45.294797 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b7a93-543e-48ff-b05f-d29788618467 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:19:45.303406 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-b35b7a93-543e-48ff-b05f-d29788618467 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 09:19:45.303406 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:19:45.303406 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:19:45.303406 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:19:45.303406 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:19:45.303406 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:19:45.303406 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:19:45.303406 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:19:45.303406 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:19:45.303406 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:19:45.303406 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:19:45.303406 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:19:45.303406 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:19:45.303406 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:19:45.303406 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:19:45.303406 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:19:45.304255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:19:45.304255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:19:45.304255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:19:45.304255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:19:45.304255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:19:45.304255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:19:45.304255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:19:45.304255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:19:45.304255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:19:45.304255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:19:45.304255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:19:45.304255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:19:45.304255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:19:45.304255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:19:45.304255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:19:45.304255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:19:45.305019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:19:45.305019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:19:45.305019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:19:45.305019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:19:45.305019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:19:45.305019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:19:45.305019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:19:45.305019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:19:45.305019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:19:45.305019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:19:45.305019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 09:19:45.305019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:19:45.315276 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 39/67] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:19:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:19:45.320983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9fd5a-6b2e-41b8-a736-e418b8819ce9 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:45.321277 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9fd5a-6b2e-41b8-a736-e418b8819ce9 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:45.321560 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9fd5a-6b2e-41b8-a736-e418b8819ce9 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:45.323165 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 40/68] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:19:45.323868 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9fd5a-6b2e-41b8-a736-e418b8819ce9 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:45.329309 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300afff-441a-4414-814a-d8a7fa2a994a None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:45.373509 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93169c6f-54b7-47a6-af67-4dc90407f755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:45.375044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93169c6f-54b7-47a6-af67-4dc90407f755 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:45.375537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93169c6f-54b7-47a6-af67-4dc90407f755 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:45.376004 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93169c6f-54b7-47a6-af67-4dc90407f755 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:45.377306 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93169c6f-54b7-47a6-af67-4dc90407f755 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:19:45.378136 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93169c6f-54b7-47a6-af67-4dc90407f755 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:45.380443 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93169c6f-54b7-47a6-af67-4dc90407f755 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:45.391706 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 29/69] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:19:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:45.393278 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8d007-9b00-4ae2-8960-fb825db76760 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:45.393762 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8d007-9b00-4ae2-8960-fb825db76760 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:45.394252 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8d007-9b00-4ae2-8960-fb825db76760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:45.413197 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-dbd8d007-9b00-4ae2-8960-fb825db76760 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:19:45.414425 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-dbd8d007-9b00-4ae2-8960-fb825db76760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:19:45.444276 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9fd5a-6b2e-41b8-a736-e418b8819ce9 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:45.476850 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcd402-8991-4c01-a80e-d856ed2972c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:45.477574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcd402-8991-4c01-a80e-d856ed2972c0 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:45.477862 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcd402-8991-4c01-a80e-d856ed2972c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:45.478170 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcd402-8991-4c01-a80e-d856ed2972c0 None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:45.478918 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbcd402-8991-4c01-a80e-d856ed2972c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:19:45.479228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbcd402-8991-4c01-a80e-d856ed2972c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:45.480703 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 30/70] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:19:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:19:45.481301 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8d007-9b00-4ae2-8960-fb825db76760 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:45.490076 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbcd402-8991-4c01-a80e-d856ed2972c0 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:45.503434 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 41/71] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 12 09:19:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:45.505149 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160fce9-b3bd-4631-bdfd-5921b72863f8 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:45.505641 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160fce9-b3bd-4631-bdfd-5921b72863f8 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:45.506177 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160fce9-b3bd-4631-bdfd-5921b72863f8 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:45.511475 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 42/72] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:19:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:19:45.511908 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160fce9-b3bd-4631-bdfd-5921b72863f8 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:45.589103 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8d007-9b00-4ae2-8960-fb825db76760 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:45.618574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160fce9-b3bd-4631-bdfd-5921b72863f8 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:45.622343 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fccd96f-f8d1-450b-8eb3-390121557c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:45.623238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccd96f-f8d1-450b-8eb3-390121557c2b None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:45.623607 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccd96f-f8d1-450b-8eb3-390121557c2b None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:45.623836 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccd96f-f8d1-450b-8eb3-390121557c2b None admin] PATH_INFO: `/v3/users/025f1b162f424dda98fae8e2f23a6180` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:45.625046 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fccd96f-f8d1-450b-8eb3-390121557c2b None admin] RBAC: Authorizing `identity:get_user(user_id=025f1b162f424dda98fae8e2f23a6180)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:45.626839 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fccd96f-f8d1-450b-8eb3-390121557c2b None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:45.628474 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 31/73] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:19:45 2022] GET /identity/v3/users/025f1b162f424dda98fae8e2f23a6180 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:45.629238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fccd96f-f8d1-450b-8eb3-390121557c2b None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:45.663656 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9773bcf-05b8-46ed-b9cc-78ae13305f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:45.664780 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9773bcf-05b8-46ed-b9cc-78ae13305f71 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:45.665261 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9773bcf-05b8-46ed-b9cc-78ae13305f71 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:45.665758 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9773bcf-05b8-46ed-b9cc-78ae13305f71 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:45.676870 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9773bcf-05b8-46ed-b9cc-78ae13305f71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:19:45.684655 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-f9773bcf-05b8-46ed-b9cc-78ae13305f71 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 09:19:45.684655 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:19:45.684655 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:19:45.684655 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:19:45.684655 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:19:45.684655 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:19:45.684655 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:19:45.684655 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:19:45.684655 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:19:45.684655 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:19:45.684655 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:19:45.684655 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:19:45.684655 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:19:45.684655 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:19:45.684655 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:19:45.684655 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:19:45.686070 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:19:45.686070 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:19:45.686070 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:19:45.686070 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:19:45.686070 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:19:45.686070 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:19:45.686070 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:19:45.686070 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:19:45.686070 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:19:45.686070 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:19:45.686070 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:19:45.686070 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:19:45.686070 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:19:45.686070 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:19:45.686070 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:19:45.686070 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:19:45.686832 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:19:45.686832 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:19:45.686832 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:19:45.686832 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:19:45.686832 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:19:45.686832 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:19:45.686832 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:19:45.686832 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:19:45.686832 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:19:45.686832 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:19:45.686832 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 09:19:45.686832 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:19:45.686832 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 43/74] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:19:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:19:45.687555 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393da41b-2df5-4a6d-8821-99f11239f0fb None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:45.687866 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393da41b-2df5-4a6d-8821-99f11239f0fb None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:45.688136 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393da41b-2df5-4a6d-8821-99f11239f0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:45.706710 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-393da41b-2df5-4a6d-8821-99f11239f0fb None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:19:45.707911 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-393da41b-2df5-4a6d-8821-99f11239f0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:19:45.729295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fccd96f-f8d1-450b-8eb3-390121557c2b None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:45.762128 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5798b86-dddb-4f04-9177-6ff8d53e22e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:45.763570 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5798b86-dddb-4f04-9177-6ff8d53e22e0 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:45.763858 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5798b86-dddb-4f04-9177-6ff8d53e22e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:45.764135 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5798b86-dddb-4f04-9177-6ff8d53e22e0 None admin] PATH_INFO: `/v3/users/6b240d8064a348a686e6f1ef20babb14` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:45.773214 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 44/75] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:19:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:19:45.774165 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393da41b-2df5-4a6d-8821-99f11239f0fb None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:45.778688 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5798b86-dddb-4f04-9177-6ff8d53e22e0 None admin] RBAC: Authorizing `identity:get_user(user_id=6b240d8064a348a686e6f1ef20babb14)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:45.780149 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5798b86-dddb-4f04-9177-6ff8d53e22e0 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:45.786598 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 32/76] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:19:45 2022] GET /identity/v3/users/6b240d8064a348a686e6f1ef20babb14 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:45.786598 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5798b86-dddb-4f04-9177-6ff8d53e22e0 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:45.865830 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393da41b-2df5-4a6d-8821-99f11239f0fb None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:45.877860 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5798b86-dddb-4f04-9177-6ff8d53e22e0 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:45.898480 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64279837-4c9f-4af2-aa8e-dd120859763c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:45.899132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64279837-4c9f-4af2-aa8e-dd120859763c None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:45.899413 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64279837-4c9f-4af2-aa8e-dd120859763c None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:45.899693 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64279837-4c9f-4af2-aa8e-dd120859763c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:45.910232 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229b630-a6dd-4533-a22c-f0081d77b38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:45.910903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229b630-a6dd-4533-a22c-f0081d77b38e None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:45.911189 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229b630-a6dd-4533-a22c-f0081d77b38e None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:45.911472 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229b630-a6dd-4533-a22c-f0081d77b38e None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:45.912226 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229b630-a6dd-4533-a22c-f0081d77b38e None admin] RBAC: Adding query filter params (name=member) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:19:45.912533 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229b630-a6dd-4533-a22c-f0081d77b38e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:45.913946 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229b630-a6dd-4533-a22c-f0081d77b38e None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:45.921575 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 33/77] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 12 09:19:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:45.922813 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd8619-9eed-4fdb-b5ba-1f2fc62786bb None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:45.923101 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd8619-9eed-4fdb-b5ba-1f2fc62786bb None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:45.923378 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd8619-9eed-4fdb-b5ba-1f2fc62786bb None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:45.924611 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 34/78] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:19:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:19:45.925307 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd8619-9eed-4fdb-b5ba-1f2fc62786bb None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:45.964070 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64279837-4c9f-4af2-aa8e-dd120859763c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:45.965559 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64279837-4c9f-4af2-aa8e-dd120859763c None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:46.021047 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd8619-9eed-4fdb-b5ba-1f2fc62786bb None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:46.052699 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39533509-cb91-4f42-a9d2-cb1f1249f38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:46.053342 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39533509-cb91-4f42-a9d2-cb1f1249f38c None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:46.053628 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39533509-cb91-4f42-a9d2-cb1f1249f38c None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:46.053928 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39533509-cb91-4f42-a9d2-cb1f1249f38c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:46.057074 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 45/79] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:19:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:19:46.057740 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64279837-4c9f-4af2-aa8e-dd120859763c None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:46.120013 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39533509-cb91-4f42-a9d2-cb1f1249f38c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:46.121497 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39533509-cb91-4f42-a9d2-cb1f1249f38c None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:46.152121 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64279837-4c9f-4af2-aa8e-dd120859763c None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:46.183458 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600456b5-03f9-4c3b-80f7-10947a156c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:46.184250 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600456b5-03f9-4c3b-80f7-10947a156c8d None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:46.184533 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600456b5-03f9-4c3b-80f7-10947a156c8d None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:46.184835 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600456b5-03f9-4c3b-80f7-10947a156c8d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:46.194261 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600456b5-03f9-4c3b-80f7-10947a156c8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:19:46.202671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-600456b5-03f9-4c3b-80f7-10947a156c8d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 09:19:46.202671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:19:46.202671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:19:46.202671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:19:46.202671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:19:46.202671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:19:46.202671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:19:46.202671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:19:46.202671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:19:46.202671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:19:46.202671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:19:46.202671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:19:46.202671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:19:46.202671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:19:46.202671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:19:46.202671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:19:46.203501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:19:46.203501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:19:46.203501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:19:46.203501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:19:46.203501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:19:46.203501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:19:46.203501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:19:46.203501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:19:46.203501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:19:46.203501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:19:46.203501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:19:46.203501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:19:46.203501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:19:46.203501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:19:46.203501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:19:46.203501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:19:46.209169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:19:46.209169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:19:46.209169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:19:46.209169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:19:46.209169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:19:46.209169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:19:46.209169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:19:46.209169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:19:46.209169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:19:46.209169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:19:46.209169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 09:19:46.209169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:19:46.209169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 46/80] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 12 09:19:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:19:46.209169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600456b5-03f9-4c3b-80f7-10947a156c8d None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:46.212981 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 35/81] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:19:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:19:46.214328 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a4371-833d-40f2-8e42-fb0cf303d6c2 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:46.214619 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a4371-833d-40f2-8e42-fb0cf303d6c2 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:46.214896 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a4371-833d-40f2-8e42-fb0cf303d6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:46.230843 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-516a4371-833d-40f2-8e42-fb0cf303d6c2 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:19:46.232031 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-516a4371-833d-40f2-8e42-fb0cf303d6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:19:46.293261 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 36/82] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:19:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:19:46.294593 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a4371-833d-40f2-8e42-fb0cf303d6c2 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:46.301247 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600456b5-03f9-4c3b-80f7-10947a156c8d None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:46.332839 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e6956-44ca-463c-96d5-8a0e56bcd84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:46.333710 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e6956-44ca-463c-96d5-8a0e56bcd84f None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:46.334022 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e6956-44ca-463c-96d5-8a0e56bcd84f None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:46.334297 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e6956-44ca-463c-96d5-8a0e56bcd84f None admin] PATH_INFO: `/v3/users/6b240d8064a348a686e6f1ef20babb14` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:46.335474 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e6956-44ca-463c-96d5-8a0e56bcd84f None admin] RBAC: Authorizing `identity:get_user(user_id=6b240d8064a348a686e6f1ef20babb14)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:46.336925 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e6956-44ca-463c-96d5-8a0e56bcd84f None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:46.338564 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 47/83] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:19:46 2022] GET /identity/v3/users/6b240d8064a348a686e6f1ef20babb14 => generated 275 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:46.339297 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e6956-44ca-463c-96d5-8a0e56bcd84f None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:46.386787 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a4371-833d-40f2-8e42-fb0cf303d6c2 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:46.423393 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9170b3-fc83-4ec7-a18e-a7c8a0297dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:46.424178 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9170b3-fc83-4ec7-a18e-a7c8a0297dcd None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:46.424456 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9170b3-fc83-4ec7-a18e-a7c8a0297dcd None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:46.424733 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9170b3-fc83-4ec7-a18e-a7c8a0297dcd None admin] PATH_INFO: `/v3/projects/43f5db26667c4824b9e1f2363e88395d` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:46.425935 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9170b3-fc83-4ec7-a18e-a7c8a0297dcd None admin] RBAC: Authorizing `identity:get_project(project_id=43f5db26667c4824b9e1f2363e88395d)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:46.427384 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9170b3-fc83-4ec7-a18e-a7c8a0297dcd None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:46.429064 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 37/84] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:19:46 2022] GET /identity/v3/projects/43f5db26667c4824b9e1f2363e88395d => generated 298 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:46.429811 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9170b3-fc83-4ec7-a18e-a7c8a0297dcd None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:46.437663 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e6956-44ca-463c-96d5-8a0e56bcd84f None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:46.468867 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447367fa-4fb3-4351-98c7-abdb696c8223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:46.469519 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447367fa-4fb3-4351-98c7-abdb696c8223 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:46.469807 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447367fa-4fb3-4351-98c7-abdb696c8223 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:46.470126 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447367fa-4fb3-4351-98c7-abdb696c8223 None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:46.470859 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447367fa-4fb3-4351-98c7-abdb696c8223 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:19:46.471208 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447367fa-4fb3-4351-98c7-abdb696c8223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:46.472606 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447367fa-4fb3-4351-98c7-abdb696c8223 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:46.480110 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 48/85] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:19:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:46.480876 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447367fa-4fb3-4351-98c7-abdb696c8223 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:46.526263 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9170b3-fc83-4ec7-a18e-a7c8a0297dcd None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:46.559332 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5f004-4d75-4897-aaaa-2cd2aab3dd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:46.560220 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5f004-4d75-4897-aaaa-2cd2aab3dd63 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:46.560504 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5f004-4d75-4897-aaaa-2cd2aab3dd63 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:46.560782 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5f004-4d75-4897-aaaa-2cd2aab3dd63 None admin] PATH_INFO: `/v3/projects/43f5db26667c4824b9e1f2363e88395d` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:46.562007 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5f004-4d75-4897-aaaa-2cd2aab3dd63 None admin] RBAC: Authorizing `identity:get_project(project_id=43f5db26667c4824b9e1f2363e88395d)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:46.563445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5f004-4d75-4897-aaaa-2cd2aab3dd63 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:46.565135 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 38/86] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:19:46 2022] GET /identity/v3/projects/43f5db26667c4824b9e1f2363e88395d => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:46.565891 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5f004-4d75-4897-aaaa-2cd2aab3dd63 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:46.574425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447367fa-4fb3-4351-98c7-abdb696c8223 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:46.606235 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f854a-ca9c-498a-b81a-d8ca87ef6704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:46.607570 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f854a-ca9c-498a-b81a-d8ca87ef6704 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:46.607856 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f854a-ca9c-498a-b81a-d8ca87ef6704 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:46.608132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f854a-ca9c-498a-b81a-d8ca87ef6704 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:46.609306 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f854a-ca9c-498a-b81a-d8ca87ef6704 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:46.610783 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f854a-ca9c-498a-b81a-d8ca87ef6704 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:46.613049 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 49/87] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:19:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:46.613197 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f854a-ca9c-498a-b81a-d8ca87ef6704 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:46.659598 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5f004-4d75-4897-aaaa-2cd2aab3dd63 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:46.690904 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce6ba4-b992-4036-896b-a6dfdaffef57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:46.691480 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce6ba4-b992-4036-896b-a6dfdaffef57 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:46.691764 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce6ba4-b992-4036-896b-a6dfdaffef57 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:46.692041 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce6ba4-b992-4036-896b-a6dfdaffef57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:46.705049 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f854a-ca9c-498a-b81a-d8ca87ef6704 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:46.736268 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392beb4b-ca14-4721-a357-c4cf61d4fa16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:46.736906 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392beb4b-ca14-4721-a357-c4cf61d4fa16 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:46.737187 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392beb4b-ca14-4721-a357-c4cf61d4fa16 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:46.737465 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392beb4b-ca14-4721-a357-c4cf61d4fa16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:46.738317 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392beb4b-ca14-4721-a357-c4cf61d4fa16 None admin] RBAC: Adding query filter params (role.id=8f01c4c38fa44034a54c1f8cd2d2db1a, scope.project.id=43f5db26667c4824b9e1f2363e88395d, user.id=025f1b162f424dda98fae8e2f23a6180) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:19:46.738630 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392beb4b-ca14-4721-a357-c4cf61d4fa16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:46.740058 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392beb4b-ca14-4721-a357-c4cf61d4fa16 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:46.745291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 50/88] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:19:46 2022] GET /identity/v3/role_assignments?user.id=025f1b162f424dda98fae8e2f23a6180&scope.project.id=43f5db26667c4824b9e1f2363e88395d&role.id=8f01c4c38fa44034a54c1f8cd2d2db1a => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:46.746087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392beb4b-ca14-4721-a357-c4cf61d4fa16 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:46.756112 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce6ba4-b992-4036-896b-a6dfdaffef57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:46.757635 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce6ba4-b992-4036-896b-a6dfdaffef57 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:46.849463 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392beb4b-ca14-4721-a357-c4cf61d4fa16 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:46.864610 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 39/89] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:19:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:19:46.865478 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce6ba4-b992-4036-896b-a6dfdaffef57 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:46.890919 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8a65b-f15a-470a-b0c4-1448730b1347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:46.891816 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8a65b-f15a-470a-b0c4-1448730b1347 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:46.892102 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8a65b-f15a-470a-b0c4-1448730b1347 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:46.892375 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8a65b-f15a-470a-b0c4-1448730b1347 None admin] PATH_INFO: `/v3/users/6b240d8064a348a686e6f1ef20babb14` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:46.893622 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8a65b-f15a-470a-b0c4-1448730b1347 None admin] RBAC: Authorizing `identity:get_user(user_id=6b240d8064a348a686e6f1ef20babb14)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:46.895139 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8a65b-f15a-470a-b0c4-1448730b1347 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:46.896792 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 51/90] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:19:46 2022] GET /identity/v3/users/6b240d8064a348a686e6f1ef20babb14 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:46.901784 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8a65b-f15a-470a-b0c4-1448730b1347 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:46.965015 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce6ba4-b992-4036-896b-a6dfdaffef57 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:46.998853 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8a65b-f15a-470a-b0c4-1448730b1347 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:46.999141 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40790351-a385-41a0-a3e9-721fe0ebe924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:46.999702 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40790351-a385-41a0-a3e9-721fe0ebe924 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:46.999981 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40790351-a385-41a0-a3e9-721fe0ebe924 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:47.000252 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40790351-a385-41a0-a3e9-721fe0ebe924 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:47.001075 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40790351-a385-41a0-a3e9-721fe0ebe924 None admin] RBAC: Adding query filter params (role.id=31076ec4ad6a42868d212118fe129d18, scope.project.id=43f5db26667c4824b9e1f2363e88395d, user.id=6b240d8064a348a686e6f1ef20babb14) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:19:47.001384 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40790351-a385-41a0-a3e9-721fe0ebe924 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:47.002861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40790351-a385-41a0-a3e9-721fe0ebe924 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:47.008550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 40/91] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:19:46 2022] GET /identity/v3/role_assignments?user.id=6b240d8064a348a686e6f1ef20babb14&scope.project.id=43f5db26667c4824b9e1f2363e88395d&role.id=31076ec4ad6a42868d212118fe129d18 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:47.009561 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40790351-a385-41a0-a3e9-721fe0ebe924 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:47.034824 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282669f-4c3d-4ebf-b89d-b43d63e215c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:47.035830 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282669f-4c3d-4ebf-b89d-b43d63e215c9 None admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:47.036295 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282669f-4c3d-4ebf-b89d-b43d63e215c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:47.036745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282669f-4c3d-4ebf-b89d-b43d63e215c9 None admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:47.037661 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282669f-4c3d-4ebf-b89d-b43d63e215c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:47.039430 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282669f-4c3d-4ebf-b89d-b43d63e215c9 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:47.070044 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 52/92] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 12 09:19:46 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:19:47.071422 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282669f-4c3d-4ebf-b89d-b43d63e215c9 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:47.165372 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40790351-a385-41a0-a3e9-721fe0ebe924 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:47.194167 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282669f-4c3d-4ebf-b89d-b43d63e215c9 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:47.231036 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb81342-c2ca-459e-accf-00ba7991bd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:47.232605 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb81342-c2ca-459e-accf-00ba7991bd5d None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:47.233101 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb81342-c2ca-459e-accf-00ba7991bd5d None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:47.233652 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb81342-c2ca-459e-accf-00ba7991bd5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:47.242347 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f885d33-d3a9-4efc-a162-c7ee937773e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:47.243360 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f885d33-d3a9-4efc-a162-c7ee937773e2 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:47.243716 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f885d33-d3a9-4efc-a162-c7ee937773e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:47.244443 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f885d33-d3a9-4efc-a162-c7ee937773e2 None admin] PATH_INFO: `/v3/projects/c2bf4930916a40b481d13e508e162fe5` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:47.247132 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f885d33-d3a9-4efc-a162-c7ee937773e2 None admin] RBAC: Authorizing `identity:get_project(project_id=c2bf4930916a40b481d13e508e162fe5)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:47.248385 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f885d33-d3a9-4efc-a162-c7ee937773e2 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:47.250545 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 41/93] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:19:47 2022] GET /identity/v3/projects/c2bf4930916a40b481d13e508e162fe5 => generated 312 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:47.256485 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f885d33-d3a9-4efc-a162-c7ee937773e2 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:47.307736 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb81342-c2ca-459e-accf-00ba7991bd5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:47.309516 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb81342-c2ca-459e-accf-00ba7991bd5d None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:47.422287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f885d33-d3a9-4efc-a162-c7ee937773e2 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:47.455417 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 53/94] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:19:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:19:47.460862 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb81342-c2ca-459e-accf-00ba7991bd5d None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:47.470420 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68cb5c1-611c-455b-bc95-65fa90dad976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:47.471180 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cb5c1-611c-455b-bc95-65fa90dad976 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:47.471552 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cb5c1-611c-455b-bc95-65fa90dad976 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:47.471900 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cb5c1-611c-455b-bc95-65fa90dad976 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:47.472819 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68cb5c1-611c-455b-bc95-65fa90dad976 None admin] RBAC: Adding query filter params (role.id=31076ec4ad6a42868d212118fe129d18, scope.project.id=c2bf4930916a40b481d13e508e162fe5, user.id=6b240d8064a348a686e6f1ef20babb14) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:19:47.473723 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68cb5c1-611c-455b-bc95-65fa90dad976 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:47.475201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68cb5c1-611c-455b-bc95-65fa90dad976 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:47.483383 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 42/95] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:19:47 2022] GET /identity/v3/role_assignments?user.id=6b240d8064a348a686e6f1ef20babb14&scope.project.id=c2bf4930916a40b481d13e508e162fe5&role.id=31076ec4ad6a42868d212118fe129d18 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:47.579416 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb81342-c2ca-459e-accf-00ba7991bd5d None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:47.620442 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19866c9c-6a18-4399-8e5a-dcf1defe8062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:47.621412 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19866c9c-6a18-4399-8e5a-dcf1defe8062 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:47.621756 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19866c9c-6a18-4399-8e5a-dcf1defe8062 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:47.622103 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19866c9c-6a18-4399-8e5a-dcf1defe8062 None admin] PATH_INFO: `/v3/projects/43f5db26667c4824b9e1f2363e88395d` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:47.623942 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19866c9c-6a18-4399-8e5a-dcf1defe8062 None admin] RBAC: Authorizing `identity:get_project(project_id=43f5db26667c4824b9e1f2363e88395d)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:47.625440 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19866c9c-6a18-4399-8e5a-dcf1defe8062 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:47.627331 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 54/96] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:19:47 2022] GET /identity/v3/projects/43f5db26667c4824b9e1f2363e88395d => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:47.633615 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68cb5c1-611c-455b-bc95-65fa90dad976 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:47.737038 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68cb5c1-611c-455b-bc95-65fa90dad976 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:47.770680 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bee438-b96c-4632-aa40-06b1dcea37e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:47.771351 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bee438-b96c-4632-aa40-06b1dcea37e6 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:47.771634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bee438-b96c-4632-aa40-06b1dcea37e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:47.771908 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bee438-b96c-4632-aa40-06b1dcea37e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:47.772738 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bee438-b96c-4632-aa40-06b1dcea37e6 None admin] RBAC: Adding query filter params (role.id=7d5eb6a968a74fb0a30eb1e80603005c, scope.project.id=43f5db26667c4824b9e1f2363e88395d, user.id=6b240d8064a348a686e6f1ef20babb14) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:19:47.773102 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bee438-b96c-4632-aa40-06b1dcea37e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:47.774917 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bee438-b96c-4632-aa40-06b1dcea37e6 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:47.782425 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 43/97] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:19:47 2022] GET /identity/v3/role_assignments?user.id=6b240d8064a348a686e6f1ef20babb14&scope.project.id=43f5db26667c4824b9e1f2363e88395d&role.id=7d5eb6a968a74fb0a30eb1e80603005c => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:49.307339 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933757b-210b-4e54-ae16-968ffd789cee None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:49.307846 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933757b-210b-4e54-ae16-968ffd789cee None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:49.307919 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933757b-210b-4e54-ae16-968ffd789cee None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:49.309248 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 55/98] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:19:49.324593 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973eb72-d167-48f6-b996-2d3980f8df87 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:49.325053 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973eb72-d167-48f6-b996-2d3980f8df87 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:49.325319 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973eb72-d167-48f6-b996-2d3980f8df87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:49.342556 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-0973eb72-d167-48f6-b996-2d3980f8df87 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:19:49.343753 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-0973eb72-d167-48f6-b996-2d3980f8df87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:19:49.430827 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 44/99] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:19:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:19:49.475431 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933757b-210b-4e54-ae16-968ffd789cee None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:49.613068 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933757b-210b-4e54-ae16-968ffd789cee None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:49.649005 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c1d31-2acb-498b-936e-9f3f37344600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:49.650182 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c1d31-2acb-498b-936e-9f3f37344600 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:49.650668 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c1d31-2acb-498b-936e-9f3f37344600 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:49.651201 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c1d31-2acb-498b-936e-9f3f37344600 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:49.668267 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c1d31-2acb-498b-936e-9f3f37344600 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:19:49.676716 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-a26c1d31-2acb-498b-936e-9f3f37344600 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:19:49.676716 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:19:49.676716 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:19:49.676716 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:19:49.676716 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:19:49.676716 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:19:49.676716 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:19:49.676716 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:19:49.676716 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:19:49.676716 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:19:49.676716 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:19:49.676716 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:19:49.676716 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:19:49.676716 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:19:49.676716 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:19:49.676716 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:19:49.677599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:19:49.677599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:19:49.677599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:19:49.677599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:19:49.677599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:19:49.677599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:19:49.677599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:19:49.677599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:19:49.677599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:19:49.677599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:19:49.677599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:19:49.677599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:19:49.677599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:19:49.677599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:19:49.677599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:19:49.677599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:19:49.682815 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:19:49.682815 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:19:49.682815 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:19:49.682815 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:19:49.682815 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:19:49.682815 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:19:49.682815 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:19:49.682815 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:19:49.682815 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:19:49.682815 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:19:49.682815 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:19:49.682815 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:19:49.684965 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 56/100] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:19:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:19:49.690984 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973eb72-d167-48f6-b996-2d3980f8df87 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:49.809418 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671dbd9-f719-4999-b00e-9ec6c0add291 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:49.810136 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671dbd9-f719-4999-b00e-9ec6c0add291 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:49.810651 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671dbd9-f719-4999-b00e-9ec6c0add291 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:49.812242 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 57/101] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:19:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:19:49.823193 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2373a-17d3-4c7d-82cf-abdb4aac946f None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:49.823772 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2373a-17d3-4c7d-82cf-abdb4aac946f None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:49.824244 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2373a-17d3-4c7d-82cf-abdb4aac946f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:49.839194 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973eb72-d167-48f6-b996-2d3980f8df87 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:49.842009 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-cba2373a-17d3-4c7d-82cf-abdb4aac946f None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:19:49.843407 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-cba2373a-17d3-4c7d-82cf-abdb4aac946f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:19:49.922626 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28332a0d-a60e-4f74-a0ee-140e8ca63849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:49.923665 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28332a0d-a60e-4f74-a0ee-140e8ca63849 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:49.924148 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28332a0d-a60e-4f74-a0ee-140e8ca63849 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:49.924716 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28332a0d-a60e-4f74-a0ee-140e8ca63849 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:49.925705 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28332a0d-a60e-4f74-a0ee-140e8ca63849 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:19:49.926227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28332a0d-a60e-4f74-a0ee-140e8ca63849 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:49.927815 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28332a0d-a60e-4f74-a0ee-140e8ca63849 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:49.940281 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 58/102] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:19:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:19:49.951957 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 45/103] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:19:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:49.957553 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2373a-17d3-4c7d-82cf-abdb4aac946f None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:49.994155 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28332a0d-a60e-4f74-a0ee-140e8ca63849 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:50.121317 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28332a0d-a60e-4f74-a0ee-140e8ca63849 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:50.157194 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2373a-17d3-4c7d-82cf-abdb4aac946f None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:50.171058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c681b-d14e-4362-a72d-de027a8924a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:50.172234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c681b-d14e-4362-a72d-de027a8924a9 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:50.172522 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c681b-d14e-4362-a72d-de027a8924a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:50.173066 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c681b-d14e-4362-a72d-de027a8924a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:50.183921 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c681b-d14e-4362-a72d-de027a8924a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:19:50.193201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-fc0c681b-d14e-4362-a72d-de027a8924a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 09:19:50.193201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:19:50.193201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:19:50.193201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:19:50.193201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:19:50.193201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:19:50.193201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:19:50.193201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:19:50.193201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:19:50.193201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:19:50.193201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:19:50.193201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:19:50.193201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:19:50.193201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:19:50.193201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:19:50.193201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:19:50.194108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:19:50.194108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:19:50.194108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:19:50.194108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:19:50.194108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:19:50.194108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:19:50.194108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:19:50.194108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:19:50.194108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:19:50.194108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:19:50.194108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:19:50.194108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:19:50.194108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:19:50.194108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:19:50.194108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:19:50.194108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:19:50.194900 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:19:50.194900 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:19:50.194900 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:19:50.194900 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:19:50.194900 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:19:50.194900 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:19:50.194900 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:19:50.194900 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:19:50.194900 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:19:50.194900 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:19:50.194900 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 09:19:50.194900 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:19:50.194900 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 46/104] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:19:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:19:50.203098 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c681b-d14e-4362-a72d-de027a8924a9 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:50.211888 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10afc95-9b18-43e9-b9bc-3ef65a5a08b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:50.212768 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10afc95-9b18-43e9-b9bc-3ef65a5a08b2 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:50.213056 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10afc95-9b18-43e9-b9bc-3ef65a5a08b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:50.213337 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10afc95-9b18-43e9-b9bc-3ef65a5a08b2 None admin] PATH_INFO: `/v3/users/025f1b162f424dda98fae8e2f23a6180` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:50.214573 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10afc95-9b18-43e9-b9bc-3ef65a5a08b2 None admin] RBAC: Authorizing `identity:get_user(user_id=025f1b162f424dda98fae8e2f23a6180)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:50.216083 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10afc95-9b18-43e9-b9bc-3ef65a5a08b2 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:50.217789 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 59/105] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:19:49 2022] GET /identity/v3/users/025f1b162f424dda98fae8e2f23a6180 => generated 247 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:19:50.223302 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10afc95-9b18-43e9-b9bc-3ef65a5a08b2 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:50.320058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c681b-d14e-4362-a72d-de027a8924a9 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:50.324980 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10afc95-9b18-43e9-b9bc-3ef65a5a08b2 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:50.353344 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a910b-05ef-4612-ab2a-23e409841513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:50.354063 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a910b-05ef-4612-ab2a-23e409841513 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:50.354348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a910b-05ef-4612-ab2a-23e409841513 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:50.354651 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a910b-05ef-4612-ab2a-23e409841513 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:50.355950 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a910b-05ef-4612-ab2a-23e409841513 None admin] RBAC: Adding query filter params (name=member) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:19:50.356259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a910b-05ef-4612-ab2a-23e409841513 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:50.358730 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a910b-05ef-4612-ab2a-23e409841513 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:50.363585 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e5e4e-6888-440f-b790-973f37de99e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:50.364676 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e5e4e-6888-440f-b790-973f37de99e4 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:50.365153 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e5e4e-6888-440f-b790-973f37de99e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:50.365607 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e5e4e-6888-440f-b790-973f37de99e4 None admin] PATH_INFO: `/v3/projects/43f5db26667c4824b9e1f2363e88395d` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:50.367025 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e5e4e-6888-440f-b790-973f37de99e4 None admin] RBAC: Authorizing `identity:get_project(project_id=43f5db26667c4824b9e1f2363e88395d)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:50.367479 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 47/106] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 12 09:19:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:50.368861 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e5e4e-6888-440f-b790-973f37de99e4 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:50.375558 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a910b-05ef-4612-ab2a-23e409841513 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:50.375806 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 60/107] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:19:50 2022] GET /identity/v3/projects/43f5db26667c4824b9e1f2363e88395d => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:50.381502 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e5e4e-6888-440f-b790-973f37de99e4 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:50.488001 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e5e4e-6888-440f-b790-973f37de99e4 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:50.500936 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a910b-05ef-4612-ab2a-23e409841513 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:50.531418 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0c930-a611-41b9-ba58-1074418d6dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:50.532656 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0c930-a611-41b9-ba58-1074418d6dba None admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:50.533119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0c930-a611-41b9-ba58-1074418d6dba None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:50.533627 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0c930-a611-41b9-ba58-1074418d6dba None admin] PATH_INFO: `/v3/projects/43f5db26667c4824b9e1f2363e88395d/users/025f1b162f424dda98fae8e2f23a6180/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:50.533747 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8a63c-9ada-49ff-9729-365134e69d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:50.534626 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8a63c-9ada-49ff-9729-365134e69d1f None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:50.534929 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8a63c-9ada-49ff-9729-365134e69d1f None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:50.535189 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8a63c-9ada-49ff-9729-365134e69d1f None admin] PATH_INFO: `/v3/users/6b240d8064a348a686e6f1ef20babb14` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:50.536449 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc8a63c-9ada-49ff-9729-365134e69d1f None admin] RBAC: Authorizing `identity:get_user(user_id=6b240d8064a348a686e6f1ef20babb14)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:50.536662 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef0c930-a611-41b9-ba58-1074418d6dba None admin] RBAC: Authorizing `identity:create_grant(project_id=43f5db26667c4824b9e1f2363e88395d, user_id=025f1b162f424dda98fae8e2f23a6180, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:50.537892 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc8a63c-9ada-49ff-9729-365134e69d1f None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:50.538493 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef0c930-a611-41b9-ba58-1074418d6dba None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:50.539848 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 48/108] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:19:50 2022] GET /identity/v3/users/6b240d8064a348a686e6f1ef20babb14 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:19:50.546061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8a63c-9ada-49ff-9729-365134e69d1f None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:50.558079 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 61/109] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 12 09:19:50 2022] PUT /identity/v3/projects/43f5db26667c4824b9e1f2363e88395d/users/025f1b162f424dda98fae8e2f23a6180/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:19:50.676959 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8a63c-9ada-49ff-9729-365134e69d1f None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:50.718214 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e9f45-6d59-4193-b4ec-927a7090baa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:50.719119 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e9f45-6d59-4193-b4ec-927a7090baa3 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:50.719410 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e9f45-6d59-4193-b4ec-927a7090baa3 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:50.719692 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e9f45-6d59-4193-b4ec-927a7090baa3 None admin] PATH_INFO: `/v3/projects/43f5db26667c4824b9e1f2363e88395d` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:50.726874 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e9f45-6d59-4193-b4ec-927a7090baa3 None admin] RBAC: Authorizing `identity:get_project(project_id=43f5db26667c4824b9e1f2363e88395d)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:50.728395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e9f45-6d59-4193-b4ec-927a7090baa3 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:50.730289 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 49/110] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:19:50 2022] GET /identity/v3/projects/43f5db26667c4824b9e1f2363e88395d => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:19:50.736126 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0c930-a611-41b9-ba58-1074418d6dba None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:50.892195 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114d9fd-3771-466d-8ed0-9abaf5da3002 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:50.892493 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114d9fd-3771-466d-8ed0-9abaf5da3002 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:50.892679 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114d9fd-3771-466d-8ed0-9abaf5da3002 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:50.894089 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 50/111] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:19:50.903400 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2beeb-4145-48bc-8f2f-57e9627f0775 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:50.903692 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2beeb-4145-48bc-8f2f-57e9627f0775 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:50.903974 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2beeb-4145-48bc-8f2f-57e9627f0775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:50.910036 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0c930-a611-41b9-ba58-1074418d6dba None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:50.937344 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-ffc2beeb-4145-48bc-8f2f-57e9627f0775 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:19:50.938582 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-ffc2beeb-4145-48bc-8f2f-57e9627f0775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:19:50.948399 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216acd6-e112-4dec-bae7-cfe9f439b121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:50.949298 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216acd6-e112-4dec-bae7-cfe9f439b121 None admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:50.949580 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216acd6-e112-4dec-bae7-cfe9f439b121 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:50.949857 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216acd6-e112-4dec-bae7-cfe9f439b121 None admin] PATH_INFO: `/v3/projects/43f5db26667c4824b9e1f2363e88395d/users/6b240d8064a348a686e6f1ef20babb14/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:50.952564 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216acd6-e112-4dec-bae7-cfe9f439b121 None admin] RBAC: Authorizing `identity:create_grant(project_id=43f5db26667c4824b9e1f2363e88395d, user_id=6b240d8064a348a686e6f1ef20babb14, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:50.953950 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216acd6-e112-4dec-bae7-cfe9f439b121 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:50.972188 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 62/112] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 12 09:19:50 2022] PUT /identity/v3/projects/43f5db26667c4824b9e1f2363e88395d/users/6b240d8064a348a686e6f1ef20babb14/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:19:51.068387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 51/113] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:19:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:19:51.108248 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216acd6-e112-4dec-bae7-cfe9f439b121 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:51.216397 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d9514-186c-4e20-a1a2-d145637ab782 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:51.216702 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d9514-186c-4e20-a1a2-d145637ab782 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:51.216871 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d9514-186c-4e20-a1a2-d145637ab782 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:51.218457 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 52/114] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:19:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:19:51.224039 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fbb65-4bcb-41e0-bd32-676a7b27de8e None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:51.224498 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fbb65-4bcb-41e0-bd32-676a7b27de8e None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:51.225033 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fbb65-4bcb-41e0-bd32-676a7b27de8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:51.261853 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216acd6-e112-4dec-bae7-cfe9f439b121 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:51.266987 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-e59fbb65-4bcb-41e0-bd32-676a7b27de8e None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:19:51.268184 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-e59fbb65-4bcb-41e0-bd32-676a7b27de8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:19:51.297949 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7b1fa-85a2-4459-bb53-29b95584de7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:51.298760 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7b1fa-85a2-4459-bb53-29b95584de7d None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:51.299047 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7b1fa-85a2-4459-bb53-29b95584de7d None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:51.299327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7b1fa-85a2-4459-bb53-29b95584de7d None admin] PATH_INFO: `/v3/roles/member` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:51.310505 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7b1fa-85a2-4459-bb53-29b95584de7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:19:51.318521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-83f7b1fa-85a2-4459-bb53-29b95584de7d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 09:19:51.318521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:19:51.318521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:19:51.318521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:19:51.318521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:19:51.318521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:19:51.318521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:19:51.318521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:19:51.318521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:19:51.318521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:19:51.318521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:19:51.318521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:19:51.318521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:19:51.318521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:19:51.318521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:19:51.318521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:19:51.319401 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:19:51.319401 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:19:51.319401 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:19:51.319401 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:19:51.319401 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:19:51.319401 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:19:51.319401 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:19:51.319401 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:19:51.319401 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:19:51.319401 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:19:51.319401 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:19:51.319401 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:19:51.319401 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:19:51.319401 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:19:51.319401 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:19:51.319401 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:19:51.320171 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:19:51.320171 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:19:51.320171 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:19:51.320171 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:19:51.320171 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:19:51.320171 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:19:51.320171 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:19:51.320171 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:19:51.320171 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:19:51.320171 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:19:51.320171 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 09:19:51.320171 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:19:51.320171 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 63/115] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:19:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:19:51.325592 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7b1fa-85a2-4459-bb53-29b95584de7d None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:51.391935 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 53/116] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:19:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:19:51.393186 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864d0cb-6640-4c2b-88ef-b08261270e0a None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:51.393473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864d0cb-6640-4c2b-88ef-b08261270e0a None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:51.393749 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864d0cb-6640-4c2b-88ef-b08261270e0a None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:51.395113 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 54/117] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:19:51.400440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f472b-978b-44b5-ab90-dbab78aa3918 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:51.400744 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f472b-978b-44b5-ab90-dbab78aa3918 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:51.401000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f472b-978b-44b5-ab90-dbab78aa3918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:51.428704 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7b1fa-85a2-4459-bb53-29b95584de7d None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:51.430886 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-ec7f472b-978b-44b5-ab90-dbab78aa3918 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:19:51.432056 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-ec7f472b-978b-44b5-ab90-dbab78aa3918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:19:51.463483 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1cc53-5370-4fbc-aea1-9ee74ee49797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:51.464202 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1cc53-5370-4fbc-aea1-9ee74ee49797 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:51.464495 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1cc53-5370-4fbc-aea1-9ee74ee49797 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:51.464772 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1cc53-5370-4fbc-aea1-9ee74ee49797 None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:51.465527 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1cc53-5370-4fbc-aea1-9ee74ee49797 None admin] RBAC: Adding query filter params (name=member) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:19:51.465912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1cc53-5370-4fbc-aea1-9ee74ee49797 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:51.467894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1cc53-5370-4fbc-aea1-9ee74ee49797 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:51.476526 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 64/118] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 12 09:19:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:19:51.477355 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1cc53-5370-4fbc-aea1-9ee74ee49797 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:51.587576 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1cc53-5370-4fbc-aea1-9ee74ee49797 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:51.604406 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 55/119] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:19:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:19:51.605070 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f472b-978b-44b5-ab90-dbab78aa3918 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:51.624654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275de0ed-e953-48c0-aa78-0a94e8e6d508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:51.625544 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275de0ed-e953-48c0-aa78-0a94e8e6d508 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:51.625831 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275de0ed-e953-48c0-aa78-0a94e8e6d508 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:51.626137 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275de0ed-e953-48c0-aa78-0a94e8e6d508 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:51.636977 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275de0ed-e953-48c0-aa78-0a94e8e6d508 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:19:51.646028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-275de0ed-e953-48c0-aa78-0a94e8e6d508 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 09:19:51.646028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:19:51.646028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:19:51.646028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:19:51.646028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:19:51.646028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:19:51.646028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:19:51.646028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:19:51.646028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:19:51.646028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:19:51.646028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:19:51.646028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:19:51.646028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:19:51.646028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:19:51.646028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:19:51.646028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:19:51.646896 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:19:51.646896 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:19:51.646896 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:19:51.646896 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:19:51.646896 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:19:51.646896 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:19:51.646896 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:19:51.646896 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:19:51.646896 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:19:51.646896 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:19:51.646896 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:19:51.646896 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:19:51.646896 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:19:51.646896 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:19:51.646896 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:19:51.646896 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:19:51.647654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:19:51.647654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:19:51.647654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:19:51.647654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:19:51.647654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:19:51.647654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:19:51.647654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:19:51.647654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:19:51.647654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:19:51.647654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:19:51.647654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 09:19:51.647654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:19:51.647654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 65/120] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 12 09:19:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:19:51.648284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275de0ed-e953-48c0-aa78-0a94e8e6d508 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:51.749406 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275de0ed-e953-48c0-aa78-0a94e8e6d508 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:51.772201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f472b-978b-44b5-ab90-dbab78aa3918 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:51.793437 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f952a99-111e-40cb-8d41-134e734a6363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:51.794302 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f952a99-111e-40cb-8d41-134e734a6363 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:51.794593 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f952a99-111e-40cb-8d41-134e734a6363 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:51.794869 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f952a99-111e-40cb-8d41-134e734a6363 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:51.806396 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f952a99-111e-40cb-8d41-134e734a6363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:19:51.815397 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-4f952a99-111e-40cb-8d41-134e734a6363 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 09:19:51.815397 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:19:51.815397 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:19:51.815397 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:19:51.815397 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:19:51.815397 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:19:51.815397 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:19:51.815397 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:19:51.815397 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:19:51.815397 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:19:51.815397 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:19:51.815397 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:19:51.815397 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:19:51.815397 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:19:51.815397 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:19:51.815397 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:19:51.816436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:19:51.816436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:19:51.816436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:19:51.816436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:19:51.816436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:19:51.816436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:19:51.816436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:19:51.816436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:19:51.816436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:19:51.816436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:19:51.816436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:19:51.816436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:19:51.816436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:19:51.816436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:19:51.816436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:19:51.816436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:19:51.817214 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:19:51.817214 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:19:51.817214 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:19:51.817214 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:19:51.817214 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:19:51.817214 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:19:51.817214 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:19:51.817214 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:19:51.817214 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:19:51.817214 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:19:51.817214 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 09:19:51.817214 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:19:51.817789 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6f09f-7b70-42fc-9170-303dfa017a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:51.817882 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 66/121] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:19:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:19:51.817882 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f952a99-111e-40cb-8d41-134e734a6363 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:51.818058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6f09f-7b70-42fc-9170-303dfa017a4d None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:51.818058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6f09f-7b70-42fc-9170-303dfa017a4d None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:51.818058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6f09f-7b70-42fc-9170-303dfa017a4d None admin] PATH_INFO: `/v3/users/6b240d8064a348a686e6f1ef20babb14` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:51.822692 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6f09f-7b70-42fc-9170-303dfa017a4d None admin] RBAC: Authorizing `identity:get_user(user_id=6b240d8064a348a686e6f1ef20babb14)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:51.824363 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6f09f-7b70-42fc-9170-303dfa017a4d None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:51.827144 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 56/122] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:19:51 2022] GET /identity/v3/users/6b240d8064a348a686e6f1ef20babb14 => generated 275 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:51.828265 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3294874-d823-4637-90bb-15bb7fbee3d1 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:51.828557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3294874-d823-4637-90bb-15bb7fbee3d1 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:51.828841 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3294874-d823-4637-90bb-15bb7fbee3d1 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:51.834970 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 57/123] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:19:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:19:51.835627 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3294874-d823-4637-90bb-15bb7fbee3d1 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:51.927393 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f952a99-111e-40cb-8d41-134e734a6363 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:51.939929 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3294874-d823-4637-90bb-15bb7fbee3d1 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:51.960205 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc58128-f78b-4b92-ae46-9dc8305916ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:51.961109 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc58128-f78b-4b92-ae46-9dc8305916ab None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:51.961398 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc58128-f78b-4b92-ae46-9dc8305916ab None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:51.961672 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc58128-f78b-4b92-ae46-9dc8305916ab None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:51.962494 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc58128-f78b-4b92-ae46-9dc8305916ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:19:51.962798 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc58128-f78b-4b92-ae46-9dc8305916ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:51.964186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc58128-f78b-4b92-ae46-9dc8305916ab None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:51.973134 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 67/124] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:19:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:51.973957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc58128-f78b-4b92-ae46-9dc8305916ab None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:51.974275 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e56a1-baf2-48a0-b288-341d5109fa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:51.975122 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e56a1-baf2-48a0-b288-341d5109fa3c None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:51.975414 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e56a1-baf2-48a0-b288-341d5109fa3c None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:51.975694 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e56a1-baf2-48a0-b288-341d5109fa3c None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:51.976453 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e56a1-baf2-48a0-b288-341d5109fa3c None admin] RBAC: Adding query filter params (name=reader) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:19:51.976762 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e56a1-baf2-48a0-b288-341d5109fa3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:51.978165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e56a1-baf2-48a0-b288-341d5109fa3c None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:51.987088 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 58/125] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 12 09:19:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:51.988251 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e936c8c-ae1b-461c-95d8-12fd0a4acf80 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:51.988548 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e936c8c-ae1b-461c-95d8-12fd0a4acf80 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:51.988834 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e936c8c-ae1b-461c-95d8-12fd0a4acf80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:52.006261 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-6e936c8c-ae1b-461c-95d8-12fd0a4acf80 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:19:52.007375 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-6e936c8c-ae1b-461c-95d8-12fd0a4acf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:19:52.074833 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc58128-f78b-4b92-ae46-9dc8305916ab None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:52.075677 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 59/126] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:19:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:19:52.076267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e936c8c-ae1b-461c-95d8-12fd0a4acf80 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:52.139903 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4701b34-7ef9-4fcf-bffa-58bec642a313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:52.140771 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4701b34-7ef9-4fcf-bffa-58bec642a313 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:52.141054 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4701b34-7ef9-4fcf-bffa-58bec642a313 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:52.141327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4701b34-7ef9-4fcf-bffa-58bec642a313 None admin] PATH_INFO: `/v3/projects/c2bf4930916a40b481d13e508e162fe5` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:52.142602 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4701b34-7ef9-4fcf-bffa-58bec642a313 None admin] RBAC: Authorizing `identity:get_project(project_id=c2bf4930916a40b481d13e508e162fe5)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:52.144060 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4701b34-7ef9-4fcf-bffa-58bec642a313 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:52.145824 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 68/127] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:19:51 2022] GET /identity/v3/projects/c2bf4930916a40b481d13e508e162fe5 => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:52.146666 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4701b34-7ef9-4fcf-bffa-58bec642a313 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:52.187041 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e936c8c-ae1b-461c-95d8-12fd0a4acf80 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:52.221182 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50766c2-3838-4fb6-8151-46072519a202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:52.222104 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50766c2-3838-4fb6-8151-46072519a202 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:52.222388 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50766c2-3838-4fb6-8151-46072519a202 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:52.222673 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50766c2-3838-4fb6-8151-46072519a202 None admin] PATH_INFO: `/v3/users/6b240d8064a348a686e6f1ef20babb14` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:52.223878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50766c2-3838-4fb6-8151-46072519a202 None admin] RBAC: Authorizing `identity:get_user(user_id=6b240d8064a348a686e6f1ef20babb14)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:52.225324 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50766c2-3838-4fb6-8151-46072519a202 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:52.226966 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 60/128] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:19:52 2022] GET /identity/v3/users/6b240d8064a348a686e6f1ef20babb14 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:52.227716 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50766c2-3838-4fb6-8151-46072519a202 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:52.284729 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4701b34-7ef9-4fcf-bffa-58bec642a313 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:52.327838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902caea2-3564-42d0-8ab5-830534c7a508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:52.328628 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50766c2-3838-4fb6-8151-46072519a202 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:52.328790 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902caea2-3564-42d0-8ab5-830534c7a508 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:52.328999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902caea2-3564-42d0-8ab5-830534c7a508 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:52.329280 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902caea2-3564-42d0-8ab5-830534c7a508 None admin] PATH_INFO: `/v3/users/8652917ed2e940bd838e2701c3f15969` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:52.344188 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902caea2-3564-42d0-8ab5-830534c7a508 None admin] RBAC: Authorizing `identity:get_user(user_id=8652917ed2e940bd838e2701c3f15969)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:52.345656 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902caea2-3564-42d0-8ab5-830534c7a508 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:52.347542 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 69/129] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:19:52 2022] GET /identity/v3/users/8652917ed2e940bd838e2701c3f15969 => generated 289 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:52.348109 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902caea2-3564-42d0-8ab5-830534c7a508 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:52.365645 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff9b24-3834-448f-96ba-a11150d1fd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:52.366527 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff9b24-3834-448f-96ba-a11150d1fd40 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:52.366806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff9b24-3834-448f-96ba-a11150d1fd40 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:52.367082 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff9b24-3834-448f-96ba-a11150d1fd40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:52.368302 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff9b24-3834-448f-96ba-a11150d1fd40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:52.369880 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff9b24-3834-448f-96ba-a11150d1fd40 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:52.371670 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 61/130] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:19:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:52.376801 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff9b24-3834-448f-96ba-a11150d1fd40 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:52.449861 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902caea2-3564-42d0-8ab5-830534c7a508 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:52.488411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f023f1-68f6-4bcd-ae1c-01b802174376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:52.489312 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f023f1-68f6-4bcd-ae1c-01b802174376 None admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:52.489597 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f023f1-68f6-4bcd-ae1c-01b802174376 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:52.489877 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f023f1-68f6-4bcd-ae1c-01b802174376 None admin] PATH_INFO: `/v3/projects/c2bf4930916a40b481d13e508e162fe5/users/6b240d8064a348a686e6f1ef20babb14/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:52.491957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f023f1-68f6-4bcd-ae1c-01b802174376 None admin] RBAC: Authorizing `identity:create_grant(project_id=c2bf4930916a40b481d13e508e162fe5, user_id=6b240d8064a348a686e6f1ef20babb14, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:52.492438 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff9b24-3834-448f-96ba-a11150d1fd40 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:52.493430 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f023f1-68f6-4bcd-ae1c-01b802174376 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:52.510372 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 70/131] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 12 09:19:52 2022] PUT /identity/v3/projects/c2bf4930916a40b481d13e508e162fe5/users/6b240d8064a348a686e6f1ef20babb14/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:19:52.514357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f023f1-68f6-4bcd-ae1c-01b802174376 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:52.559330 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143efb4-312c-4d52-b922-a1ef4413d44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:52.560240 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143efb4-312c-4d52-b922-a1ef4413d44b None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:52.560515 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143efb4-312c-4d52-b922-a1ef4413d44b None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:52.562132 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143efb4-312c-4d52-b922-a1ef4413d44b None admin] PATH_INFO: `/v3/projects/43f5db26667c4824b9e1f2363e88395d` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:52.566539 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143efb4-312c-4d52-b922-a1ef4413d44b None admin] RBAC: Authorizing `identity:get_project(project_id=43f5db26667c4824b9e1f2363e88395d)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:52.569575 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143efb4-312c-4d52-b922-a1ef4413d44b None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:52.574549 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 62/132] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:19:52 2022] GET /identity/v3/projects/43f5db26667c4824b9e1f2363e88395d => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:52.576776 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143efb4-312c-4d52-b922-a1ef4413d44b None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:52.699788 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143efb4-312c-4d52-b922-a1ef4413d44b None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:52.735010 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7b6e5-8680-40f9-acbf-3ed134c88c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:52.735684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7b6e5-8680-40f9-acbf-3ed134c88c99 None admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:52.735966 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7b6e5-8680-40f9-acbf-3ed134c88c99 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:52.736242 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7b6e5-8680-40f9-acbf-3ed134c88c99 None admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:52.736950 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7b6e5-8680-40f9-acbf-3ed134c88c99 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:52.738411 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7b6e5-8680-40f9-acbf-3ed134c88c99 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:52.758746 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f023f1-68f6-4bcd-ae1c-01b802174376 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:52.773824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 63/133] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 12 09:19:52 2022] POST /identity/v3/projects => generated 302 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:19:52.775198 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7b6e5-8680-40f9-acbf-3ed134c88c99 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:52.888141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d723849-c5b8-49b7-a2b6-00ac2abe1fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:52.888745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d723849-c5b8-49b7-a2b6-00ac2abe1fdc None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:52.888974 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d723849-c5b8-49b7-a2b6-00ac2abe1fdc None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:52.889244 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d723849-c5b8-49b7-a2b6-00ac2abe1fdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:52.897854 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7b6e5-8680-40f9-acbf-3ed134c88c99 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:52.941235 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf0fc4-2feb-45ce-8890-ee87f600b867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:52.942678 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf0fc4-2feb-45ce-8890-ee87f600b867 None admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:52.943186 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf0fc4-2feb-45ce-8890-ee87f600b867 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:52.944192 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf0fc4-2feb-45ce-8890-ee87f600b867 None admin] PATH_INFO: `/v3/projects/43f5db26667c4824b9e1f2363e88395d/users/6b240d8064a348a686e6f1ef20babb14/roles/7d5eb6a968a74fb0a30eb1e80603005c` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:52.946913 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf0fc4-2feb-45ce-8890-ee87f600b867 None admin] RBAC: Authorizing `identity:create_grant(project_id=43f5db26667c4824b9e1f2363e88395d, user_id=6b240d8064a348a686e6f1ef20babb14, role_id=7d5eb6a968a74fb0a30eb1e80603005c)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:52.948894 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf0fc4-2feb-45ce-8890-ee87f600b867 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:52.973873 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 64/134] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 12 09:19:52 2022] PUT /identity/v3/projects/43f5db26667c4824b9e1f2363e88395d/users/6b240d8064a348a686e6f1ef20babb14/roles/7d5eb6a968a74fb0a30eb1e80603005c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:19:53.071434 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d723849-c5b8-49b7-a2b6-00ac2abe1fdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:53.072937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d723849-c5b8-49b7-a2b6-00ac2abe1fdc None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:53.183522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 71/135] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:19:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 673 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:19:53.190389 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf0fc4-2feb-45ce-8890-ee87f600b867 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:53.322645 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf0fc4-2feb-45ce-8890-ee87f600b867 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:53.365809 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd7a6b-c617-41c8-a50b-ae442300b1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:53.367098 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd7a6b-c617-41c8-a50b-ae442300b1a2 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:53.367604 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd7a6b-c617-41c8-a50b-ae442300b1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:53.368084 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd7a6b-c617-41c8-a50b-ae442300b1a2 None admin] PATH_INFO: `/v3/projects/43f5db26667c4824b9e1f2363e88395d` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:53.369608 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd7a6b-c617-41c8-a50b-ae442300b1a2 None admin] RBAC: Authorizing `identity:get_project(project_id=43f5db26667c4824b9e1f2363e88395d)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:53.371317 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd7a6b-c617-41c8-a50b-ae442300b1a2 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:53.373927 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 65/136] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:19:53 2022] GET /identity/v3/projects/43f5db26667c4824b9e1f2363e88395d => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:53.382483 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d723849-c5b8-49b7-a2b6-00ac2abe1fdc None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:53.489586 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d723849-c5b8-49b7-a2b6-00ac2abe1fdc None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:53.524056 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19f9db-d7b3-446d-97f1-6bc3044803ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:53.524719 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19f9db-d7b3-446d-97f1-6bc3044803ad None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:53.525008 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19f9db-d7b3-446d-97f1-6bc3044803ad None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:53.525292 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19f9db-d7b3-446d-97f1-6bc3044803ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:53.526163 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19f9db-d7b3-446d-97f1-6bc3044803ad None admin] RBAC: Adding query filter params (role.id=62c060ea2ced4eb49bf035f7139ba8ea, scope.project.id=43f5db26667c4824b9e1f2363e88395d, user.id=8652917ed2e940bd838e2701c3f15969) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:19:53.526483 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19f9db-d7b3-446d-97f1-6bc3044803ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:53.527933 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19f9db-d7b3-446d-97f1-6bc3044803ad None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:53.534253 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 72/137] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:19:53 2022] GET /identity/v3/role_assignments?user.id=8652917ed2e940bd838e2701c3f15969&scope.project.id=43f5db26667c4824b9e1f2363e88395d&role.id=62c060ea2ced4eb49bf035f7139ba8ea => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:53.680108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192f26c-0bfb-46d5-b11c-96a0ae356cce None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:53.681103 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192f26c-0bfb-46d5-b11c-96a0ae356cce None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:53.681682 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192f26c-0bfb-46d5-b11c-96a0ae356cce None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:53.683472 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 66/138] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:19:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:19:53.690136 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22166cb-8f0d-4b8f-b73c-3c5b3331efb7 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:53.690422 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22166cb-8f0d-4b8f-b73c-3c5b3331efb7 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:53.690710 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22166cb-8f0d-4b8f-b73c-3c5b3331efb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:53.715030 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-a22166cb-8f0d-4b8f-b73c-3c5b3331efb7 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:19:53.716286 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-a22166cb-8f0d-4b8f-b73c-3c5b3331efb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:19:53.804446 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 73/139] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:19:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:19:53.851511 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192f26c-0bfb-46d5-b11c-96a0ae356cce None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:53.969461 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192f26c-0bfb-46d5-b11c-96a0ae356cce None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:54.007723 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a6163-3439-4fc9-97d7-9984cca1f98e None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:54.008026 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a6163-3439-4fc9-97d7-9984cca1f98e None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:54.008294 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a6163-3439-4fc9-97d7-9984cca1f98e None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:54.009661 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 74/140] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:19:54.013729 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82763bd-3691-4ea0-97fc-4e1f57f59cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:54.014796 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82763bd-3691-4ea0-97fc-4e1f57f59cde None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:54.015275 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82763bd-3691-4ea0-97fc-4e1f57f59cde None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:54.015392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b488b-c8b1-49c3-be99-a3450a381d23 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:54.015609 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b488b-c8b1-49c3-be99-a3450a381d23 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:54.015897 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b488b-c8b1-49c3-be99-a3450a381d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:54.016263 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82763bd-3691-4ea0-97fc-4e1f57f59cde None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:54.027952 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82763bd-3691-4ea0-97fc-4e1f57f59cde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:19:54.036466 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-a82763bd-3691-4ea0-97fc-4e1f57f59cde None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:19:54.036466 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:19:54.036466 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:19:54.036466 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:19:54.036466 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:19:54.036466 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:19:54.036466 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:19:54.036466 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:19:54.036466 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:19:54.036466 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:19:54.036466 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:19:54.036466 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:19:54.036466 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:19:54.036466 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:19:54.036466 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:19:54.036466 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:19:54.037349 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:19:54.037349 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:19:54.037349 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:19:54.037349 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:19:54.037349 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:19:54.037349 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:19:54.037349 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:19:54.037349 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:19:54.037349 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:19:54.037349 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:19:54.037349 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:19:54.037349 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:19:54.037349 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:19:54.037349 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:19:54.037349 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:19:54.037349 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:19:54.038162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:19:54.038162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:19:54.038162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:19:54.038162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:19:54.038162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:19:54.038162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:19:54.038162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:19:54.038162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:19:54.038162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:19:54.038162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:19:54.038162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:19:54.038162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:19:54.040848 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 67/141] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:19:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:19:54.046348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82763bd-3691-4ea0-97fc-4e1f57f59cde None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:54.052836 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-630b488b-c8b1-49c3-be99-a3450a381d23 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:19:54.054070 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-630b488b-c8b1-49c3-be99-a3450a381d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:19:54.149332 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82763bd-3691-4ea0-97fc-4e1f57f59cde None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:54.173512 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 75/142] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:19:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:19:54.185145 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c202b-dc84-4c31-ae1e-ce71079f65da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:54.185882 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c202b-dc84-4c31-ae1e-ce71079f65da None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:54.186188 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c202b-dc84-4c31-ae1e-ce71079f65da None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:54.186468 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c202b-dc84-4c31-ae1e-ce71079f65da None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:54.187217 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c202b-dc84-4c31-ae1e-ce71079f65da None admin] RBAC: Adding query filter params (name=admin) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:19:54.187526 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c202b-dc84-4c31-ae1e-ce71079f65da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:54.188892 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c202b-dc84-4c31-ae1e-ce71079f65da None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:54.197349 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 68/143] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:19:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:19:54.202974 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b488b-c8b1-49c3-be99-a3450a381d23 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:54.216457 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c202b-dc84-4c31-ae1e-ce71079f65da None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:54.363690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b488b-c8b1-49c3-be99-a3450a381d23 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:54.429296 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c202b-dc84-4c31-ae1e-ce71079f65da None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:54.448500 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4301b5-30f4-4791-94a9-05655dec4fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:54.449385 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4301b5-30f4-4791-94a9-05655dec4fad None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:54.449667 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4301b5-30f4-4791-94a9-05655dec4fad None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:54.449958 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4301b5-30f4-4791-94a9-05655dec4fad None admin] PATH_INFO: `/v3/users/025f1b162f424dda98fae8e2f23a6180` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:54.452297 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4301b5-30f4-4791-94a9-05655dec4fad None admin] RBAC: Authorizing `identity:get_user(user_id=025f1b162f424dda98fae8e2f23a6180)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:54.453759 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4301b5-30f4-4791-94a9-05655dec4fad None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:54.455600 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 76/144] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:19:54 2022] GET /identity/v3/users/025f1b162f424dda98fae8e2f23a6180 => generated 247 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:54.471674 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4301b5-30f4-4791-94a9-05655dec4fad None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:54.513603 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b18523-d7a6-4f4d-ad6c-17e432cf7fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:54.514442 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b18523-d7a6-4f4d-ad6c-17e432cf7fc2 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:54.514724 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b18523-d7a6-4f4d-ad6c-17e432cf7fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:54.514998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b18523-d7a6-4f4d-ad6c-17e432cf7fc2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:54.542653 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b18523-d7a6-4f4d-ad6c-17e432cf7fc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:19:54.559531 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-11b18523-d7a6-4f4d-ad6c-17e432cf7fc2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 09:19:54.559531 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:19:54.559531 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:19:54.559531 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:19:54.559531 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:19:54.559531 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:19:54.559531 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:19:54.559531 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:19:54.559531 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:19:54.559531 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:19:54.559531 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:19:54.559531 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:19:54.559531 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:19:54.559531 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:19:54.559531 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:19:54.559531 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:19:54.560508 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:19:54.560508 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:19:54.560508 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:19:54.560508 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:19:54.560508 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:19:54.560508 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:19:54.560508 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:19:54.560508 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:19:54.560508 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:19:54.560508 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:19:54.560508 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:19:54.560508 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:19:54.560508 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:19:54.560508 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:19:54.560508 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:19:54.560508 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:19:54.561357 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:19:54.561357 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:19:54.561357 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:19:54.561357 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:19:54.561357 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:19:54.561357 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:19:54.561357 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:19:54.561357 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:19:54.561357 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:19:54.561357 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:19:54.561357 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 09:19:54.561357 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:19:54.565392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 69/145] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:19:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:19:54.574221 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b18523-d7a6-4f4d-ad6c-17e432cf7fc2 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:54.694037 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4301b5-30f4-4791-94a9-05655dec4fad None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:54.742623 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a714b2d-4357-4adf-b7a9-e569bea5a698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:54.743290 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a714b2d-4357-4adf-b7a9-e569bea5a698 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:54.743579 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a714b2d-4357-4adf-b7a9-e569bea5a698 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:54.743867 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a714b2d-4357-4adf-b7a9-e569bea5a698 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:54.806098 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b18523-d7a6-4f4d-ad6c-17e432cf7fc2 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:54.841338 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a714b2d-4357-4adf-b7a9-e569bea5a698 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:54.842832 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a714b2d-4357-4adf-b7a9-e569bea5a698 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:54.874675 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d743e22-90c4-49d4-a7af-c71d49c9d034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:54.875384 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d743e22-90c4-49d4-a7af-c71d49c9d034 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:54.875676 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d743e22-90c4-49d4-a7af-c71d49c9d034 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:54.875965 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d743e22-90c4-49d4-a7af-c71d49c9d034 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:54.876737 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d743e22-90c4-49d4-a7af-c71d49c9d034 None admin] RBAC: Adding query filter params (name=member) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:19:54.877050 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d743e22-90c4-49d4-a7af-c71d49c9d034 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:54.878477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d743e22-90c4-49d4-a7af-c71d49c9d034 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:54.900178 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 70/146] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 12 09:19:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:54.906348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d743e22-90c4-49d4-a7af-c71d49c9d034 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:54.946139 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 77/147] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:19:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 09:19:54.948747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a714b2d-4357-4adf-b7a9-e569bea5a698 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:55.046817 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a714b2d-4357-4adf-b7a9-e569bea5a698 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:55.065328 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d743e22-90c4-49d4-a7af-c71d49c9d034 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:55.082032 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d02d82-b817-4fec-819a-aec38e2b7a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:55.082032 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d02d82-b817-4fec-819a-aec38e2b7a19 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:55.082306 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d02d82-b817-4fec-819a-aec38e2b7a19 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:55.082530 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d02d82-b817-4fec-819a-aec38e2b7a19 None admin] PATH_INFO: `/v3/projects/43f5db26667c4824b9e1f2363e88395d` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:55.083663 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d02d82-b817-4fec-819a-aec38e2b7a19 None admin] RBAC: Authorizing `identity:get_project(project_id=43f5db26667c4824b9e1f2363e88395d)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:55.085111 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d02d82-b817-4fec-819a-aec38e2b7a19 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:55.086814 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 78/148] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:19:54 2022] GET /identity/v3/projects/43f5db26667c4824b9e1f2363e88395d => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:19:55.097922 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d02d82-b817-4fec-819a-aec38e2b7a19 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:55.119277 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d8da9-a95b-43c2-8f96-1476db076672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:55.120471 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d8da9-a95b-43c2-8f96-1476db076672 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:55.120948 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d8da9-a95b-43c2-8f96-1476db076672 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:55.121414 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d8da9-a95b-43c2-8f96-1476db076672 None admin] PATH_INFO: `/v3/users/6b240d8064a348a686e6f1ef20babb14` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:55.123049 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d8da9-a95b-43c2-8f96-1476db076672 None admin] RBAC: Authorizing `identity:get_user(user_id=6b240d8064a348a686e6f1ef20babb14)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:55.124683 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d8da9-a95b-43c2-8f96-1476db076672 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:55.134876 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 71/149] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:19:54 2022] GET /identity/v3/users/6b240d8064a348a686e6f1ef20babb14 => generated 275 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:19:55.140409 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d8da9-a95b-43c2-8f96-1476db076672 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:55.202754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d02d82-b817-4fec-819a-aec38e2b7a19 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:55.237951 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46a495-f445-4e7f-b7e5-ff59ff0d3ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:55.238629 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46a495-f445-4e7f-b7e5-ff59ff0d3ba1 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:55.238911 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46a495-f445-4e7f-b7e5-ff59ff0d3ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:55.239183 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46a495-f445-4e7f-b7e5-ff59ff0d3ba1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:55.240017 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46a495-f445-4e7f-b7e5-ff59ff0d3ba1 None admin] RBAC: Adding query filter params (role.id=8f01c4c38fa44034a54c1f8cd2d2db1a, scope.project.id=43f5db26667c4824b9e1f2363e88395d, user.id=025f1b162f424dda98fae8e2f23a6180) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:19:55.240328 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46a495-f445-4e7f-b7e5-ff59ff0d3ba1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:55.241795 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46a495-f445-4e7f-b7e5-ff59ff0d3ba1 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:55.247886 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 79/150] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:19:55 2022] GET /identity/v3/role_assignments?user.id=025f1b162f424dda98fae8e2f23a6180&scope.project.id=43f5db26667c4824b9e1f2363e88395d&role.id=8f01c4c38fa44034a54c1f8cd2d2db1a => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:19:55.265661 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d8da9-a95b-43c2-8f96-1476db076672 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:55.309737 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c892b68-f636-4fe9-be78-add68d5b3409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:55.310840 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c892b68-f636-4fe9-be78-add68d5b3409 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:55.311321 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c892b68-f636-4fe9-be78-add68d5b3409 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:55.311794 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c892b68-f636-4fe9-be78-add68d5b3409 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:55.420826 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c892b68-f636-4fe9-be78-add68d5b3409 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:55.422731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c892b68-f636-4fe9-be78-add68d5b3409 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:55.515485 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc64c11-e025-4769-8961-e81573c9d057 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:55.516015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc64c11-e025-4769-8961-e81573c9d057 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:55.516015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc64c11-e025-4769-8961-e81573c9d057 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:55.517396 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 80/151] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:19:55.527592 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d927f-8380-47c7-bd66-83cd9a6cf41f None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:55.528046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d927f-8380-47c7-bd66-83cd9a6cf41f None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:55.528848 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d927f-8380-47c7-bd66-83cd9a6cf41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:55.549817 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-b78d927f-8380-47c7-bd66-83cd9a6cf41f None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:19:55.551513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-b78d927f-8380-47c7-bd66-83cd9a6cf41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:19:55.554428 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 72/152] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:19:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:19:55.576753 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c892b68-f636-4fe9-be78-add68d5b3409 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:55.632706 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 81/153] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:19:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:19:55.660130 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d927f-8380-47c7-bd66-83cd9a6cf41f None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:55.771080 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d927f-8380-47c7-bd66-83cd9a6cf41f None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:55.801543 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c892b68-f636-4fe9-be78-add68d5b3409 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:55.809643 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773ac33-3257-406d-bf8f-6d3bdd729dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:55.810490 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773ac33-3257-406d-bf8f-6d3bdd729dc6 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:55.810769 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773ac33-3257-406d-bf8f-6d3bdd729dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:55.811039 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773ac33-3257-406d-bf8f-6d3bdd729dc6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:55.822902 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773ac33-3257-406d-bf8f-6d3bdd729dc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:19:55.831671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-4773ac33-3257-406d-bf8f-6d3bdd729dc6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 09:19:55.831671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:19:55.831671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:19:55.831671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:19:55.831671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:19:55.831671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:19:55.831671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:19:55.831671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:19:55.831671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:19:55.831671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:19:55.831671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:19:55.831671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:19:55.831671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:19:55.831671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:19:55.831671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:19:55.831671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:19:55.832537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:19:55.832537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:19:55.832537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:19:55.832537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:19:55.832537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:19:55.832537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:19:55.832537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:19:55.832537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:19:55.832537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:19:55.832537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:19:55.832537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:19:55.832537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:19:55.832537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:19:55.832537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:19:55.832537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:19:55.832537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:19:55.834204 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:19:55.834204 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:19:55.834204 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:19:55.834204 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:19:55.834204 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:19:55.834204 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:19:55.834204 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:19:55.834204 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:19:55.834204 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:19:55.834204 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:19:55.834204 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 09:19:55.834204 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:19:55.834204 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 82/154] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:19:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:19:55.838869 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773ac33-3257-406d-bf8f-6d3bdd729dc6 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:55.894606 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de312a6d-20ae-46f7-82fd-09ade482016c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:55.895494 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de312a6d-20ae-46f7-82fd-09ade482016c None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:55.895775 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de312a6d-20ae-46f7-82fd-09ade482016c None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:55.896058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de312a6d-20ae-46f7-82fd-09ade482016c None admin] PATH_INFO: `/v3/projects/43f5db26667c4824b9e1f2363e88395d` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:55.897298 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de312a6d-20ae-46f7-82fd-09ade482016c None admin] RBAC: Authorizing `identity:get_project(project_id=43f5db26667c4824b9e1f2363e88395d)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:55.898759 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de312a6d-20ae-46f7-82fd-09ade482016c None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:55.900471 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 73/155] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:19:55 2022] GET /identity/v3/projects/43f5db26667c4824b9e1f2363e88395d => generated 298 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:19:55.923832 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de312a6d-20ae-46f7-82fd-09ade482016c None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:55.952747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773ac33-3257-406d-bf8f-6d3bdd729dc6 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:55.989572 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a41ff-ce42-4fcb-9d6b-ce5bd33a17ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:55.990425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a41ff-ce42-4fcb-9d6b-ce5bd33a17ae None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:55.990712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a41ff-ce42-4fcb-9d6b-ce5bd33a17ae None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:55.990990 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a41ff-ce42-4fcb-9d6b-ce5bd33a17ae None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:55.991897 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a41ff-ce42-4fcb-9d6b-ce5bd33a17ae None admin] RBAC: Adding query filter params (name=member) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:19:55.992208 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a41ff-ce42-4fcb-9d6b-ce5bd33a17ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:55.993593 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a41ff-ce42-4fcb-9d6b-ce5bd33a17ae None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:56.003709 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 83/156] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 12 09:19:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:56.009236 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a41ff-ce42-4fcb-9d6b-ce5bd33a17ae None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:56.123144 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a41ff-ce42-4fcb-9d6b-ce5bd33a17ae None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:56.161055 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f3489-877c-48a4-b8bb-7214d0d53696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:56.161941 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f3489-877c-48a4-b8bb-7214d0d53696 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:56.162229 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f3489-877c-48a4-b8bb-7214d0d53696 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:56.162501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f3489-877c-48a4-b8bb-7214d0d53696 None admin] PATH_INFO: `/v3/users/6b240d8064a348a686e6f1ef20babb14` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:56.163700 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66f3489-877c-48a4-b8bb-7214d0d53696 None admin] RBAC: Authorizing `identity:get_user(user_id=6b240d8064a348a686e6f1ef20babb14)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:56.165147 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66f3489-877c-48a4-b8bb-7214d0d53696 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:56.166943 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 84/157] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:19:56 2022] GET /identity/v3/users/6b240d8064a348a686e6f1ef20babb14 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:19:56.172656 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f3489-877c-48a4-b8bb-7214d0d53696 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:56.212043 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de312a6d-20ae-46f7-82fd-09ade482016c None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:56.281013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f3489-877c-48a4-b8bb-7214d0d53696 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:56.307097 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4bd2c-255b-4048-8827-dba77c3adca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:56.307783 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4bd2c-255b-4048-8827-dba77c3adca6 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:56.308246 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4bd2c-255b-4048-8827-dba77c3adca6 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:56.308521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4bd2c-255b-4048-8827-dba77c3adca6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:56.310691 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb4bd2c-255b-4048-8827-dba77c3adca6 None admin] RBAC: Adding query filter params (role.id=31076ec4ad6a42868d212118fe129d18, scope.project.id=43f5db26667c4824b9e1f2363e88395d, user.id=6b240d8064a348a686e6f1ef20babb14) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:19:56.311010 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb4bd2c-255b-4048-8827-dba77c3adca6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:56.313102 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb4bd2c-255b-4048-8827-dba77c3adca6 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:56.321422 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 74/158] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:19:55 2022] GET /identity/v3/role_assignments?user.id=6b240d8064a348a686e6f1ef20babb14&scope.project.id=43f5db26667c4824b9e1f2363e88395d&role.id=31076ec4ad6a42868d212118fe129d18 => generated 608 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:19:56.321673 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3f95e-b04f-4d9d-884d-b6d23d4f1661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:56.322812 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67fee9-692f-464d-92ea-85a7c7110f3e None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:56.323152 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67fee9-692f-464d-92ea-85a7c7110f3e None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:56.323432 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67fee9-692f-464d-92ea-85a7c7110f3e None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:56.329939 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 75/159] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:19:56.330531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3f95e-b04f-4d9d-884d-b6d23d4f1661 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:56.330930 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3f95e-b04f-4d9d-884d-b6d23d4f1661 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:56.331276 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3f95e-b04f-4d9d-884d-b6d23d4f1661 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:56.331540 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fe90a-7026-4572-9813-14292fbf2eef None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:56.331834 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fe90a-7026-4572-9813-14292fbf2eef None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:56.332109 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fe90a-7026-4572-9813-14292fbf2eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:56.358784 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-899fe90a-7026-4572-9813-14292fbf2eef None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:19:56.359921 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-899fe90a-7026-4572-9813-14292fbf2eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:19:56.442465 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d3f95e-b04f-4d9d-884d-b6d23d4f1661 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:56.443966 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d3f95e-b04f-4d9d-884d-b6d23d4f1661 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:56.513308 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 76/160] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:19:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:19:56.515042 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c96b3-04d8-4181-a1bc-b2266d08e9ec None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:56.515506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c96b3-04d8-4181-a1bc-b2266d08e9ec None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:56.515937 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c96b3-04d8-4181-a1bc-b2266d08e9ec None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:56.521940 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 77/161] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:19:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:19:56.524014 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9c7c5-6f05-4daa-a0f1-4ea7399faa32 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:56.524473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9c7c5-6f05-4daa-a0f1-4ea7399faa32 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:56.524902 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9c7c5-6f05-4daa-a0f1-4ea7399faa32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:56.542536 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-0ad9c7c5-6f05-4daa-a0f1-4ea7399faa32 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:19:56.544601 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-0ad9c7c5-6f05-4daa-a0f1-4ea7399faa32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:19:56.580842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 85/162] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:19:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 09:19:56.580842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3f95e-b04f-4d9d-884d-b6d23d4f1661 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:56.632227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 78/163] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:19:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:19:56.639419 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9c7c5-6f05-4daa-a0f1-4ea7399faa32 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:56.717304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3f95e-b04f-4d9d-884d-b6d23d4f1661 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:56.750143 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc9f89-b810-4804-a225-cc93865c84b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:56.751340 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc9f89-b810-4804-a225-cc93865c84b7 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:56.751795 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc9f89-b810-4804-a225-cc93865c84b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:56.752236 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc9f89-b810-4804-a225-cc93865c84b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:56.759137 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9c7c5-6f05-4daa-a0f1-4ea7399faa32 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:56.763056 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc9f89-b810-4804-a225-cc93865c84b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:19:56.771291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-bbbc9f89-b810-4804-a225-cc93865c84b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 09:19:56.771291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:19:56.771291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:19:56.771291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:19:56.771291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:19:56.771291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:19:56.771291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:19:56.771291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:19:56.771291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:19:56.771291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:19:56.771291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:19:56.771291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:19:56.771291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:19:56.771291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:19:56.771291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:19:56.771291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:19:56.772405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:19:56.772405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:19:56.772405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:19:56.772405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:19:56.772405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:19:56.772405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:19:56.772405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:19:56.772405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:19:56.772405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:19:56.772405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:19:56.772405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:19:56.772405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:19:56.772405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:19:56.772405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:19:56.772405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:19:56.772405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:19:56.773364 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:19:56.773364 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:19:56.773364 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:19:56.773364 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:19:56.773364 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:19:56.773364 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:19:56.773364 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:19:56.773364 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:19:56.773364 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:19:56.773364 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:19:56.773364 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 09:19:56.773364 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:19:56.780561 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 86/164] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 12 09:19:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:19:56.780561 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc9f89-b810-4804-a225-cc93865c84b7 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:56.797060 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8382e81-daf6-40d8-a0ab-e44b14cbc810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:56.797962 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8382e81-daf6-40d8-a0ab-e44b14cbc810 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:56.798246 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8382e81-daf6-40d8-a0ab-e44b14cbc810 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:56.798518 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8382e81-daf6-40d8-a0ab-e44b14cbc810 None admin] PATH_INFO: `/v3/projects/c2bf4930916a40b481d13e508e162fe5` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:56.799700 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8382e81-daf6-40d8-a0ab-e44b14cbc810 None admin] RBAC: Authorizing `identity:get_project(project_id=c2bf4930916a40b481d13e508e162fe5)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:56.801157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8382e81-daf6-40d8-a0ab-e44b14cbc810 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:56.803047 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 79/165] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:19:56 2022] GET /identity/v3/projects/c2bf4930916a40b481d13e508e162fe5 => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:56.803725 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8382e81-daf6-40d8-a0ab-e44b14cbc810 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:56.880774 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc9f89-b810-4804-a225-cc93865c84b7 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:56.896944 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8382e81-daf6-40d8-a0ab-e44b14cbc810 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:56.912082 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518df9fe-0e84-4770-8b6a-66f9d687b6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:56.914224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518df9fe-0e84-4770-8b6a-66f9d687b6c8 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:56.914224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518df9fe-0e84-4770-8b6a-66f9d687b6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:56.914224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518df9fe-0e84-4770-8b6a-66f9d687b6c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:56.915204 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518df9fe-0e84-4770-8b6a-66f9d687b6c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:56.916677 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518df9fe-0e84-4770-8b6a-66f9d687b6c8 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:56.918338 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 87/166] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:19:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:56.920881 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518df9fe-0e84-4770-8b6a-66f9d687b6c8 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:56.933140 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574ac5a-6e07-440d-958f-2766f1767f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:56.933818 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574ac5a-6e07-440d-958f-2766f1767f6a None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:56.934128 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574ac5a-6e07-440d-958f-2766f1767f6a None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:56.934401 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574ac5a-6e07-440d-958f-2766f1767f6a None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:56.935145 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574ac5a-6e07-440d-958f-2766f1767f6a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:19:56.935448 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574ac5a-6e07-440d-958f-2766f1767f6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:56.936804 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574ac5a-6e07-440d-958f-2766f1767f6a None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:56.944554 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 80/167] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:19:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:56.945751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038f455-f229-4448-9bb5-7ab8afe250e0 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:56.946069 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038f455-f229-4448-9bb5-7ab8afe250e0 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:56.946344 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038f455-f229-4448-9bb5-7ab8afe250e0 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:56.949477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 81/168] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:19:56.949477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038f455-f229-4448-9bb5-7ab8afe250e0 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:57.016355 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518df9fe-0e84-4770-8b6a-66f9d687b6c8 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:57.042945 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038f455-f229-4448-9bb5-7ab8afe250e0 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:57.048141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e045afc-ce9a-47f9-8c4a-8177dede935f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:57.048786 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e045afc-ce9a-47f9-8c4a-8177dede935f None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:57.049068 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e045afc-ce9a-47f9-8c4a-8177dede935f None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:57.049344 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e045afc-ce9a-47f9-8c4a-8177dede935f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:57.050212 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e045afc-ce9a-47f9-8c4a-8177dede935f None admin] RBAC: Adding query filter params (role.id=31076ec4ad6a42868d212118fe129d18, scope.project.id=c2bf4930916a40b481d13e508e162fe5, user.id=6b240d8064a348a686e6f1ef20babb14) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:19:57.050522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e045afc-ce9a-47f9-8c4a-8177dede935f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:57.051969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e045afc-ce9a-47f9-8c4a-8177dede935f None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:57.057529 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 88/169] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:19:56 2022] GET /identity/v3/role_assignments?user.id=6b240d8064a348a686e6f1ef20babb14&scope.project.id=c2bf4930916a40b481d13e508e162fe5&role.id=31076ec4ad6a42868d212118fe129d18 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:57.058422 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e045afc-ce9a-47f9-8c4a-8177dede935f None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:57.077522 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efcbcac-57d4-4104-8cd5-bfce924a7a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:57.078261 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efcbcac-57d4-4104-8cd5-bfce924a7a33 None admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:57.078541 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efcbcac-57d4-4104-8cd5-bfce924a7a33 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:57.078810 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efcbcac-57d4-4104-8cd5-bfce924a7a33 None admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:57.079536 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efcbcac-57d4-4104-8cd5-bfce924a7a33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:57.081004 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efcbcac-57d4-4104-8cd5-bfce924a7a33 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:57.112905 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 82/170] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 12 09:19:56 2022] POST /identity/v3/users => generated 283 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:19:57.114497 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100775d6-8801-44c0-8d43-8e8ccb000115 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:57.114781 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100775d6-8801-44c0-8d43-8e8ccb000115 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:57.115059 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100775d6-8801-44c0-8d43-8e8ccb000115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:57.147324 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-100775d6-8801-44c0-8d43-8e8ccb000115 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:19:57.148632 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-100775d6-8801-44c0-8d43-8e8ccb000115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:19:57.205512 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e045afc-ce9a-47f9-8c4a-8177dede935f None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:57.227497 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 83/171] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:19:57.250542 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100775d6-8801-44c0-8d43-8e8ccb000115 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:57.255966 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdae24-4749-4719-be3e-b91b2255b403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:57.257175 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdae24-4749-4719-be3e-b91b2255b403 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:57.257704 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdae24-4749-4719-be3e-b91b2255b403 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:57.258207 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdae24-4749-4719-be3e-b91b2255b403 None admin] PATH_INFO: `/v3/users/6b240d8064a348a686e6f1ef20babb14` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:57.261156 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdae24-4749-4719-be3e-b91b2255b403 None admin] RBAC: Authorizing `identity:get_user(user_id=6b240d8064a348a686e6f1ef20babb14)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:57.263659 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdae24-4749-4719-be3e-b91b2255b403 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:57.266003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 89/172] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:19:57 2022] GET /identity/v3/users/6b240d8064a348a686e6f1ef20babb14 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:57.271444 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdae24-4749-4719-be3e-b91b2255b403 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:57.384395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100775d6-8801-44c0-8d43-8e8ccb000115 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:57.392965 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdae24-4749-4719-be3e-b91b2255b403 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:57.421238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e81a2d-c194-48e0-a73a-b7d48cc82616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:57.422529 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e81a2d-c194-48e0-a73a-b7d48cc82616 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:57.422821 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e81a2d-c194-48e0-a73a-b7d48cc82616 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:57.423097 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e81a2d-c194-48e0-a73a-b7d48cc82616 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:57.433761 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e81a2d-c194-48e0-a73a-b7d48cc82616 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:19:57.437317 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22adc1-e9ea-4d2d-9353-837fb0e2ba12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:57.438010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22adc1-e9ea-4d2d-9353-837fb0e2ba12 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:57.438295 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22adc1-e9ea-4d2d-9353-837fb0e2ba12 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:57.438571 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22adc1-e9ea-4d2d-9353-837fb0e2ba12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:57.441715 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-26e81a2d-c194-48e0-a73a-b7d48cc82616 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 09:19:57.441715 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:19:57.441715 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:19:57.441715 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:19:57.441715 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:19:57.441715 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:19:57.441715 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:19:57.441715 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:19:57.441715 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:19:57.441715 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:19:57.441715 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:19:57.441715 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:19:57.441715 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:19:57.441715 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:19:57.441715 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:19:57.441715 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:19:57.442740 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:19:57.442740 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:19:57.442740 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:19:57.442740 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:19:57.442740 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:19:57.442740 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:19:57.442740 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:19:57.442740 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:19:57.442740 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:19:57.442740 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:19:57.442740 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:19:57.442740 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:19:57.442740 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:19:57.442740 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:19:57.442740 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:19:57.442740 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:19:57.443520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:19:57.443520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:19:57.443520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:19:57.443520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:19:57.443520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:19:57.443520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:19:57.443520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:19:57.443520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:19:57.443520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:19:57.443520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:19:57.443520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 09:19:57.443520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:19:57.443520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 84/173] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:19:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:19:57.448826 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e81a2d-c194-48e0-a73a-b7d48cc82616 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:57.524475 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22adc1-e9ea-4d2d-9353-837fb0e2ba12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:57.525472 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22adc1-e9ea-4d2d-9353-837fb0e2ba12 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:57.554950 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e81a2d-c194-48e0-a73a-b7d48cc82616 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:57.592480 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f494df3-48e9-42e8-830a-03f3bb648e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:57.593670 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f494df3-48e9-42e8-830a-03f3bb648e6a None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:57.594236 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f494df3-48e9-42e8-830a-03f3bb648e6a None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:57.594717 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f494df3-48e9-42e8-830a-03f3bb648e6a None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:57.595869 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f494df3-48e9-42e8-830a-03f3bb648e6a None admin] RBAC: Adding query filter params (name=reader) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:19:57.596460 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f494df3-48e9-42e8-830a-03f3bb648e6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:57.598447 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f494df3-48e9-42e8-830a-03f3bb648e6a None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:57.608212 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 85/174] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 12 09:19:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:19:57.616295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f494df3-48e9-42e8-830a-03f3bb648e6a None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:57.634218 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 90/175] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:19:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 09:19:57.640081 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22adc1-e9ea-4d2d-9353-837fb0e2ba12 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:57.727585 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f494df3-48e9-42e8-830a-03f3bb648e6a None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:57.746771 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22adc1-e9ea-4d2d-9353-837fb0e2ba12 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:57.763461 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20948940-96de-4678-8333-7aaf1f529391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:57.764472 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20948940-96de-4678-8333-7aaf1f529391 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:57.764905 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20948940-96de-4678-8333-7aaf1f529391 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:57.765193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20948940-96de-4678-8333-7aaf1f529391 None admin] PATH_INFO: `/v3/users/8652917ed2e940bd838e2701c3f15969` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:57.766748 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20948940-96de-4678-8333-7aaf1f529391 None admin] RBAC: Authorizing `identity:get_user(user_id=8652917ed2e940bd838e2701c3f15969)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:57.768203 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20948940-96de-4678-8333-7aaf1f529391 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:57.771062 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 86/176] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:19:57 2022] GET /identity/v3/users/8652917ed2e940bd838e2701c3f15969 => generated 289 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:19:57.776083 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20948940-96de-4678-8333-7aaf1f529391 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:57.786621 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c33e9-cd3c-46fb-8db3-17a0f87d64c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:57.787497 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c33e9-cd3c-46fb-8db3-17a0f87d64c7 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:57.787777 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c33e9-cd3c-46fb-8db3-17a0f87d64c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:57.788049 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c33e9-cd3c-46fb-8db3-17a0f87d64c7 None admin] PATH_INFO: `/v3/projects/43f5db26667c4824b9e1f2363e88395d` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:57.789356 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c33e9-cd3c-46fb-8db3-17a0f87d64c7 None admin] RBAC: Authorizing `identity:get_project(project_id=43f5db26667c4824b9e1f2363e88395d)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:57.790875 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c33e9-cd3c-46fb-8db3-17a0f87d64c7 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:57.792885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 91/177] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:19:57 2022] GET /identity/v3/projects/43f5db26667c4824b9e1f2363e88395d => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:57.798431 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c33e9-cd3c-46fb-8db3-17a0f87d64c7 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:57.882438 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20948940-96de-4678-8333-7aaf1f529391 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:57.924295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e19d0-8966-4585-9f3b-dfc1881340e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:57.925167 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e19d0-8966-4585-9f3b-dfc1881340e0 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:57.929919 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e19d0-8966-4585-9f3b-dfc1881340e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:57.929919 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e19d0-8966-4585-9f3b-dfc1881340e0 None admin] PATH_INFO: `/v3/projects/43f5db26667c4824b9e1f2363e88395d` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:57.930331 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e19d0-8966-4585-9f3b-dfc1881340e0 None admin] RBAC: Authorizing `identity:get_project(project_id=43f5db26667c4824b9e1f2363e88395d)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:57.931441 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e19d0-8966-4585-9f3b-dfc1881340e0 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:57.933305 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 87/178] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:19:57 2022] GET /identity/v3/projects/43f5db26667c4824b9e1f2363e88395d => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:19:57.942143 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e19d0-8966-4585-9f3b-dfc1881340e0 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:58.001398 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c33e9-cd3c-46fb-8db3-17a0f87d64c7 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:58.058499 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9ac7c-40ab-4831-92b3-267147f0b57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:58.059159 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9ac7c-40ab-4831-92b3-267147f0b57d None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:58.059506 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9ac7c-40ab-4831-92b3-267147f0b57d None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:58.059788 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9ac7c-40ab-4831-92b3-267147f0b57d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:58.060622 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9ac7c-40ab-4831-92b3-267147f0b57d None admin] RBAC: Adding query filter params (role.id=7d5eb6a968a74fb0a30eb1e80603005c, scope.project.id=43f5db26667c4824b9e1f2363e88395d, user.id=6b240d8064a348a686e6f1ef20babb14) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:19:58.060933 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9ac7c-40ab-4831-92b3-267147f0b57d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:58.062412 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9ac7c-40ab-4831-92b3-267147f0b57d None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:58.075941 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 92/179] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:19:57 2022] GET /identity/v3/role_assignments?user.id=6b240d8064a348a686e6f1ef20babb14&scope.project.id=43f5db26667c4824b9e1f2363e88395d&role.id=7d5eb6a968a74fb0a30eb1e80603005c => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:19:58.093493 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e19d0-8966-4585-9f3b-dfc1881340e0 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:58.143202 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415f095-6ca1-41a8-ad49-0e96e555f666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:58.144112 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415f095-6ca1-41a8-ad49-0e96e555f666 None admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:58.144394 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415f095-6ca1-41a8-ad49-0e96e555f666 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:58.144670 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415f095-6ca1-41a8-ad49-0e96e555f666 None admin] PATH_INFO: `/v3/projects/43f5db26667c4824b9e1f2363e88395d/users/8652917ed2e940bd838e2701c3f15969/roles/62c060ea2ced4eb49bf035f7139ba8ea` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:58.146709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415f095-6ca1-41a8-ad49-0e96e555f666 None admin] RBAC: Authorizing `identity:create_grant(project_id=43f5db26667c4824b9e1f2363e88395d, user_id=8652917ed2e940bd838e2701c3f15969, role_id=62c060ea2ced4eb49bf035f7139ba8ea)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:19:58.148172 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415f095-6ca1-41a8-ad49-0e96e555f666 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:19:58.163327 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 88/180] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 12 09:19:57 2022] PUT /identity/v3/projects/43f5db26667c4824b9e1f2363e88395d/users/8652917ed2e940bd838e2701c3f15969/roles/62c060ea2ced4eb49bf035f7139ba8ea => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:19:59.599112 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6786fa-9ad8-4ce6-8846-2e4d9b8131a7 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:59.599639 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6786fa-9ad8-4ce6-8846-2e4d9b8131a7 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:59.599639 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6786fa-9ad8-4ce6-8846-2e4d9b8131a7 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:59.601163 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 93/181] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:19:59.607302 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a6333-630a-4408-8b2f-a82108faf699 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:59.607709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a6333-630a-4408-8b2f-a82108faf699 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:59.608034 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a6333-630a-4408-8b2f-a82108faf699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:59.626448 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-4a6a6333-630a-4408-8b2f-a82108faf699 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:19:59.627675 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-4a6a6333-630a-4408-8b2f-a82108faf699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:19:59.700616 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 89/182] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:19:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:19:59.723534 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6786fa-9ad8-4ce6-8846-2e4d9b8131a7 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:59.821036 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b3b75-3664-409c-a8d3-5475c07eb67e None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:59.821421 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b3b75-3664-409c-a8d3-5475c07eb67e None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:59.821583 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b3b75-3664-409c-a8d3-5475c07eb67e None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:59.823024 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 90/183] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:19:59.828664 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282b635-098a-4350-8c19-17ef3fa1f82d None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:59.828944 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282b635-098a-4350-8c19-17ef3fa1f82d None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:59.829218 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282b635-098a-4350-8c19-17ef3fa1f82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:59.830915 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6786fa-9ad8-4ce6-8846-2e4d9b8131a7 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:19:59.845391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-3282b635-098a-4350-8c19-17ef3fa1f82d None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:19:59.846570 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-3282b635-098a-4350-8c19-17ef3fa1f82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:19:59.876725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcea836-391a-4dd0-91f1-7bd9c88deb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:19:59.877484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcea836-391a-4dd0-91f1-7bd9c88deb4c None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:19:59.877768 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcea836-391a-4dd0-91f1-7bd9c88deb4c None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:19:59.878091 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcea836-391a-4dd0-91f1-7bd9c88deb4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:19:59.889985 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcea836-391a-4dd0-91f1-7bd9c88deb4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:19:59.899930 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-5bcea836-391a-4dd0-91f1-7bd9c88deb4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:19:59.899930 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:19:59.899930 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:19:59.899930 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:19:59.899930 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:19:59.899930 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:19:59.899930 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:19:59.899930 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:19:59.899930 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:19:59.899930 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:19:59.899930 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:19:59.899930 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:19:59.899930 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:19:59.899930 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:19:59.899930 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:19:59.899930 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:19:59.901809 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:19:59.901809 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:19:59.901809 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:19:59.901809 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:19:59.901809 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:19:59.901809 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:19:59.901809 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:19:59.901809 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:19:59.901809 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:19:59.901809 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:19:59.901809 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:19:59.901809 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:19:59.901809 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:19:59.901809 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:19:59.901809 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:19:59.901809 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:19:59.902744 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:19:59.902744 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:19:59.902744 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:19:59.902744 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:19:59.902744 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:19:59.902744 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:19:59.902744 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:19:59.902744 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:19:59.902744 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:19:59.902744 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:19:59.902744 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:19:59.902744 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:19:59.902744 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 94/184] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:19:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:19:59.915015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcea836-391a-4dd0-91f1-7bd9c88deb4c None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:19:59.921032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 91/185] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:19:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:19:59.943897 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282b635-098a-4350-8c19-17ef3fa1f82d None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:00.028922 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcea836-391a-4dd0-91f1-7bd9c88deb4c None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:00.044814 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282b635-098a-4350-8c19-17ef3fa1f82d None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:00.062933 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6682b2a-7868-458a-acef-47bb5e6fff1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:00.063599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6682b2a-7868-458a-acef-47bb5e6fff1f None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:00.063876 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6682b2a-7868-458a-acef-47bb5e6fff1f None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:00.064143 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6682b2a-7868-458a-acef-47bb5e6fff1f None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:00.064880 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6682b2a-7868-458a-acef-47bb5e6fff1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:00.065182 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6682b2a-7868-458a-acef-47bb5e6fff1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:00.066574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6682b2a-7868-458a-acef-47bb5e6fff1f None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:00.074845 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 95/186] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:19:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:00.076581 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92255846-e055-4090-836c-5498bb36ce36 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:00.076866 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92255846-e055-4090-836c-5498bb36ce36 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:00.077138 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92255846-e055-4090-836c-5498bb36ce36 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:00.078397 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 96/187] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:00.082110 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92255846-e055-4090-836c-5498bb36ce36 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:00.084912 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648ec42-5683-4391-90e3-a63b3ed57b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:00.085751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648ec42-5683-4391-90e3-a63b3ed57b30 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:00.086067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648ec42-5683-4391-90e3-a63b3ed57b30 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:00.086347 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648ec42-5683-4391-90e3-a63b3ed57b30 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:00.101697 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648ec42-5683-4391-90e3-a63b3ed57b30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:00.110238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-b648ec42-5683-4391-90e3-a63b3ed57b30 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 09:20:00.110238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:00.110238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:00.110238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:00.110238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:00.110238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:00.110238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:00.110238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:00.110238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:00.110238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:00.110238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:00.110238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:00.110238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:00.110238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:00.110238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:00.110238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:00.111103 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:00.111103 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:00.111103 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:00.111103 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:00.111103 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:00.111103 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:00.111103 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:00.111103 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:00.111103 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:00.111103 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:00.111103 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:00.111103 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:00.111103 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:00.111103 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:00.111103 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:00.111103 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:00.116928 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:00.116928 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:00.116928 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:00.116928 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:00.116928 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:00.116928 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:00.116928 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:00.116928 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:00.116928 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:00.116928 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:00.116928 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 09:20:00.116928 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:00.116928 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 92/188] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 12 09:19:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:00.116928 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1aa4d-02fa-43b9-a623-af961a7ac939 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:00.117636 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1aa4d-02fa-43b9-a623-af961a7ac939 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:00.117636 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1aa4d-02fa-43b9-a623-af961a7ac939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:00.130747 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-2ae1aa4d-02fa-43b9-a623-af961a7ac939 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:00.131875 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-2ae1aa4d-02fa-43b9-a623-af961a7ac939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:00.195096 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92255846-e055-4090-836c-5498bb36ce36 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:00.195691 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 93/189] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:00.196524 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1aa4d-02fa-43b9-a623-af961a7ac939 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:00.252173 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8ffe1-4b66-483b-88d9-92f5ff50b3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:00.253045 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8ffe1-4b66-483b-88d9-92f5ff50b3a4 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:00.253321 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8ffe1-4b66-483b-88d9-92f5ff50b3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:00.253588 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8ffe1-4b66-483b-88d9-92f5ff50b3a4 None admin] PATH_INFO: `/v3/users/cbe8ef8640d64319b67a2b4fcc0e7a98` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:00.267415 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8ffe1-4b66-483b-88d9-92f5ff50b3a4 None admin] RBAC: Authorizing `identity:get_user(user_id=cbe8ef8640d64319b67a2b4fcc0e7a98)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:00.268927 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8ffe1-4b66-483b-88d9-92f5ff50b3a4 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:00.270693 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 97/190] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:20:00 2022] GET /identity/v3/users/cbe8ef8640d64319b67a2b4fcc0e7a98 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:00.271494 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8ffe1-4b66-483b-88d9-92f5ff50b3a4 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:00.295343 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1aa4d-02fa-43b9-a623-af961a7ac939 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:00.329489 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80599372-0ad4-4399-96f6-e6fcab86ee1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:00.330221 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80599372-0ad4-4399-96f6-e6fcab86ee1e None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:00.330475 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80599372-0ad4-4399-96f6-e6fcab86ee1e None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:00.330749 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80599372-0ad4-4399-96f6-e6fcab86ee1e None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:00.331498 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80599372-0ad4-4399-96f6-e6fcab86ee1e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:00.331804 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80599372-0ad4-4399-96f6-e6fcab86ee1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:00.333183 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80599372-0ad4-4399-96f6-e6fcab86ee1e None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:00.345423 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 94/191] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:20:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:00.345423 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80599372-0ad4-4399-96f6-e6fcab86ee1e None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:00.384650 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8ffe1-4b66-483b-88d9-92f5ff50b3a4 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:00.423463 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b3b55-d2de-4a11-8273-932d2c57d815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:00.424347 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b3b55-d2de-4a11-8273-932d2c57d815 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:00.424626 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b3b55-d2de-4a11-8273-932d2c57d815 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:00.424931 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b3b55-d2de-4a11-8273-932d2c57d815 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:00.426223 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b3b55-d2de-4a11-8273-932d2c57d815 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:00.427759 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b3b55-d2de-4a11-8273-932d2c57d815 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:00.429663 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 98/192] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:00.435493 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b3b55-d2de-4a11-8273-932d2c57d815 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:00.445939 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80599372-0ad4-4399-96f6-e6fcab86ee1e None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:00.477944 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6bf98-b1ac-45eb-92c0-e5c182d59290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:00.478841 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6bf98-b1ac-45eb-92c0-e5c182d59290 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:00.479272 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6bf98-b1ac-45eb-92c0-e5c182d59290 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:00.479551 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6bf98-b1ac-45eb-92c0-e5c182d59290 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:00.534742 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b3b55-d2de-4a11-8273-932d2c57d815 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:00.545989 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6bf98-b1ac-45eb-92c0-e5c182d59290 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:00.547439 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6bf98-b1ac-45eb-92c0-e5c182d59290 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:00.573823 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1f4dc-1c84-4547-b291-00f64e2adadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:00.575077 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1f4dc-1c84-4547-b291-00f64e2adadc None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:00.575361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1f4dc-1c84-4547-b291-00f64e2adadc None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:00.575637 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1f4dc-1c84-4547-b291-00f64e2adadc None admin] PATH_INFO: `/v3/users/cbe8ef8640d64319b67a2b4fcc0e7a98` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:00.576848 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1f4dc-1c84-4547-b291-00f64e2adadc None admin] RBAC: Authorizing `identity:get_user(user_id=cbe8ef8640d64319b67a2b4fcc0e7a98)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:00.578328 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1f4dc-1c84-4547-b291-00f64e2adadc None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:00.584354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 99/193] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:20:00 2022] GET /identity/v3/users/cbe8ef8640d64319b67a2b4fcc0e7a98 => generated 283 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:00.584354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1f4dc-1c84-4547-b291-00f64e2adadc None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:00.658196 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 95/194] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:20:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:20:00.658196 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6bf98-b1ac-45eb-92c0-e5c182d59290 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:00.684308 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1f4dc-1c84-4547-b291-00f64e2adadc None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:00.718044 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e71d9a-5b87-4b99-8bb2-124fb1967c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:00.718712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e71d9a-5b87-4b99-8bb2-124fb1967c37 None admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:00.718990 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e71d9a-5b87-4b99-8bb2-124fb1967c37 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:00.719262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e71d9a-5b87-4b99-8bb2-124fb1967c37 None admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:00.719967 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e71d9a-5b87-4b99-8bb2-124fb1967c37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:00.721408 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e71d9a-5b87-4b99-8bb2-124fb1967c37 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:00.740776 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 100/195] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 12 09:20:00 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:20:00.741873 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4658c70-ad9d-43d0-b681-cfee968a7f89 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:00.742190 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4658c70-ad9d-43d0-b681-cfee968a7f89 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:00.742460 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4658c70-ad9d-43d0-b681-cfee968a7f89 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:00.748015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 101/196] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:00.748015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4658c70-ad9d-43d0-b681-cfee968a7f89 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:00.748261 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6bf98-b1ac-45eb-92c0-e5c182d59290 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:00.784715 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3aaa93-d790-44e9-bc04-d263beba9994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:00.785561 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3aaa93-d790-44e9-bc04-d263beba9994 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:00.785941 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3aaa93-d790-44e9-bc04-d263beba9994 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:00.786292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3aaa93-d790-44e9-bc04-d263beba9994 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:00.851851 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4658c70-ad9d-43d0-b681-cfee968a7f89 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:00.858635 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3aaa93-d790-44e9-bc04-d263beba9994 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:00.860356 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3aaa93-d790-44e9-bc04-d263beba9994 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:00.886731 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff85a80-db61-4d10-bb9f-03b26df5be85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:00.887641 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff85a80-db61-4d10-bb9f-03b26df5be85 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:00.887922 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff85a80-db61-4d10-bb9f-03b26df5be85 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:00.888191 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff85a80-db61-4d10-bb9f-03b26df5be85 None admin] PATH_INFO: `/v3/projects/9d1d4b4ef82c4618beda78779862fc08` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:00.889439 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff85a80-db61-4d10-bb9f-03b26df5be85 None admin] RBAC: Authorizing `identity:get_project(project_id=9d1d4b4ef82c4618beda78779862fc08)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:00.890965 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff85a80-db61-4d10-bb9f-03b26df5be85 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:00.893072 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 102/197] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:20:00 2022] GET /identity/v3/projects/9d1d4b4ef82c4618beda78779862fc08 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:00.894316 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b3db4-2530-4e3a-80d1-41aa4f731edf None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:00.894603 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b3db4-2530-4e3a-80d1-41aa4f731edf None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:00.895161 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b3db4-2530-4e3a-80d1-41aa4f731edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:00.912210 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-146b3db4-2530-4e3a-80d1-41aa4f731edf None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:00.913336 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-146b3db4-2530-4e3a-80d1-41aa4f731edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:00.966104 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 96/198] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:20:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:20:00.966701 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3aaa93-d790-44e9-bc04-d263beba9994 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:00.994583 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 103/199] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:00.995693 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b3db4-2530-4e3a-80d1-41aa4f731edf None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:01.082752 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3aaa93-d790-44e9-bc04-d263beba9994 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:01.119955 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0f6c3-80ee-4ae1-a284-6fef32f41c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:01.120621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0f6c3-80ee-4ae1-a284-6fef32f41c81 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:01.120835 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b3db4-2530-4e3a-80d1-41aa4f731edf None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:01.120941 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0f6c3-80ee-4ae1-a284-6fef32f41c81 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:01.121164 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0f6c3-80ee-4ae1-a284-6fef32f41c81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:01.122807 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0f6c3-80ee-4ae1-a284-6fef32f41c81 None admin] RBAC: Adding query filter params (role.id=8f01c4c38fa44034a54c1f8cd2d2db1a, scope.project.id=9d1d4b4ef82c4618beda78779862fc08, user.id=cbe8ef8640d64319b67a2b4fcc0e7a98) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:01.122807 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0f6c3-80ee-4ae1-a284-6fef32f41c81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:01.124719 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0f6c3-80ee-4ae1-a284-6fef32f41c81 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:01.129564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 97/200] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:20:00 2022] GET /identity/v3/role_assignments?user.id=cbe8ef8640d64319b67a2b4fcc0e7a98&scope.project.id=9d1d4b4ef82c4618beda78779862fc08&role.id=8f01c4c38fa44034a54c1f8cd2d2db1a => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:01.130556 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0f6c3-80ee-4ae1-a284-6fef32f41c81 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:01.162976 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd41c36-aae0-4f0f-9472-69e6aa3a232f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:01.163814 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd41c36-aae0-4f0f-9472-69e6aa3a232f None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:01.164098 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd41c36-aae0-4f0f-9472-69e6aa3a232f None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:01.164367 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd41c36-aae0-4f0f-9472-69e6aa3a232f None admin] PATH_INFO: `/v3/projects/9d1d4b4ef82c4618beda78779862fc08` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:01.165655 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd41c36-aae0-4f0f-9472-69e6aa3a232f None admin] RBAC: Authorizing `identity:get_project(project_id=9d1d4b4ef82c4618beda78779862fc08)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:01.167302 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd41c36-aae0-4f0f-9472-69e6aa3a232f None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:01.169585 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 104/201] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:20:00 2022] GET /identity/v3/projects/9d1d4b4ef82c4618beda78779862fc08 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:01.174844 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd41c36-aae0-4f0f-9472-69e6aa3a232f None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:01.259369 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0f6c3-80ee-4ae1-a284-6fef32f41c81 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:01.284109 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd41c36-aae0-4f0f-9472-69e6aa3a232f None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:01.299575 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f34694-72ad-425b-a1b1-ceca95d0eab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:01.300689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f34694-72ad-425b-a1b1-ceca95d0eab0 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:01.300973 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f34694-72ad-425b-a1b1-ceca95d0eab0 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:01.301394 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f34694-72ad-425b-a1b1-ceca95d0eab0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:01.315859 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f34694-72ad-425b-a1b1-ceca95d0eab0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:01.319266 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b96dc1-449d-419f-9f8b-ceee102c01b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:01.319940 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b96dc1-449d-419f-9f8b-ceee102c01b4 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:01.320429 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b96dc1-449d-419f-9f8b-ceee102c01b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:01.320705 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b96dc1-449d-419f-9f8b-ceee102c01b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:01.321541 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b96dc1-449d-419f-9f8b-ceee102c01b4 None admin] RBAC: Adding query filter params (role.id=7d5eb6a968a74fb0a30eb1e80603005c, scope.project.id=9d1d4b4ef82c4618beda78779862fc08, user.id=cbe8ef8640d64319b67a2b4fcc0e7a98) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:01.321923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b96dc1-449d-419f-9f8b-ceee102c01b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:01.323656 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b96dc1-449d-419f-9f8b-ceee102c01b4 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:01.324058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-82f34694-72ad-425b-a1b1-ceca95d0eab0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 09:20:01.324058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:01.324058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:01.324058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:01.324058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:01.324058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:01.324058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:01.324058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:01.324058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:01.324058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:01.324058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:01.324058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:01.324058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:01.324058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:01.324058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:01.324058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:01.325520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:01.325520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:01.325520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:01.325520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:01.325520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:01.325520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:01.325520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:01.325520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:01.325520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:01.325520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:01.325520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:01.325520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:01.325520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:01.325520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:01.325520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:01.325520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:01.327309 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:01.327309 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:01.327309 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:01.327309 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:01.327309 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:01.327309 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:01.327309 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:01.327309 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:01.327309 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:01.327309 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:01.327309 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 09:20:01.327309 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:01.327309 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 98/202] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:20:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:01.331545 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f34694-72ad-425b-a1b1-ceca95d0eab0 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:01.343025 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 105/203] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:20:01 2022] GET /identity/v3/role_assignments?user.id=cbe8ef8640d64319b67a2b4fcc0e7a98&scope.project.id=9d1d4b4ef82c4618beda78779862fc08&role.id=7d5eb6a968a74fb0a30eb1e80603005c => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:01.444051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f34694-72ad-425b-a1b1-ceca95d0eab0 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:01.481557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25832d56-53c6-4522-aa15-acf5d3548a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:01.482291 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25832d56-53c6-4522-aa15-acf5d3548a78 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:01.482574 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25832d56-53c6-4522-aa15-acf5d3548a78 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:01.482853 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25832d56-53c6-4522-aa15-acf5d3548a78 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:01.483618 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25832d56-53c6-4522-aa15-acf5d3548a78 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:01.483927 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25832d56-53c6-4522-aa15-acf5d3548a78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:01.485343 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25832d56-53c6-4522-aa15-acf5d3548a78 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:01.494967 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 99/204] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 12 09:20:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:01.501411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b96dc1-449d-419f-9f8b-ceee102c01b4 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:01.639275 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b96dc1-449d-419f-9f8b-ceee102c01b4 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:01.674264 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cad3b5-db5c-43a3-826e-ed36c226c906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:01.675139 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cad3b5-db5c-43a3-826e-ed36c226c906 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:01.675415 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cad3b5-db5c-43a3-826e-ed36c226c906 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:01.675730 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cad3b5-db5c-43a3-826e-ed36c226c906 None admin] PATH_INFO: `/v3/users/8652917ed2e940bd838e2701c3f15969` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:01.676896 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cad3b5-db5c-43a3-826e-ed36c226c906 None admin] RBAC: Authorizing `identity:get_user(user_id=8652917ed2e940bd838e2701c3f15969)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:01.678381 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cad3b5-db5c-43a3-826e-ed36c226c906 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:01.680015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 106/205] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:20:01 2022] GET /identity/v3/users/8652917ed2e940bd838e2701c3f15969 => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:01.685561 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25832d56-53c6-4522-aa15-acf5d3548a78 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:01.785575 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25832d56-53c6-4522-aa15-acf5d3548a78 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:01.819149 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d9188-36c6-4cd9-ae95-f137c5c084a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:01.819801 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d9188-36c6-4cd9-ae95-f137c5c084a3 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:01.820079 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d9188-36c6-4cd9-ae95-f137c5c084a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:01.820349 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d9188-36c6-4cd9-ae95-f137c5c084a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:01.888168 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d9188-36c6-4cd9-ae95-f137c5c084a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:01.889616 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d9188-36c6-4cd9-ae95-f137c5c084a3 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:01.987582 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 100/206] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:20:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:20:01.993262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cad3b5-db5c-43a3-826e-ed36c226c906 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:02.093583 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cad3b5-db5c-43a3-826e-ed36c226c906 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:02.128166 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a42914-08be-415f-a71e-e27c2859bb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:02.129026 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a42914-08be-415f-a71e-e27c2859bb59 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:02.129306 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a42914-08be-415f-a71e-e27c2859bb59 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:02.129576 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a42914-08be-415f-a71e-e27c2859bb59 None admin] PATH_INFO: `/v3/projects/43f5db26667c4824b9e1f2363e88395d` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:02.131049 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a42914-08be-415f-a71e-e27c2859bb59 None admin] RBAC: Authorizing `identity:get_project(project_id=43f5db26667c4824b9e1f2363e88395d)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:02.132492 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a42914-08be-415f-a71e-e27c2859bb59 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:02.134491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 107/207] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:20:01 2022] GET /identity/v3/projects/43f5db26667c4824b9e1f2363e88395d => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:02.140692 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d9188-36c6-4cd9-ae95-f137c5c084a3 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:02.240880 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d9188-36c6-4cd9-ae95-f137c5c084a3 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:02.275723 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8e5a9-4545-4b2b-ac16-67ed454db414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:02.276380 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8e5a9-4545-4b2b-ac16-67ed454db414 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:02.276662 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8e5a9-4545-4b2b-ac16-67ed454db414 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:02.276937 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8e5a9-4545-4b2b-ac16-67ed454db414 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:02.277759 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8e5a9-4545-4b2b-ac16-67ed454db414 None admin] RBAC: Adding query filter params (role.id=62c060ea2ced4eb49bf035f7139ba8ea, scope.project.id=43f5db26667c4824b9e1f2363e88395d, user.id=8652917ed2e940bd838e2701c3f15969) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:02.278148 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8e5a9-4545-4b2b-ac16-67ed454db414 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:02.279594 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8e5a9-4545-4b2b-ac16-67ed454db414 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:02.285891 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 101/208] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:20:02 2022] GET /identity/v3/role_assignments?user.id=8652917ed2e940bd838e2701c3f15969&scope.project.id=43f5db26667c4824b9e1f2363e88395d&role.id=62c060ea2ced4eb49bf035f7139ba8ea => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:03.392958 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec4319-edcd-46d7-aa5a-7ec3775cb43f None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:03.393978 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec4319-edcd-46d7-aa5a-7ec3775cb43f None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:03.394472 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec4319-edcd-46d7-aa5a-7ec3775cb43f None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:03.396052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 108/209] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:03.401619 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3b9f0-e0f2-42c1-adb0-db40b12cf878 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:03.402481 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3b9f0-e0f2-42c1-adb0-db40b12cf878 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:03.402957 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3b9f0-e0f2-42c1-adb0-db40b12cf878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:03.420420 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-9cf3b9f0-e0f2-42c1-adb0-db40b12cf878 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:03.421963 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-9cf3b9f0-e0f2-42c1-adb0-db40b12cf878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:03.491892 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 102/210] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:03.515676 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec4319-edcd-46d7-aa5a-7ec3775cb43f None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:03.534087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ec41a-52db-4b26-8393-8391323ccb30 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:03.534395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ec41a-52db-4b26-8393-8391323ccb30 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:03.534654 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ec41a-52db-4b26-8393-8391323ccb30 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:03.536021 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 103/211] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:20:03.541061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f5f8c-1a33-4e19-b23a-7bd04efee65d None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:03.541521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f5f8c-1a33-4e19-b23a-7bd04efee65d None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:03.541965 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f5f8c-1a33-4e19-b23a-7bd04efee65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:03.558998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-a94f5f8c-1a33-4e19-b23a-7bd04efee65d None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:03.560452 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-a94f5f8c-1a33-4e19-b23a-7bd04efee65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:03.623764 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec4319-edcd-46d7-aa5a-7ec3775cb43f None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:03.628298 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 104/212] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:20:03.653385 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f5f8c-1a33-4e19-b23a-7bd04efee65d None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:03.659251 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3196c-dd88-4833-95a3-e82a7a953b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:03.660051 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3196c-dd88-4833-95a3-e82a7a953b82 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:03.660334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3196c-dd88-4833-95a3-e82a7a953b82 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:03.660613 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3196c-dd88-4833-95a3-e82a7a953b82 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:03.670968 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3196c-dd88-4833-95a3-e82a7a953b82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:03.678779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-8ce3196c-dd88-4833-95a3-e82a7a953b82 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 09:20:03.678779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:03.678779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:03.678779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:03.678779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:03.678779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:03.678779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:03.678779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:03.678779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:03.678779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:03.678779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:03.678779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:03.678779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:03.678779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:03.678779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:03.678779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:03.679681 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:03.679681 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:03.679681 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:03.679681 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:03.679681 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:03.679681 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:03.679681 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:03.679681 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:03.679681 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:03.679681 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:03.679681 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:03.679681 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:03.679681 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:03.679681 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:03.679681 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:03.679681 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:03.680574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:03.680574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:03.680574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:03.680574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:03.680574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:03.680574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:03.680574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:03.680574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:03.680574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:03.680574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:03.680574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 09:20:03.680574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:03.680574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 109/213] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:20:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:03.686468 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3196c-dd88-4833-95a3-e82a7a953b82 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:03.763219 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f5f8c-1a33-4e19-b23a-7bd04efee65d None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:03.790073 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3196c-dd88-4833-95a3-e82a7a953b82 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:03.798515 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2969368-547c-4275-a18f-4bd094477e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:03.799750 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2969368-547c-4275-a18f-4bd094477e3c None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:03.800236 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2969368-547c-4275-a18f-4bd094477e3c None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:03.800709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2969368-547c-4275-a18f-4bd094477e3c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:03.802658 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2969368-547c-4275-a18f-4bd094477e3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:03.804458 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2969368-547c-4275-a18f-4bd094477e3c None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:03.806543 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 105/214] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:03.813000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2969368-547c-4275-a18f-4bd094477e3c None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:03.829287 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9612f5d-7a0e-404c-9dff-8eebf853dfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:03.829985 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9612f5d-7a0e-404c-9dff-8eebf853dfaf None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:03.830428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9612f5d-7a0e-404c-9dff-8eebf853dfaf None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:03.830850 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9612f5d-7a0e-404c-9dff-8eebf853dfaf None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:03.831747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9612f5d-7a0e-404c-9dff-8eebf853dfaf None admin] RBAC: Adding query filter params (name=member) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:03.832202 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9612f5d-7a0e-404c-9dff-8eebf853dfaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:03.833754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9612f5d-7a0e-404c-9dff-8eebf853dfaf None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:03.842969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 110/215] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 12 09:20:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:03.848513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9612f5d-7a0e-404c-9dff-8eebf853dfaf None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:03.915223 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2969368-547c-4275-a18f-4bd094477e3c None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:03.947112 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9612f5d-7a0e-404c-9dff-8eebf853dfaf None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:03.947495 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f781b5-3c92-4bca-914b-dba3794936a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:03.948167 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f781b5-3c92-4bca-914b-dba3794936a0 None admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:03.948453 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f781b5-3c92-4bca-914b-dba3794936a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:03.948725 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f781b5-3c92-4bca-914b-dba3794936a0 None admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:03.949452 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f781b5-3c92-4bca-914b-dba3794936a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:03.950992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f781b5-3c92-4bca-914b-dba3794936a0 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:03.970752 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 106/216] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 12 09:20:03 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:20:03.972238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36399459-d1bb-46c6-bd33-aef78dff734c None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:03.972792 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36399459-d1bb-46c6-bd33-aef78dff734c None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:03.972792 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36399459-d1bb-46c6-bd33-aef78dff734c None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:03.974076 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 107/217] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:03.980066 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314456a7-7597-4a55-a7af-2c4aa49bda7e None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:03.980597 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314456a7-7597-4a55-a7af-2c4aa49bda7e None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:03.981018 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314456a7-7597-4a55-a7af-2c4aa49bda7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:03.990372 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019841e-001b-46c4-9c20-4d2427880a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:03.991270 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019841e-001b-46c4-9c20-4d2427880a42 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:03.991548 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019841e-001b-46c4-9c20-4d2427880a42 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:03.991844 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019841e-001b-46c4-9c20-4d2427880a42 None admin] PATH_INFO: `/v3/users/628196b943e84b90b05133db3166a043` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:03.999703 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-314456a7-7597-4a55-a7af-2c4aa49bda7e None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:04.001028 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-314456a7-7597-4a55-a7af-2c4aa49bda7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:04.009326 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019841e-001b-46c4-9c20-4d2427880a42 None admin] RBAC: Authorizing `identity:get_user(user_id=628196b943e84b90b05133db3166a043)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:04.011448 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019841e-001b-46c4-9c20-4d2427880a42 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:04.013460 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 111/218] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:20:03 2022] GET /identity/v3/users/628196b943e84b90b05133db3166a043 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:04.014715 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64900054-a883-473f-b523-da1faaa8a6a3 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:04.014982 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64900054-a883-473f-b523-da1faaa8a6a3 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:04.015250 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64900054-a883-473f-b523-da1faaa8a6a3 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:04.016471 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 112/219] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:04.019030 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64900054-a883-473f-b523-da1faaa8a6a3 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:04.071439 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 108/220] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:20:04.073414 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b683a-66a9-48ef-b39a-b44d914d9b63 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:04.073724 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b683a-66a9-48ef-b39a-b44d914d9b63 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:04.074028 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b683a-66a9-48ef-b39a-b44d914d9b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:04.094358 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-d67b683a-66a9-48ef-b39a-b44d914d9b63 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:04.095705 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-d67b683a-66a9-48ef-b39a-b44d914d9b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:04.144751 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64900054-a883-473f-b523-da1faaa8a6a3 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:04.171143 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 109/221] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:04.171921 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b683a-66a9-48ef-b39a-b44d914d9b63 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:04.183698 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12216f1d-2e1d-4a98-9738-5f2979ff1131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:04.184378 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12216f1d-2e1d-4a98-9738-5f2979ff1131 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:04.184657 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12216f1d-2e1d-4a98-9738-5f2979ff1131 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:04.184930 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12216f1d-2e1d-4a98-9738-5f2979ff1131 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:04.258562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12216f1d-2e1d-4a98-9738-5f2979ff1131 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:04.260015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12216f1d-2e1d-4a98-9738-5f2979ff1131 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:04.290258 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b683a-66a9-48ef-b39a-b44d914d9b63 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:04.332859 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6c6db-da77-496d-a85e-f8de1e511dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:04.333772 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6c6db-da77-496d-a85e-f8de1e511dce None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:04.334089 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6c6db-da77-496d-a85e-f8de1e511dce None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:04.334418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6c6db-da77-496d-a85e-f8de1e511dce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:04.347867 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6c6db-da77-496d-a85e-f8de1e511dce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:04.355902 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-8ab6c6db-da77-496d-a85e-f8de1e511dce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:20:04.355902 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:04.355902 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:04.355902 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:04.355902 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:04.355902 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:04.355902 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:04.355902 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:04.355902 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:04.355902 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:04.355902 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:04.355902 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:04.355902 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:04.355902 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:04.355902 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:04.355902 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:04.357363 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:04.357363 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:04.357363 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:04.357363 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:04.357363 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:04.357363 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:04.357363 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:04.357363 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:04.357363 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:04.357363 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:04.357363 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:04.357363 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:04.357363 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:04.357363 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:04.357363 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:04.357363 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:04.358220 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:04.358220 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:04.358220 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:04.358220 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:04.358220 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:04.358220 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:04.358220 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:04.358220 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:04.358220 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:04.358220 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:04.358220 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:20:04.358220 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:04.358220 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 110/222] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:20:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:04.358904 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6c6db-da77-496d-a85e-f8de1e511dce None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:04.383406 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 113/223] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:20:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:20:04.384461 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12216f1d-2e1d-4a98-9738-5f2979ff1131 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:04.457708 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6c6db-da77-496d-a85e-f8de1e511dce None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:04.484948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12216f1d-2e1d-4a98-9738-5f2979ff1131 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:04.491561 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1cd01-ea0d-4272-92f6-82f04d13f516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:04.492383 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1cd01-ea0d-4272-92f6-82f04d13f516 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:04.492662 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1cd01-ea0d-4272-92f6-82f04d13f516 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:04.492933 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1cd01-ea0d-4272-92f6-82f04d13f516 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:04.503981 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1cd01-ea0d-4272-92f6-82f04d13f516 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:04.512601 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-0ad1cd01-ea0d-4272-92f6-82f04d13f516 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 09:20:04.512601 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:04.512601 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:04.512601 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:04.512601 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:04.512601 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:04.512601 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:04.512601 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:04.512601 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:04.512601 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:04.512601 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:04.512601 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:04.512601 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:04.512601 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:04.512601 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:04.512601 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:04.513722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:04.513722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:04.513722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:04.513722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:04.513722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:04.513722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:04.513722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:04.513722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:04.513722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:04.513722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:04.513722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:04.513722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:04.513722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:04.513722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:04.513722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:04.513722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:04.514597 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:04.514597 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:04.514597 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:04.514597 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:04.514597 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:04.514597 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:04.514597 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:04.514597 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:04.514597 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:04.514597 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:04.514597 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 09:20:04.514597 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:04.514597 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 111/224] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 12 09:20:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:04.518758 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1cd01-ea0d-4272-92f6-82f04d13f516 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:04.524899 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62dbe3-09ec-457d-953e-be114e9d1009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:04.525757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62dbe3-09ec-457d-953e-be114e9d1009 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:04.526210 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62dbe3-09ec-457d-953e-be114e9d1009 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:04.526627 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62dbe3-09ec-457d-953e-be114e9d1009 None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:04.527541 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62dbe3-09ec-457d-953e-be114e9d1009 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:04.528497 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62dbe3-09ec-457d-953e-be114e9d1009 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:04.530062 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62dbe3-09ec-457d-953e-be114e9d1009 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:04.538621 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 114/225] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:20:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:04.539595 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62dbe3-09ec-457d-953e-be114e9d1009 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:04.624917 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1cd01-ea0d-4272-92f6-82f04d13f516 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:04.647604 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62dbe3-09ec-457d-953e-be114e9d1009 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:04.665200 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2948de1-4c11-4b7c-b77a-2caf133952bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:04.666405 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2948de1-4c11-4b7c-b77a-2caf133952bd None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:04.666761 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2948de1-4c11-4b7c-b77a-2caf133952bd None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:04.667106 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2948de1-4c11-4b7c-b77a-2caf133952bd None admin] PATH_INFO: `/v3/projects/9d1d4b4ef82c4618beda78779862fc08` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:04.668829 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2948de1-4c11-4b7c-b77a-2caf133952bd None admin] RBAC: Authorizing `identity:get_project(project_id=9d1d4b4ef82c4618beda78779862fc08)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:04.670479 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2948de1-4c11-4b7c-b77a-2caf133952bd None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:04.672921 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 112/226] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:20:04 2022] GET /identity/v3/projects/9d1d4b4ef82c4618beda78779862fc08 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:04.673915 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2948de1-4c11-4b7c-b77a-2caf133952bd None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:04.686475 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0d74e-51b5-4430-9238-9ad20786ce7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:04.687475 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0d74e-51b5-4430-9238-9ad20786ce7d None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:04.687956 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0d74e-51b5-4430-9238-9ad20786ce7d None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:04.688428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0d74e-51b5-4430-9238-9ad20786ce7d None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:04.689470 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0d74e-51b5-4430-9238-9ad20786ce7d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:04.690005 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0d74e-51b5-4430-9238-9ad20786ce7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:04.691584 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0d74e-51b5-4430-9238-9ad20786ce7d None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:04.703880 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 115/227] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:20:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:04.706545 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0d74e-51b5-4430-9238-9ad20786ce7d None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:04.790685 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2948de1-4c11-4b7c-b77a-2caf133952bd None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:04.806199 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0d74e-51b5-4430-9238-9ad20786ce7d None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:04.824330 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91ce1d-35d9-467e-8def-7c5b0e0d4766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:04.825761 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91ce1d-35d9-467e-8def-7c5b0e0d4766 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:04.826072 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91ce1d-35d9-467e-8def-7c5b0e0d4766 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:04.826346 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91ce1d-35d9-467e-8def-7c5b0e0d4766 None admin] PATH_INFO: `/v3/users/cbe8ef8640d64319b67a2b4fcc0e7a98` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:04.827616 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c91ce1d-35d9-467e-8def-7c5b0e0d4766 None admin] RBAC: Authorizing `identity:get_user(user_id=cbe8ef8640d64319b67a2b4fcc0e7a98)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:04.829233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c91ce1d-35d9-467e-8def-7c5b0e0d4766 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:04.831118 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 113/228] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:20:04 2022] GET /identity/v3/users/cbe8ef8640d64319b67a2b4fcc0e7a98 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:04.831890 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91ce1d-35d9-467e-8def-7c5b0e0d4766 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:04.843444 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252894a-c2a6-40de-83d8-da16191e86a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:04.844562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252894a-c2a6-40de-83d8-da16191e86a9 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:04.845062 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252894a-c2a6-40de-83d8-da16191e86a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:04.845534 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252894a-c2a6-40de-83d8-da16191e86a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:04.846597 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a252894a-c2a6-40de-83d8-da16191e86a9 None admin] RBAC: Adding query filter params (role.id=31076ec4ad6a42868d212118fe129d18, scope.project.id=9d1d4b4ef82c4618beda78779862fc08, user.id=628196b943e84b90b05133db3166a043) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:04.847124 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a252894a-c2a6-40de-83d8-da16191e86a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:04.848801 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a252894a-c2a6-40de-83d8-da16191e86a9 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:04.855016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 116/229] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:20:04 2022] GET /identity/v3/role_assignments?user.id=628196b943e84b90b05133db3166a043&scope.project.id=9d1d4b4ef82c4618beda78779862fc08&role.id=31076ec4ad6a42868d212118fe129d18 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:04.856047 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252894a-c2a6-40de-83d8-da16191e86a9 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:04.937046 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91ce1d-35d9-467e-8def-7c5b0e0d4766 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:04.961390 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252894a-c2a6-40de-83d8-da16191e86a9 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:04.972493 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062bd31-3b65-4d52-a400-66eee90a0f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:04.973412 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062bd31-3b65-4d52-a400-66eee90a0f3f None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:04.973691 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062bd31-3b65-4d52-a400-66eee90a0f3f None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:04.973994 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062bd31-3b65-4d52-a400-66eee90a0f3f None admin] PATH_INFO: `/v3/users/cbe8ef8640d64319b67a2b4fcc0e7a98` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:04.975293 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062bd31-3b65-4d52-a400-66eee90a0f3f None admin] RBAC: Authorizing `identity:get_user(user_id=cbe8ef8640d64319b67a2b4fcc0e7a98)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:04.976743 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062bd31-3b65-4d52-a400-66eee90a0f3f None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:04.978582 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 114/230] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:20:04 2022] GET /identity/v3/users/cbe8ef8640d64319b67a2b4fcc0e7a98 => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:04.984323 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062bd31-3b65-4d52-a400-66eee90a0f3f None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:05.000547 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c89be9-d0bb-4008-8e98-7427866057d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:05.001821 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c89be9-d0bb-4008-8e98-7427866057d1 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:05.002396 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c89be9-d0bb-4008-8e98-7427866057d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:05.002869 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c89be9-d0bb-4008-8e98-7427866057d1 None admin] PATH_INFO: `/v3/projects/9d1d4b4ef82c4618beda78779862fc08` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:05.004391 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c89be9-d0bb-4008-8e98-7427866057d1 None admin] RBAC: Authorizing `identity:get_project(project_id=9d1d4b4ef82c4618beda78779862fc08)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:05.006471 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c89be9-d0bb-4008-8e98-7427866057d1 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:05.008798 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 117/231] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:20:04 2022] GET /identity/v3/projects/9d1d4b4ef82c4618beda78779862fc08 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:05.018745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c89be9-d0bb-4008-8e98-7427866057d1 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:05.155360 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062bd31-3b65-4d52-a400-66eee90a0f3f None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:05.192668 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c89be9-d0bb-4008-8e98-7427866057d1 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:05.212967 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b7e7e-fb04-45bf-aca7-f4806aba683f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:05.214173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b7e7e-fb04-45bf-aca7-f4806aba683f None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:05.214659 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b7e7e-fb04-45bf-aca7-f4806aba683f None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:05.215143 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b7e7e-fb04-45bf-aca7-f4806aba683f None admin] PATH_INFO: `/v3/projects/9d1d4b4ef82c4618beda78779862fc08` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:05.217067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b7e7e-fb04-45bf-aca7-f4806aba683f None admin] RBAC: Authorizing `identity:get_project(project_id=9d1d4b4ef82c4618beda78779862fc08)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:05.218745 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b7e7e-fb04-45bf-aca7-f4806aba683f None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:05.229063 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 115/232] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:20:04 2022] GET /identity/v3/projects/9d1d4b4ef82c4618beda78779862fc08 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:05.231071 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b7e7e-fb04-45bf-aca7-f4806aba683f None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:05.236422 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c8ac0-4653-4fb7-8fc2-02f30e689209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:05.237324 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c8ac0-4653-4fb7-8fc2-02f30e689209 None admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:05.237598 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c8ac0-4653-4fb7-8fc2-02f30e689209 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:05.237868 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c8ac0-4653-4fb7-8fc2-02f30e689209 None admin] PATH_INFO: `/v3/projects/9d1d4b4ef82c4618beda78779862fc08/users/cbe8ef8640d64319b67a2b4fcc0e7a98/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:05.242765 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c8ac0-4653-4fb7-8fc2-02f30e689209 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d1d4b4ef82c4618beda78779862fc08, user_id=cbe8ef8640d64319b67a2b4fcc0e7a98, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:05.248241 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c8ac0-4653-4fb7-8fc2-02f30e689209 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:05.269612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 118/233] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 12 09:20:05 2022] PUT /identity/v3/projects/9d1d4b4ef82c4618beda78779862fc08/users/cbe8ef8640d64319b67a2b4fcc0e7a98/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:20:05.355379 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b7e7e-fb04-45bf-aca7-f4806aba683f None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:05.401393 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf213fd2-1907-429c-acca-f66379fd654a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:05.402317 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf213fd2-1907-429c-acca-f66379fd654a None admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:05.402644 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf213fd2-1907-429c-acca-f66379fd654a None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:05.403459 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf213fd2-1907-429c-acca-f66379fd654a None admin] PATH_INFO: `/v3/projects/9d1d4b4ef82c4618beda78779862fc08/users/cbe8ef8640d64319b67a2b4fcc0e7a98/roles/7d5eb6a968a74fb0a30eb1e80603005c` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:05.406269 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf213fd2-1907-429c-acca-f66379fd654a None admin] RBAC: Authorizing `identity:create_grant(project_id=9d1d4b4ef82c4618beda78779862fc08, user_id=cbe8ef8640d64319b67a2b4fcc0e7a98, role_id=7d5eb6a968a74fb0a30eb1e80603005c)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:05.407781 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf213fd2-1907-429c-acca-f66379fd654a None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:05.427395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 116/234] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 12 09:20:05 2022] PUT /identity/v3/projects/9d1d4b4ef82c4618beda78779862fc08/users/cbe8ef8640d64319b67a2b4fcc0e7a98/roles/7d5eb6a968a74fb0a30eb1e80603005c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:20:06.552687 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358028ef-8b7d-4f9f-9b1b-6d34199f82f8 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:06.553712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358028ef-8b7d-4f9f-9b1b-6d34199f82f8 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:06.554220 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358028ef-8b7d-4f9f-9b1b-6d34199f82f8 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:06.555794 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 119/235] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:06.561333 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7174c-2e52-42b3-a864-d9bea1afbeb3 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:06.562210 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7174c-2e52-42b3-a864-d9bea1afbeb3 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:06.562703 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7174c-2e52-42b3-a864-d9bea1afbeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:06.586235 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-a3d7174c-2e52-42b3-a864-d9bea1afbeb3 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:06.587720 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-a3d7174c-2e52-42b3-a864-d9bea1afbeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:06.681774 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 117/236] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:06.716996 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358028ef-8b7d-4f9f-9b1b-6d34199f82f8 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:06.846648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358028ef-8b7d-4f9f-9b1b-6d34199f82f8 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:06.888517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b7fa2-86d5-45c9-ba87-e52b4f47b9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:06.889688 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b7fa2-86d5-45c9-ba87-e52b4f47b9e0 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:06.890209 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b7fa2-86d5-45c9-ba87-e52b4f47b9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:06.890699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b7fa2-86d5-45c9-ba87-e52b4f47b9e0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:06.911073 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b7fa2-86d5-45c9-ba87-e52b4f47b9e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:06.919278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-575b7fa2-86d5-45c9-ba87-e52b4f47b9e0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 09:20:06.919278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:06.919278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:06.919278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:06.919278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:06.919278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:06.919278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:06.919278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:06.919278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:06.919278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:06.919278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:06.919278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:06.919278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:06.919278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:06.919278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:06.919278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:06.920159 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:06.920159 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:06.920159 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:06.920159 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:06.920159 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:06.920159 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:06.920159 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:06.920159 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:06.920159 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:06.920159 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:06.920159 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:06.920159 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:06.920159 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:06.920159 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:06.920159 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:06.920159 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:06.920975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:06.920975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:06.920975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:06.920975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:06.920975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:06.920975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:06.920975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:06.920975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:06.920975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:06.920975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:06.920975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 09:20:06.920975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:06.923348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 120/237] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:20:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:06.929143 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7174c-2e52-42b3-a864-d9bea1afbeb3 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:06.985967 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023af16-188c-4a94-91af-e2cd0b0d234f None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:06.986596 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023af16-188c-4a94-91af-e2cd0b0d234f None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:06.987071 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023af16-188c-4a94-91af-e2cd0b0d234f None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:06.988645 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 121/238] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:20:06.994228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe11b4-4f26-437e-907e-9608f3933fdd None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:06.994779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe11b4-4f26-437e-907e-9608f3933fdd None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:06.995253 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe11b4-4f26-437e-907e-9608f3933fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:07.013332 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-23fe11b4-4f26-437e-907e-9608f3933fdd None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:07.014864 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-23fe11b4-4f26-437e-907e-9608f3933fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:07.090529 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7174c-2e52-42b3-a864-d9bea1afbeb3 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:07.133090 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b84b0-05a1-4c24-b0eb-0c9f880760d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:07.133769 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b84b0-05a1-4c24-b0eb-0c9f880760d7 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:07.134075 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b84b0-05a1-4c24-b0eb-0c9f880760d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:07.134349 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b84b0-05a1-4c24-b0eb-0c9f880760d7 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:07.135094 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b84b0-05a1-4c24-b0eb-0c9f880760d7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:07.135398 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b84b0-05a1-4c24-b0eb-0c9f880760d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:07.136771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b84b0-05a1-4c24-b0eb-0c9f880760d7 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:07.143287 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 122/239] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:20:07.149648 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 118/240] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 12 09:20:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:07.154848 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe11b4-4f26-437e-907e-9608f3933fdd None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:07.174649 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b84b0-05a1-4c24-b0eb-0c9f880760d7 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:07.272787 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b84b0-05a1-4c24-b0eb-0c9f880760d7 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:07.311573 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67aacc-1da6-401b-a9ff-6453a3552e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:07.312392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67aacc-1da6-401b-a9ff-6453a3552e09 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:07.312673 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67aacc-1da6-401b-a9ff-6453a3552e09 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:07.312945 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67aacc-1da6-401b-a9ff-6453a3552e09 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:07.314165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67aacc-1da6-401b-a9ff-6453a3552e09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:07.315627 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67aacc-1da6-401b-a9ff-6453a3552e09 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:07.317414 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 119/241] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:07.326882 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67aacc-1da6-401b-a9ff-6453a3552e09 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:07.335452 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe11b4-4f26-437e-907e-9608f3933fdd None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:07.396470 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3f09f-18e3-4105-99cb-4d48954a3638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:07.397265 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3f09f-18e3-4105-99cb-4d48954a3638 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:07.397548 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3f09f-18e3-4105-99cb-4d48954a3638 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:07.397821 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3f09f-18e3-4105-99cb-4d48954a3638 None admin] PATH_INFO: `/v3/users/0e4a7c457c544b68a914edd7b61c8e77` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:07.425857 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3f09f-18e3-4105-99cb-4d48954a3638 None admin] RBAC: Authorizing `identity:get_user(user_id=0e4a7c457c544b68a914edd7b61c8e77)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:07.427447 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3f09f-18e3-4105-99cb-4d48954a3638 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:07.430759 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 123/242] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:20:07 2022] GET /identity/v3/users/0e4a7c457c544b68a914edd7b61c8e77 => generated 297 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:07.435012 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3f09f-18e3-4105-99cb-4d48954a3638 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:07.468122 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67aacc-1da6-401b-a9ff-6453a3552e09 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:07.535566 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ca707-f688-4bc6-9355-d740444fd589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:07.536258 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ca707-f688-4bc6-9355-d740444fd589 None admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:07.536539 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ca707-f688-4bc6-9355-d740444fd589 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:07.536816 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ca707-f688-4bc6-9355-d740444fd589 None admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:07.537536 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ca707-f688-4bc6-9355-d740444fd589 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:07.539010 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ca707-f688-4bc6-9355-d740444fd589 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:07.574412 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3f09f-18e3-4105-99cb-4d48954a3638 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:07.596509 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 120/243] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 12 09:20:07 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:20:07.624668 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214ccc5-5d20-4d3e-9c6b-b7a3926f2b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:07.625347 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214ccc5-5d20-4d3e-9c6b-b7a3926f2b9a None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:07.625628 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214ccc5-5d20-4d3e-9c6b-b7a3926f2b9a None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:07.625922 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214ccc5-5d20-4d3e-9c6b-b7a3926f2b9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:07.698680 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214ccc5-5d20-4d3e-9c6b-b7a3926f2b9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:07.700128 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214ccc5-5d20-4d3e-9c6b-b7a3926f2b9a None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:07.787614 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85982861-d807-4035-af6f-fd6d02539b36 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:07.787957 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85982861-d807-4035-af6f-fd6d02539b36 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:07.788178 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85982861-d807-4035-af6f-fd6d02539b36 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:07.789669 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 121/244] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:07.796322 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088a7b8-93b9-404e-89fb-24445234f0af None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:07.796633 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088a7b8-93b9-404e-89fb-24445234f0af None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:07.796886 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088a7b8-93b9-404e-89fb-24445234f0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:07.812015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 124/245] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:20:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 09:20:07.820076 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214ccc5-5d20-4d3e-9c6b-b7a3926f2b9a None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:07.839898 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-6088a7b8-93b9-404e-89fb-24445234f0af None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:07.841184 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-6088a7b8-93b9-404e-89fb-24445234f0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:07.927285 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214ccc5-5d20-4d3e-9c6b-b7a3926f2b9a None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:07.953032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 122/246] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:07.965088 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf503d09-96cb-4a97-a8f4-5bd70e887c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:07.966064 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf503d09-96cb-4a97-a8f4-5bd70e887c4a None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:07.966351 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf503d09-96cb-4a97-a8f4-5bd70e887c4a None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:07.966631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf503d09-96cb-4a97-a8f4-5bd70e887c4a None admin] PATH_INFO: `/v3/projects/9d1d4b4ef82c4618beda78779862fc08` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:07.967825 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf503d09-96cb-4a97-a8f4-5bd70e887c4a None admin] RBAC: Authorizing `identity:get_project(project_id=9d1d4b4ef82c4618beda78779862fc08)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:07.969278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf503d09-96cb-4a97-a8f4-5bd70e887c4a None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:07.971449 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 125/247] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:20:07 2022] GET /identity/v3/projects/9d1d4b4ef82c4618beda78779862fc08 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:07.978905 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf503d09-96cb-4a97-a8f4-5bd70e887c4a None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:07.979056 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088a7b8-93b9-404e-89fb-24445234f0af None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:08.110665 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf503d09-96cb-4a97-a8f4-5bd70e887c4a None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:08.115455 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088a7b8-93b9-404e-89fb-24445234f0af None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:08.158107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10e549-2d87-4cd9-906c-fe91e9d38fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:08.158944 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10e549-2d87-4cd9-906c-fe91e9d38fa2 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:08.159226 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10e549-2d87-4cd9-906c-fe91e9d38fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:08.159499 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10e549-2d87-4cd9-906c-fe91e9d38fa2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:08.159612 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902bb4c3-d70b-4683-a97b-655cc4cbbdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:08.160375 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bb4c3-d70b-4683-a97b-655cc4cbbdd8 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:08.160665 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bb4c3-d70b-4683-a97b-655cc4cbbdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:08.160946 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bb4c3-d70b-4683-a97b-655cc4cbbdd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:08.161811 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902bb4c3-d70b-4683-a97b-655cc4cbbdd8 None admin] RBAC: Adding query filter params (role.id=62c060ea2ced4eb49bf035f7139ba8ea, scope.project.id=9d1d4b4ef82c4618beda78779862fc08, user.id=0e4a7c457c544b68a914edd7b61c8e77) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:08.162182 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902bb4c3-d70b-4683-a97b-655cc4cbbdd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:08.163659 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902bb4c3-d70b-4683-a97b-655cc4cbbdd8 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:08.171958 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 123/248] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:20:07 2022] GET /identity/v3/role_assignments?user.id=0e4a7c457c544b68a914edd7b61c8e77&scope.project.id=9d1d4b4ef82c4618beda78779862fc08&role.id=62c060ea2ced4eb49bf035f7139ba8ea => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:08.173935 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510ce69-0116-4d05-91c8-7a8a6e8b2891 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:08.173935 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510ce69-0116-4d05-91c8-7a8a6e8b2891 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:08.174252 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510ce69-0116-4d05-91c8-7a8a6e8b2891 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:08.175686 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 124/249] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:08.176535 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10e549-2d87-4cd9-906c-fe91e9d38fa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:08.181479 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc273e56-fa28-4e92-b8f4-66dc94b9d44d None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:08.181791 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc273e56-fa28-4e92-b8f4-66dc94b9d44d None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:08.182095 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc273e56-fa28-4e92-b8f4-66dc94b9d44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:08.186436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-7d10e549-2d87-4cd9-906c-fe91e9d38fa2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 09:20:08.186436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:08.186436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:08.186436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:08.186436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:08.186436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:08.186436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:08.186436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:08.186436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:08.186436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:08.186436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:08.186436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:08.186436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:08.186436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:08.186436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:08.186436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:08.187405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:08.187405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:08.187405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:08.187405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:08.187405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:08.187405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:08.187405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:08.187405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:08.187405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:08.187405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:08.187405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:08.187405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:08.187405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:08.187405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:08.187405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:08.187405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:08.188222 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:08.188222 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:08.188222 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:08.188222 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:08.188222 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:08.188222 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:08.188222 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:08.188222 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:08.188222 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:08.188222 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:08.188222 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 09:20:08.188222 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:08.190902 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 126/250] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:20:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:08.204519 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10e549-2d87-4cd9-906c-fe91e9d38fa2 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:08.209519 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-fc273e56-fa28-4e92-b8f4-66dc94b9d44d None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:08.210971 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-fc273e56-fa28-4e92-b8f4-66dc94b9d44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:08.290778 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 125/251] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:20:08.314880 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc273e56-fa28-4e92-b8f4-66dc94b9d44d None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:08.372643 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10e549-2d87-4cd9-906c-fe91e9d38fa2 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:08.453134 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc273e56-fa28-4e92-b8f4-66dc94b9d44d None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:08.460050 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99038a-67e3-44b3-af44-1afe8b91c076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:08.460673 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99038a-67e3-44b3-af44-1afe8b91c076 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:08.460955 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99038a-67e3-44b3-af44-1afe8b91c076 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:08.461231 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99038a-67e3-44b3-af44-1afe8b91c076 None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:08.462029 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99038a-67e3-44b3-af44-1afe8b91c076 None admin] RBAC: Adding query filter params (name=member) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:08.462345 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99038a-67e3-44b3-af44-1afe8b91c076 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:08.463755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99038a-67e3-44b3-af44-1afe8b91c076 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:08.479089 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 127/252] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 12 09:20:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:08.480278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a21696-ff15-4080-b92f-49900ca2714b None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:08.480770 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a21696-ff15-4080-b92f-49900ca2714b None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:08.480878 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a21696-ff15-4080-b92f-49900ca2714b None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:08.485921 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 128/253] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:08.487642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22534bd0-210a-41f0-8461-bb05ac13ae4a None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:08.487932 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22534bd0-210a-41f0-8461-bb05ac13ae4a None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:08.488212 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22534bd0-210a-41f0-8461-bb05ac13ae4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:08.506663 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-22534bd0-210a-41f0-8461-bb05ac13ae4a None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:08.506886 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f51c77-5197-4171-8be9-2de447e06011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:08.507537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f51c77-5197-4171-8be9-2de447e06011 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:08.507824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f51c77-5197-4171-8be9-2de447e06011 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:08.508097 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f51c77-5197-4171-8be9-2de447e06011 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:08.508610 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-22534bd0-210a-41f0-8461-bb05ac13ae4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:08.537511 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f51c77-5197-4171-8be9-2de447e06011 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:08.545593 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-f6f51c77-5197-4171-8be9-2de447e06011 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:20:08.545593 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:08.545593 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:08.545593 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:08.545593 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:08.545593 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:08.545593 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:08.545593 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:08.545593 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:08.545593 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:08.545593 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:08.545593 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:08.545593 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:08.545593 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:08.545593 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:08.545593 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:08.546694 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:08.546694 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:08.546694 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:08.546694 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:08.546694 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:08.546694 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:08.546694 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:08.546694 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:08.546694 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:08.546694 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:08.546694 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:08.546694 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:08.546694 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:08.546694 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:08.546694 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:08.546694 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:08.547685 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:08.547685 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:08.547685 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:08.547685 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:08.547685 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:08.547685 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:08.547685 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:08.547685 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:08.547685 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:08.547685 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:08.547685 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:20:08.547685 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:08.558624 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 126/254] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:20:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:20:08.559673 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f51c77-5197-4171-8be9-2de447e06011 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:08.588249 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 129/255] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:20:08.589254 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22534bd0-210a-41f0-8461-bb05ac13ae4a None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:08.753163 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22534bd0-210a-41f0-8461-bb05ac13ae4a None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:08.763564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f51c77-5197-4171-8be9-2de447e06011 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:08.820021 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e64c15-e001-4113-a07d-5b448f4cd321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:08.821002 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e64c15-e001-4113-a07d-5b448f4cd321 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:08.821460 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e64c15-e001-4113-a07d-5b448f4cd321 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:08.821992 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e64c15-e001-4113-a07d-5b448f4cd321 None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:08.823506 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e64c15-e001-4113-a07d-5b448f4cd321 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:08.824001 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e64c15-e001-4113-a07d-5b448f4cd321 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:08.826685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e64c15-e001-4113-a07d-5b448f4cd321 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:08.833625 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04896756-50e0-416e-806c-4bcf5c408202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:08.834815 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04896756-50e0-416e-806c-4bcf5c408202 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:08.835302 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04896756-50e0-416e-806c-4bcf5c408202 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:08.835753 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04896756-50e0-416e-806c-4bcf5c408202 None admin] PATH_INFO: `/v3/users/628196b943e84b90b05133db3166a043` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:08.839954 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04896756-50e0-416e-806c-4bcf5c408202 None admin] RBAC: Authorizing `identity:get_user(user_id=628196b943e84b90b05133db3166a043)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:08.840217 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04896756-50e0-416e-806c-4bcf5c408202 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:08.845157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 127/256] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:20:08 2022] GET /identity/v3/users/628196b943e84b90b05133db3166a043 => generated 297 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:08.845157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04896756-50e0-416e-806c-4bcf5c408202 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:08.848599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 130/257] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:20:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:08.849615 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e64c15-e001-4113-a07d-5b448f4cd321 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:08.999562 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04896756-50e0-416e-806c-4bcf5c408202 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:09.021154 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e64c15-e001-4113-a07d-5b448f4cd321 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:09.064310 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed305b-d17f-41b2-a9da-bd54bb7e512f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:09.065183 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed305b-d17f-41b2-a9da-bd54bb7e512f None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:09.065467 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed305b-d17f-41b2-a9da-bd54bb7e512f None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:09.065739 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed305b-d17f-41b2-a9da-bd54bb7e512f None admin] PATH_INFO: `/v3/projects/9d1d4b4ef82c4618beda78779862fc08` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:09.067444 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05dca70-bd77-4e02-b72b-a5c455300dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:09.068254 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05dca70-bd77-4e02-b72b-a5c455300dd1 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:09.068529 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05dca70-bd77-4e02-b72b-a5c455300dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:09.068793 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05dca70-bd77-4e02-b72b-a5c455300dd1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:09.069942 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed305b-d17f-41b2-a9da-bd54bb7e512f None admin] RBAC: Authorizing `identity:get_project(project_id=9d1d4b4ef82c4618beda78779862fc08)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:09.071399 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed305b-d17f-41b2-a9da-bd54bb7e512f None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:09.075597 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 131/258] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:20:08 2022] GET /identity/v3/projects/9d1d4b4ef82c4618beda78779862fc08 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:09.076404 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed305b-d17f-41b2-a9da-bd54bb7e512f None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:09.092214 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05dca70-bd77-4e02-b72b-a5c455300dd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:09.100406 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-a05dca70-bd77-4e02-b72b-a5c455300dd1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 09:20:09.100406 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:09.100406 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:09.100406 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:09.100406 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:09.100406 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:09.100406 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:09.100406 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:09.100406 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:09.100406 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:09.100406 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:09.100406 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:09.100406 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:09.100406 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:09.100406 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:09.100406 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:09.101296 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:09.101296 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:09.101296 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:09.101296 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:09.101296 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:09.101296 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:09.101296 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:09.101296 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:09.101296 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:09.101296 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:09.101296 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:09.101296 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:09.101296 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:09.101296 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:09.101296 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:09.101296 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:09.102134 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:09.102134 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:09.102134 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:09.102134 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:09.102134 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:09.102134 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:09.102134 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:09.102134 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:09.102134 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:09.102134 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:09.102134 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 09:20:09.102134 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:09.102134 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 128/259] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 12 09:20:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:09.102821 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05dca70-bd77-4e02-b72b-a5c455300dd1 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:09.248863 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed305b-d17f-41b2-a9da-bd54bb7e512f None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:09.282607 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05dca70-bd77-4e02-b72b-a5c455300dd1 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:09.306599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0d17f-3826-43d9-a681-d75b6f1e363a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:09.307483 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0d17f-3826-43d9-a681-d75b6f1e363a None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:09.307762 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0d17f-3826-43d9-a681-d75b6f1e363a None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:09.308035 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0d17f-3826-43d9-a681-d75b6f1e363a None admin] PATH_INFO: `/v3/users/cbe8ef8640d64319b67a2b4fcc0e7a98` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:09.312357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0d17f-3826-43d9-a681-d75b6f1e363a None admin] RBAC: Authorizing `identity:get_user(user_id=cbe8ef8640d64319b67a2b4fcc0e7a98)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:09.313837 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0d17f-3826-43d9-a681-d75b6f1e363a None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:09.315543 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 132/260] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:20:09 2022] GET /identity/v3/users/cbe8ef8640d64319b67a2b4fcc0e7a98 => generated 283 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:09.316389 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0d17f-3826-43d9-a681-d75b6f1e363a None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:09.316811 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3f833-9c27-4b32-a02c-530e724ff48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:09.317716 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3f833-9c27-4b32-a02c-530e724ff48b None admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:09.318020 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3f833-9c27-4b32-a02c-530e724ff48b None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:09.318295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3f833-9c27-4b32-a02c-530e724ff48b None admin] PATH_INFO: `/v3/projects/9d1d4b4ef82c4618beda78779862fc08/users/628196b943e84b90b05133db3166a043/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:09.320617 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3f833-9c27-4b32-a02c-530e724ff48b None admin] RBAC: Authorizing `identity:create_grant(project_id=9d1d4b4ef82c4618beda78779862fc08, user_id=628196b943e84b90b05133db3166a043, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:09.322127 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3f833-9c27-4b32-a02c-530e724ff48b None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:09.342616 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 129/261] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 12 09:20:09 2022] PUT /identity/v3/projects/9d1d4b4ef82c4618beda78779862fc08/users/628196b943e84b90b05133db3166a043/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:20:09.345705 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3f833-9c27-4b32-a02c-530e724ff48b None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:09.499355 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3f833-9c27-4b32-a02c-530e724ff48b None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:09.537625 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330d0ec-44da-4054-be9d-22eb74972be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:09.538729 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330d0ec-44da-4054-be9d-22eb74972be8 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:09.539018 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330d0ec-44da-4054-be9d-22eb74972be8 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:09.539349 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330d0ec-44da-4054-be9d-22eb74972be8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:09.584117 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0d17f-3826-43d9-a681-d75b6f1e363a None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:09.618098 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330d0ec-44da-4054-be9d-22eb74972be8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:09.620126 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330d0ec-44da-4054-be9d-22eb74972be8 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:09.686663 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a15310-edc0-4656-81f6-2df9064084d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:09.687377 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a15310-edc0-4656-81f6-2df9064084d0 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:09.687638 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a15310-edc0-4656-81f6-2df9064084d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:09.687910 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a15310-edc0-4656-81f6-2df9064084d0 None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:09.688675 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a15310-edc0-4656-81f6-2df9064084d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:09.688988 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a15310-edc0-4656-81f6-2df9064084d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:09.690426 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a15310-edc0-4656-81f6-2df9064084d0 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:09.709304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 133/262] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:20:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:09.715450 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a15310-edc0-4656-81f6-2df9064084d0 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:09.730293 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 130/263] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:20:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:20:09.736018 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330d0ec-44da-4054-be9d-22eb74972be8 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:09.850246 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330d0ec-44da-4054-be9d-22eb74972be8 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:09.868365 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a15310-edc0-4656-81f6-2df9064084d0 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:09.893478 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9ae49-7a84-4013-bbb4-03222db6b202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:09.894905 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9ae49-7a84-4013-bbb4-03222db6b202 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:09.895416 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9ae49-7a84-4013-bbb4-03222db6b202 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:09.895884 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9ae49-7a84-4013-bbb4-03222db6b202 None admin] PATH_INFO: `/v3/projects/9d1d4b4ef82c4618beda78779862fc08` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:09.897267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9ae49-7a84-4013-bbb4-03222db6b202 None admin] RBAC: Authorizing `identity:get_project(project_id=9d1d4b4ef82c4618beda78779862fc08)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:09.898995 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9ae49-7a84-4013-bbb4-03222db6b202 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:09.901390 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 131/264] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:20:09 2022] GET /identity/v3/projects/9d1d4b4ef82c4618beda78779862fc08 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:09.908323 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9ae49-7a84-4013-bbb4-03222db6b202 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:09.926567 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18fabab-b982-4ed1-a9d0-a3a489fbc1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:09.927443 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fabab-b982-4ed1-a9d0-a3a489fbc1bc None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:09.927722 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fabab-b982-4ed1-a9d0-a3a489fbc1bc None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:09.927994 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fabab-b982-4ed1-a9d0-a3a489fbc1bc None admin] PATH_INFO: `/v3/users/cbe8ef8640d64319b67a2b4fcc0e7a98` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:09.929192 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18fabab-b982-4ed1-a9d0-a3a489fbc1bc None admin] RBAC: Authorizing `identity:get_user(user_id=cbe8ef8640d64319b67a2b4fcc0e7a98)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:09.930671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18fabab-b982-4ed1-a9d0-a3a489fbc1bc None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:09.932301 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 134/265] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:20:09 2022] GET /identity/v3/users/cbe8ef8640d64319b67a2b4fcc0e7a98 => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:09.938172 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18fabab-b982-4ed1-a9d0-a3a489fbc1bc None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:10.013238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9ae49-7a84-4013-bbb4-03222db6b202 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:10.047035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e544a-80a1-41b8-b403-0a0e9d528f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:10.047689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e544a-80a1-41b8-b403-0a0e9d528f15 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:10.047971 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e544a-80a1-41b8-b403-0a0e9d528f15 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:10.048247 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e544a-80a1-41b8-b403-0a0e9d528f15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:10.049068 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e544a-80a1-41b8-b403-0a0e9d528f15 None admin] RBAC: Adding query filter params (role.id=8f01c4c38fa44034a54c1f8cd2d2db1a, scope.project.id=9d1d4b4ef82c4618beda78779862fc08, user.id=cbe8ef8640d64319b67a2b4fcc0e7a98) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:10.049375 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e544a-80a1-41b8-b403-0a0e9d528f15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:10.050861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e544a-80a1-41b8-b403-0a0e9d528f15 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:10.057109 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 132/266] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:20:09 2022] GET /identity/v3/role_assignments?user.id=cbe8ef8640d64319b67a2b4fcc0e7a98&scope.project.id=9d1d4b4ef82c4618beda78779862fc08&role.id=8f01c4c38fa44034a54c1f8cd2d2db1a => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:10.063902 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18fabab-b982-4ed1-a9d0-a3a489fbc1bc None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:10.102156 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73003458-90a2-454d-9a9b-9ed81ed78531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:10.103156 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73003458-90a2-454d-9a9b-9ed81ed78531 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:10.104091 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73003458-90a2-454d-9a9b-9ed81ed78531 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:10.104091 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73003458-90a2-454d-9a9b-9ed81ed78531 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:10.178353 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73003458-90a2-454d-9a9b-9ed81ed78531 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:10.179840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73003458-90a2-454d-9a9b-9ed81ed78531 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:10.282278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 135/267] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:20:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:20:10.288246 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e544a-80a1-41b8-b403-0a0e9d528f15 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:10.417618 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e544a-80a1-41b8-b403-0a0e9d528f15 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:10.452012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db5a41-080f-4182-8531-4508ab149f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:10.453150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db5a41-080f-4182-8531-4508ab149f59 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:10.453577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db5a41-080f-4182-8531-4508ab149f59 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:10.454020 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db5a41-080f-4182-8531-4508ab149f59 None admin] PATH_INFO: `/v3/projects/9d1d4b4ef82c4618beda78779862fc08` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:10.455355 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db5a41-080f-4182-8531-4508ab149f59 None admin] RBAC: Authorizing `identity:get_project(project_id=9d1d4b4ef82c4618beda78779862fc08)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:10.456970 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db5a41-080f-4182-8531-4508ab149f59 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:10.458908 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 133/268] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:20:10 2022] GET /identity/v3/projects/9d1d4b4ef82c4618beda78779862fc08 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:10.464890 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73003458-90a2-454d-9a9b-9ed81ed78531 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:10.565337 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73003458-90a2-454d-9a9b-9ed81ed78531 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:10.599942 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4fc8b-1635-4419-9886-3c4a9228be75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:10.600881 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4fc8b-1635-4419-9886-3c4a9228be75 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:10.601309 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4fc8b-1635-4419-9886-3c4a9228be75 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:10.601725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4fc8b-1635-4419-9886-3c4a9228be75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:10.602721 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4fc8b-1635-4419-9886-3c4a9228be75 None admin] RBAC: Adding query filter params (role.id=7d5eb6a968a74fb0a30eb1e80603005c, scope.project.id=9d1d4b4ef82c4618beda78779862fc08, user.id=cbe8ef8640d64319b67a2b4fcc0e7a98) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:10.603175 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4fc8b-1635-4419-9886-3c4a9228be75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:10.604775 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4fc8b-1635-4419-9886-3c4a9228be75 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:10.612051 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 136/269] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:20:10 2022] GET /identity/v3/role_assignments?user.id=cbe8ef8640d64319b67a2b4fcc0e7a98&scope.project.id=9d1d4b4ef82c4618beda78779862fc08&role.id=7d5eb6a968a74fb0a30eb1e80603005c => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:11.032470 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57ead4-51c3-49af-92b7-6963dc66fd2a None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:11.033012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57ead4-51c3-49af-92b7-6963dc66fd2a None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:11.033012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57ead4-51c3-49af-92b7-6963dc66fd2a None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:11.034647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 134/270] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:11.040435 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326c43c-73c8-4205-a804-a34ac2cb1ac0 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:11.040873 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326c43c-73c8-4205-a804-a34ac2cb1ac0 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:11.041069 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326c43c-73c8-4205-a804-a34ac2cb1ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:11.057434 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1a614-3874-4b99-bee7-94e4d307395a None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:11.057753 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1a614-3874-4b99-bee7-94e4d307395a None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:11.058029 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1a614-3874-4b99-bee7-94e4d307395a None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:11.059630 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 135/271] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:20:11.063152 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-6326c43c-73c8-4205-a804-a34ac2cb1ac0 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:11.064354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-6326c43c-73c8-4205-a804-a34ac2cb1ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:11.067108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67dbf5f-76b4-403b-a45f-23c3ff052970 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:11.067391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67dbf5f-76b4-403b-a45f-23c3ff052970 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:11.067666 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67dbf5f-76b4-403b-a45f-23c3ff052970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:11.084787 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-f67dbf5f-76b4-403b-a45f-23c3ff052970 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:11.085980 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-f67dbf5f-76b4-403b-a45f-23c3ff052970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:11.157892 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 137/272] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:20:11.160292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 136/273] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:20:11.186028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326c43c-73c8-4205-a804-a34ac2cb1ac0 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:11.189628 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67dbf5f-76b4-403b-a45f-23c3ff052970 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:11.292265 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67dbf5f-76b4-403b-a45f-23c3ff052970 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:11.302273 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326c43c-73c8-4205-a804-a34ac2cb1ac0 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:11.324509 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8d472-3e40-46d6-a2f2-08549e538f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:11.325344 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8d472-3e40-46d6-a2f2-08549e538f91 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:11.325622 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8d472-3e40-46d6-a2f2-08549e538f91 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:11.325910 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8d472-3e40-46d6-a2f2-08549e538f91 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:11.327080 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8d472-3e40-46d6-a2f2-08549e538f91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:11.328527 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8d472-3e40-46d6-a2f2-08549e538f91 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:11.334469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 137/274] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:11.334469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4de0a3-6beb-420b-92ac-42bc8621fb2a None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:11.334469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4de0a3-6beb-420b-92ac-42bc8621fb2a None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:11.334469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4de0a3-6beb-420b-92ac-42bc8621fb2a None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:11.334469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 138/275] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:11.337838 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4de0a3-6beb-420b-92ac-42bc8621fb2a None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:11.339937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af1fc6-b9d9-433a-889e-7ebcaa3856e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:11.341261 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af1fc6-b9d9-433a-889e-7ebcaa3856e8 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:11.341546 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af1fc6-b9d9-433a-889e-7ebcaa3856e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:11.341863 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af1fc6-b9d9-433a-889e-7ebcaa3856e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:11.352167 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af1fc6-b9d9-433a-889e-7ebcaa3856e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:11.360019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-21af1fc6-b9d9-433a-889e-7ebcaa3856e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 09:20:11.360019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:11.360019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:11.360019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:11.360019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:11.360019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:11.360019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:11.360019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:11.360019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:11.360019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:11.360019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:11.360019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:11.360019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:11.360019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:11.360019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:11.360019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:11.360916 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:11.360916 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:11.360916 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:11.360916 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:11.360916 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:11.360916 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:11.360916 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:11.360916 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:11.360916 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:11.360916 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:11.360916 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:11.360916 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:11.360916 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:11.360916 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:11.360916 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:11.360916 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:11.361718 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:11.361718 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:11.361718 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:11.361718 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:11.361718 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:11.361718 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:11.361718 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:11.361718 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:11.361718 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:11.361718 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:11.361718 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 09:20:11.361718 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:11.361718 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 138/276] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:20:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:11.362893 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28486718-c6d7-4dc9-8e7a-b5fbce612e36 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:11.362893 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28486718-c6d7-4dc9-8e7a-b5fbce612e36 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:11.363173 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28486718-c6d7-4dc9-8e7a-b5fbce612e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:11.383616 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-28486718-c6d7-4dc9-8e7a-b5fbce612e36 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:11.384788 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-28486718-c6d7-4dc9-8e7a-b5fbce612e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:11.438154 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4de0a3-6beb-420b-92ac-42bc8621fb2a None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:11.457472 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 139/277] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:11.458321 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28486718-c6d7-4dc9-8e7a-b5fbce612e36 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:11.486178 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54976e3-f8c8-44c5-810b-2b25f3d9d501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:11.486853 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54976e3-f8c8-44c5-810b-2b25f3d9d501 None admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:11.487138 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54976e3-f8c8-44c5-810b-2b25f3d9d501 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:11.487414 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54976e3-f8c8-44c5-810b-2b25f3d9d501 None admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:11.488110 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54976e3-f8c8-44c5-810b-2b25f3d9d501 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:11.489542 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54976e3-f8c8-44c5-810b-2b25f3d9d501 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:11.509754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 139/278] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 12 09:20:11 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:20:11.510438 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54976e3-f8c8-44c5-810b-2b25f3d9d501 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:11.581483 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28486718-c6d7-4dc9-8e7a-b5fbce612e36 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:11.619844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54976e3-f8c8-44c5-810b-2b25f3d9d501 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:11.630885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d7467-a056-480a-b957-eb6672483b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:11.632412 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d7467-a056-480a-b957-eb6672483b3c None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:11.632839 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d7467-a056-480a-b957-eb6672483b3c None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:11.633253 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d7467-a056-480a-b957-eb6672483b3c None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:11.634371 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d7467-a056-480a-b957-eb6672483b3c None admin] RBAC: Adding query filter params (name=member) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:11.634824 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d7467-a056-480a-b957-eb6672483b3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:11.637099 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d7467-a056-480a-b957-eb6672483b3c None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:11.649359 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 140/279] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 12 09:20:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:11.655537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d7467-a056-480a-b957-eb6672483b3c None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:11.663092 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651269be-cf6e-42a7-b34a-50c789ef8135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:11.664013 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651269be-cf6e-42a7-b34a-50c789ef8135 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:11.664362 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651269be-cf6e-42a7-b34a-50c789ef8135 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:11.664690 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651269be-cf6e-42a7-b34a-50c789ef8135 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:11.676845 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651269be-cf6e-42a7-b34a-50c789ef8135 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:11.685282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-651269be-cf6e-42a7-b34a-50c789ef8135 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 09:20:11.685282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:11.685282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:11.685282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:11.685282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:11.685282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:11.685282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:11.685282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:11.685282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:11.685282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:11.685282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:11.685282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:11.685282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:11.685282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:11.685282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:11.685282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:11.686439 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:11.686439 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:11.686439 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:11.686439 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:11.686439 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:11.686439 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:11.686439 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:11.686439 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:11.686439 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:11.686439 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:11.686439 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:11.686439 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:11.686439 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:11.686439 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:11.686439 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:11.686439 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:11.687230 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:11.687230 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:11.687230 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:11.687230 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:11.687230 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:11.687230 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:11.687230 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:11.687230 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:11.687230 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:11.687230 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:11.687230 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 09:20:11.687230 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:11.687230 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 140/280] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:20:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:11.694955 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651269be-cf6e-42a7-b34a-50c789ef8135 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:11.767508 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d7467-a056-480a-b957-eb6672483b3c None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:11.802225 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf69805-7e7f-4ccf-982c-94e7efd08a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:11.803809 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf69805-7e7f-4ccf-982c-94e7efd08a7c None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:11.804284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf69805-7e7f-4ccf-982c-94e7efd08a7c None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:11.804980 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf69805-7e7f-4ccf-982c-94e7efd08a7c None admin] PATH_INFO: `/v3/users/9ac9674375aa4de7ae45df80d36821cf` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:11.809819 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651269be-cf6e-42a7-b34a-50c789ef8135 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:11.819399 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf69805-7e7f-4ccf-982c-94e7efd08a7c None admin] RBAC: Authorizing `identity:get_user(user_id=9ac9674375aa4de7ae45df80d36821cf)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:11.821111 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf69805-7e7f-4ccf-982c-94e7efd08a7c None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:11.823057 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 141/281] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:20:11 2022] GET /identity/v3/users/9ac9674375aa4de7ae45df80d36821cf => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:11.829330 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf69805-7e7f-4ccf-982c-94e7efd08a7c None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:11.850715 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941a9f8-72f6-4a7f-bd30-69b1ef258f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:11.851318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941a9f8-72f6-4a7f-bd30-69b1ef258f02 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:11.851601 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941a9f8-72f6-4a7f-bd30-69b1ef258f02 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:11.851877 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941a9f8-72f6-4a7f-bd30-69b1ef258f02 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:11.852634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941a9f8-72f6-4a7f-bd30-69b1ef258f02 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:11.852937 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941a9f8-72f6-4a7f-bd30-69b1ef258f02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:11.856109 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941a9f8-72f6-4a7f-bd30-69b1ef258f02 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:11.864740 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 141/282] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 12 09:20:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:11.870486 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941a9f8-72f6-4a7f-bd30-69b1ef258f02 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:11.941345 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf69805-7e7f-4ccf-982c-94e7efd08a7c None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:11.975634 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef78d2-af1c-4bea-9d08-a02b4e2dd8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:11.976291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef78d2-af1c-4bea-9d08-a02b4e2dd8fe None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:11.976569 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef78d2-af1c-4bea-9d08-a02b4e2dd8fe None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:11.976841 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef78d2-af1c-4bea-9d08-a02b4e2dd8fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:11.977659 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef78d2-af1c-4bea-9d08-a02b4e2dd8fe None admin] RBAC: Adding query filter params (role.id=31076ec4ad6a42868d212118fe129d18, user.id=9ac9674375aa4de7ae45df80d36821cf, scope.system=all) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:11.977987 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef78d2-af1c-4bea-9d08-a02b4e2dd8fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:11.979426 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef78d2-af1c-4bea-9d08-a02b4e2dd8fe None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:11.985022 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 142/283] 10.222.0.60 () {56 vars in 1308 bytes} [Thu May 12 09:20:11 2022] GET /identity/v3/role_assignments?user.id=9ac9674375aa4de7ae45df80d36821cf&scope.system=all&role.id=31076ec4ad6a42868d212118fe129d18 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:11.998924 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941a9f8-72f6-4a7f-bd30-69b1ef258f02 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:12.037196 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32679aa7-5f4f-421e-9577-71091751bd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:12.038106 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32679aa7-5f4f-421e-9577-71091751bd28 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:12.038387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32679aa7-5f4f-421e-9577-71091751bd28 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:12.038655 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32679aa7-5f4f-421e-9577-71091751bd28 None admin] PATH_INFO: `/v3/users/0e4a7c457c544b68a914edd7b61c8e77` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:12.039871 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32679aa7-5f4f-421e-9577-71091751bd28 None admin] RBAC: Authorizing `identity:get_user(user_id=0e4a7c457c544b68a914edd7b61c8e77)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:12.041330 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32679aa7-5f4f-421e-9577-71091751bd28 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:12.043341 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 142/284] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:20:11 2022] GET /identity/v3/users/0e4a7c457c544b68a914edd7b61c8e77 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:12.048834 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef78d2-af1c-4bea-9d08-a02b4e2dd8fe None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:12.161671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef78d2-af1c-4bea-9d08-a02b4e2dd8fe None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:12.197565 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a73ba4-a9db-41f1-b5ab-a002f0d986d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:12.198477 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a73ba4-a9db-41f1-b5ab-a002f0d986d3 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:12.198756 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a73ba4-a9db-41f1-b5ab-a002f0d986d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:12.199025 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a73ba4-a9db-41f1-b5ab-a002f0d986d3 None admin] PATH_INFO: `/v3/projects/9d1d4b4ef82c4618beda78779862fc08` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:12.200299 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a73ba4-a9db-41f1-b5ab-a002f0d986d3 None admin] RBAC: Authorizing `identity:get_project(project_id=9d1d4b4ef82c4618beda78779862fc08)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:12.201753 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a73ba4-a9db-41f1-b5ab-a002f0d986d3 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:12.203511 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 143/285] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:20:12 2022] GET /identity/v3/projects/9d1d4b4ef82c4618beda78779862fc08 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:12.209569 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32679aa7-5f4f-421e-9577-71091751bd28 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:12.357663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32679aa7-5f4f-421e-9577-71091751bd28 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:12.396406 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce0d3a-c7d7-4ba9-a8c6-247204cf47eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:12.397304 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce0d3a-c7d7-4ba9-a8c6-247204cf47eb None admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:12.397579 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce0d3a-c7d7-4ba9-a8c6-247204cf47eb None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:12.397846 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce0d3a-c7d7-4ba9-a8c6-247204cf47eb None admin] PATH_INFO: `/v3/projects/9d1d4b4ef82c4618beda78779862fc08/users/0e4a7c457c544b68a914edd7b61c8e77/roles/62c060ea2ced4eb49bf035f7139ba8ea` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:12.399822 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce0d3a-c7d7-4ba9-a8c6-247204cf47eb None admin] RBAC: Authorizing `identity:create_grant(project_id=9d1d4b4ef82c4618beda78779862fc08, user_id=0e4a7c457c544b68a914edd7b61c8e77, role_id=62c060ea2ced4eb49bf035f7139ba8ea)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:12.401253 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce0d3a-c7d7-4ba9-a8c6-247204cf47eb None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:12.418174 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 143/286] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 12 09:20:12 2022] PUT /identity/v3/projects/9d1d4b4ef82c4618beda78779862fc08/users/0e4a7c457c544b68a914edd7b61c8e77/roles/62c060ea2ced4eb49bf035f7139ba8ea => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:20:12.486551 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fe847-56f9-441c-a43d-0a154c8abd91 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:12.486890 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fe847-56f9-441c-a43d-0a154c8abd91 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:12.487109 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fe847-56f9-441c-a43d-0a154c8abd91 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:12.488521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 144/287] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:12.493630 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00997c-58f4-4b72-8156-5ba7808739e3 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:12.493924 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00997c-58f4-4b72-8156-5ba7808739e3 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:12.494206 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00997c-58f4-4b72-8156-5ba7808739e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:12.518347 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-fb00997c-58f4-4b72-8156-5ba7808739e3 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:12.519524 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-fb00997c-58f4-4b72-8156-5ba7808739e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:12.619062 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 144/288] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:12.654371 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fe847-56f9-441c-a43d-0a154c8abd91 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:12.804863 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fe847-56f9-441c-a43d-0a154c8abd91 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:12.839152 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201e6ec-2494-44f8-b483-98cd1addde6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:12.841130 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201e6ec-2494-44f8-b483-98cd1addde6c None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:12.841704 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201e6ec-2494-44f8-b483-98cd1addde6c None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:12.842349 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201e6ec-2494-44f8-b483-98cd1addde6c None admin] PATH_INFO: `/v3/roles/member` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:12.860703 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201e6ec-2494-44f8-b483-98cd1addde6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:12.868885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-4201e6ec-2494-44f8-b483-98cd1addde6c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 09:20:12.868885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:12.868885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:12.868885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:12.868885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:12.868885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:12.868885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:12.868885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:12.868885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:12.868885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:12.868885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:12.868885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:12.868885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:12.868885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:12.868885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:12.868885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:12.870186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:12.870186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:12.870186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:12.870186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:12.870186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:12.870186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:12.870186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:12.870186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:12.870186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:12.870186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:12.870186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:12.870186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:12.870186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:12.870186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:12.870186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:12.870186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:12.871003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:12.871003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:12.871003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:12.871003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:12.871003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:12.871003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:12.871003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:12.871003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:12.871003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:12.871003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:12.871003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 09:20:12.871003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:12.871003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 145/289] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:20:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:12.878993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00997c-58f4-4b72-8156-5ba7808739e3 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:13.013937 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00997c-58f4-4b72-8156-5ba7808739e3 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:13.048114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec9dc2-950a-4d16-ad8b-6dc38a4a75db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:13.048917 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec9dc2-950a-4d16-ad8b-6dc38a4a75db None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:13.049078 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec9dc2-950a-4d16-ad8b-6dc38a4a75db None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:13.049348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec9dc2-950a-4d16-ad8b-6dc38a4a75db None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:13.050141 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec9dc2-950a-4d16-ad8b-6dc38a4a75db None admin] RBAC: Adding query filter params (name=member) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:13.050451 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec9dc2-950a-4d16-ad8b-6dc38a4a75db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:13.051859 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec9dc2-950a-4d16-ad8b-6dc38a4a75db None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:13.062395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 145/290] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 12 09:20:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:13.067722 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201e6ec-2494-44f8-b483-98cd1addde6c None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:13.225977 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201e6ec-2494-44f8-b483-98cd1addde6c None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:13.261424 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb0fa0-750c-47c4-98a9-162e0c1b41e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:13.263099 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb0fa0-750c-47c4-98a9-162e0c1b41e1 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:13.263385 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb0fa0-750c-47c4-98a9-162e0c1b41e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:13.263661 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb0fa0-750c-47c4-98a9-162e0c1b41e1 None admin] PATH_INFO: `/v3/users/628196b943e84b90b05133db3166a043` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:13.264961 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb0fa0-750c-47c4-98a9-162e0c1b41e1 None admin] RBAC: Authorizing `identity:get_user(user_id=628196b943e84b90b05133db3166a043)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:13.266517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb0fa0-750c-47c4-98a9-162e0c1b41e1 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:13.268243 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 146/291] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:20:13 2022] GET /identity/v3/users/628196b943e84b90b05133db3166a043 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:13.274157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec9dc2-950a-4d16-ad8b-6dc38a4a75db None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:13.379291 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec9dc2-950a-4d16-ad8b-6dc38a4a75db None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:13.413289 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e193cbd-43ba-44c0-bee5-d6a0f3d4578e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:13.413987 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e193cbd-43ba-44c0-bee5-d6a0f3d4578e None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:13.414354 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e193cbd-43ba-44c0-bee5-d6a0f3d4578e None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:13.414670 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e193cbd-43ba-44c0-bee5-d6a0f3d4578e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:13.482134 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e193cbd-43ba-44c0-bee5-d6a0f3d4578e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:13.483520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e193cbd-43ba-44c0-bee5-d6a0f3d4578e None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:13.582706 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 146/292] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:20:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:20:13.588691 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb0fa0-750c-47c4-98a9-162e0c1b41e1 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:13.690958 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb0fa0-750c-47c4-98a9-162e0c1b41e1 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:13.724923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6150524-c7fa-4a76-9d34-c454b778c872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:13.725800 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6150524-c7fa-4a76-9d34-c454b778c872 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:13.726106 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6150524-c7fa-4a76-9d34-c454b778c872 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:13.726380 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6150524-c7fa-4a76-9d34-c454b778c872 None admin] PATH_INFO: `/v3/projects/9d1d4b4ef82c4618beda78779862fc08` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:13.727568 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6150524-c7fa-4a76-9d34-c454b778c872 None admin] RBAC: Authorizing `identity:get_project(project_id=9d1d4b4ef82c4618beda78779862fc08)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:13.729017 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6150524-c7fa-4a76-9d34-c454b778c872 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:13.730725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 147/293] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:20:13 2022] GET /identity/v3/projects/9d1d4b4ef82c4618beda78779862fc08 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:13.736627 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e193cbd-43ba-44c0-bee5-d6a0f3d4578e None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:13.837333 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e193cbd-43ba-44c0-bee5-d6a0f3d4578e None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:13.872565 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973eba0d-29a1-4a1b-a932-32d22646ff62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:13.873218 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973eba0d-29a1-4a1b-a932-32d22646ff62 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:13.873499 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973eba0d-29a1-4a1b-a932-32d22646ff62 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:13.873769 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973eba0d-29a1-4a1b-a932-32d22646ff62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:13.874611 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973eba0d-29a1-4a1b-a932-32d22646ff62 None admin] RBAC: Adding query filter params (role.id=31076ec4ad6a42868d212118fe129d18, scope.project.id=9d1d4b4ef82c4618beda78779862fc08, user.id=628196b943e84b90b05133db3166a043) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:13.874919 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973eba0d-29a1-4a1b-a932-32d22646ff62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:13.876321 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973eba0d-29a1-4a1b-a932-32d22646ff62 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:13.882591 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 147/294] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:20:13 2022] GET /identity/v3/role_assignments?user.id=628196b943e84b90b05133db3166a043&scope.project.id=9d1d4b4ef82c4618beda78779862fc08&role.id=31076ec4ad6a42868d212118fe129d18 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:14.238075 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737d835-84f4-40e1-8db1-c06d40dd18fc None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:14.239097 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737d835-84f4-40e1-8db1-c06d40dd18fc None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:14.239600 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737d835-84f4-40e1-8db1-c06d40dd18fc None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:14.241399 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 148/295] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:14.248456 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999a874-f1f2-458f-b2db-f1c12627c289 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:14.249333 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999a874-f1f2-458f-b2db-f1c12627c289 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:14.249806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999a874-f1f2-458f-b2db-f1c12627c289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:14.267655 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-1999a874-f1f2-458f-b2db-f1c12627c289 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:14.269154 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-1999a874-f1f2-458f-b2db-f1c12627c289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:14.336244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 148/296] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:20:14.359129 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737d835-84f4-40e1-8db1-c06d40dd18fc None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:14.478981 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737d835-84f4-40e1-8db1-c06d40dd18fc None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:14.518955 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e981dfe-e870-46fe-958c-1ccff0ac4e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:14.519757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e981dfe-e870-46fe-958c-1ccff0ac4e93 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:14.520035 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e981dfe-e870-46fe-958c-1ccff0ac4e93 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:14.520306 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e981dfe-e870-46fe-958c-1ccff0ac4e93 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:14.530837 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e981dfe-e870-46fe-958c-1ccff0ac4e93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:14.538786 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-7e981dfe-e870-46fe-958c-1ccff0ac4e93 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 09:20:14.538786 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:14.538786 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:14.538786 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:14.538786 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:14.538786 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:14.538786 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:14.538786 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:14.538786 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:14.538786 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:14.538786 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:14.538786 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:14.538786 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:14.538786 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:14.538786 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:14.538786 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:14.539721 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:14.539721 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:14.539721 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:14.539721 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:14.539721 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:14.539721 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:14.539721 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:14.539721 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:14.539721 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:14.539721 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:14.539721 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:14.539721 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:14.539721 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:14.539721 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:14.539721 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:14.539721 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:14.540540 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:14.540540 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:14.540540 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:14.540540 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:14.540540 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:14.540540 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:14.540540 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:14.540540 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:14.540540 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:14.540540 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:14.540540 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 09:20:14.540540 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:14.540540 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 149/297] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:20:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:14.549352 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999a874-f1f2-458f-b2db-f1c12627c289 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:14.618672 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1df34-1fc1-4462-9a0d-e6c581cdd816 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:14.618860 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1df34-1fc1-4462-9a0d-e6c581cdd816 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:14.619136 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1df34-1fc1-4462-9a0d-e6c581cdd816 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:14.620568 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 150/298] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:20:14.625928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e11610-0ee2-4c49-820b-c3a54f95703e None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:14.626450 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e11610-0ee2-4c49-820b-c3a54f95703e None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:14.626919 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e11610-0ee2-4c49-820b-c3a54f95703e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:14.644579 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-c8e11610-0ee2-4c49-820b-c3a54f95703e None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:14.646126 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-c8e11610-0ee2-4c49-820b-c3a54f95703e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:14.655778 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999a874-f1f2-458f-b2db-f1c12627c289 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:14.698179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a955cc2-e2ae-42bf-af21-ceda9c05616b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:14.698852 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a955cc2-e2ae-42bf-af21-ceda9c05616b None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:14.699184 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a955cc2-e2ae-42bf-af21-ceda9c05616b None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:14.699438 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a955cc2-e2ae-42bf-af21-ceda9c05616b None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:14.700850 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a955cc2-e2ae-42bf-af21-ceda9c05616b None admin] RBAC: Adding query filter params (name=reader) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:14.701158 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a955cc2-e2ae-42bf-af21-ceda9c05616b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:14.702556 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a955cc2-e2ae-42bf-af21-ceda9c05616b None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:14.713289 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 149/299] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 12 09:20:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:14.719302 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a955cc2-e2ae-42bf-af21-ceda9c05616b None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:14.727315 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 151/300] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:20:14.749497 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e11610-0ee2-4c49-820b-c3a54f95703e None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:14.828162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a955cc2-e2ae-42bf-af21-ceda9c05616b None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:14.850880 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e11610-0ee2-4c49-820b-c3a54f95703e None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:14.861793 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532359e-9ef1-4b97-9f2b-c4d0bdd15c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:14.862867 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532359e-9ef1-4b97-9f2b-c4d0bdd15c1d None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:14.863310 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532359e-9ef1-4b97-9f2b-c4d0bdd15c1d None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:14.863578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532359e-9ef1-4b97-9f2b-c4d0bdd15c1d None admin] PATH_INFO: `/v3/users/86593feb3736493fbddd202b7119cca4` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:14.877378 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e532359e-9ef1-4b97-9f2b-c4d0bdd15c1d None admin] RBAC: Authorizing `identity:get_user(user_id=86593feb3736493fbddd202b7119cca4)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:14.878800 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e532359e-9ef1-4b97-9f2b-c4d0bdd15c1d None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:14.880931 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 150/301] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:20:14 2022] GET /identity/v3/users/86593feb3736493fbddd202b7119cca4 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:14.886058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625be5ab-ecba-41e0-bc41-02dafb0c08d9 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:14.886058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625be5ab-ecba-41e0-bc41-02dafb0c08d9 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:14.886058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625be5ab-ecba-41e0-bc41-02dafb0c08d9 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:14.886058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 151/302] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:14.886706 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625be5ab-ecba-41e0-bc41-02dafb0c08d9 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:14.893241 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd6347-325a-423c-bac4-6b44a92f4446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:14.894176 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd6347-325a-423c-bac4-6b44a92f4446 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:14.894454 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd6347-325a-423c-bac4-6b44a92f4446 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:14.894753 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd6347-325a-423c-bac4-6b44a92f4446 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:14.897669 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd6347-325a-423c-bac4-6b44a92f4446 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:14.900153 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd6347-325a-423c-bac4-6b44a92f4446 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:14.903037 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 152/303] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:14.910010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f8204-aef6-4159-baf9-c0f786ecedfc None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:14.910010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f8204-aef6-4159-baf9-c0f786ecedfc None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:14.910010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f8204-aef6-4159-baf9-c0f786ecedfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:14.932052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-ef9f8204-aef6-4159-baf9-c0f786ecedfc None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:14.934458 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-ef9f8204-aef6-4159-baf9-c0f786ecedfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:15.023530 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 153/304] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:15.024159 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f8204-aef6-4159-baf9-c0f786ecedfc None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:15.041358 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625be5ab-ecba-41e0-bc41-02dafb0c08d9 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:15.073108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c0dcf-29fd-439d-8c5b-d4b28465075a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:15.073766 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c0dcf-29fd-439d-8c5b-d4b28465075a None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:15.074080 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c0dcf-29fd-439d-8c5b-d4b28465075a None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:15.074351 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c0dcf-29fd-439d-8c5b-d4b28465075a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:15.075747 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c0dcf-29fd-439d-8c5b-d4b28465075a None admin] RBAC: Adding query filter params (role.id=62c060ea2ced4eb49bf035f7139ba8ea, user.id=86593feb3736493fbddd202b7119cca4, scope.system=all) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:15.076053 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c0dcf-29fd-439d-8c5b-d4b28465075a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:15.077475 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c0dcf-29fd-439d-8c5b-d4b28465075a None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:15.089938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 152/305] 10.222.0.60 () {56 vars in 1308 bytes} [Thu May 12 09:20:14 2022] GET /identity/v3/role_assignments?user.id=86593feb3736493fbddd202b7119cca4&scope.system=all&role.id=62c060ea2ced4eb49bf035f7139ba8ea => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:15.089938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c0dcf-29fd-439d-8c5b-d4b28465075a None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:15.147400 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f8204-aef6-4159-baf9-c0f786ecedfc None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:15.196902 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d360736-e663-45bf-8091-c1c1a99e98fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:15.197601 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d360736-e663-45bf-8091-c1c1a99e98fc None admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:15.197885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d360736-e663-45bf-8091-c1c1a99e98fc None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:15.198193 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d360736-e663-45bf-8091-c1c1a99e98fc None admin] PATH_INFO: `/v3/groups` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:15.198899 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d360736-e663-45bf-8091-c1c1a99e98fc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:15.201144 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d360736-e663-45bf-8091-c1c1a99e98fc None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:15.212164 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c0dcf-29fd-439d-8c5b-d4b28465075a None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:15.219730 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 154/306] 10.222.0.60 () {60 vars in 1134 bytes} [Thu May 12 09:20:15 2022] POST /identity/v3/groups => generated 229 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:20:15.256133 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c685adc-a527-43e1-9e86-548894d19dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:15.256967 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c685adc-a527-43e1-9e86-548894d19dc5 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:15.257246 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c685adc-a527-43e1-9e86-548894d19dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:15.257520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c685adc-a527-43e1-9e86-548894d19dc5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:15.271023 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c685adc-a527-43e1-9e86-548894d19dc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:15.279395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-9c685adc-a527-43e1-9e86-548894d19dc5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 09:20:15.279395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:15.279395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:15.279395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:15.279395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:15.279395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:15.279395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:15.279395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:15.279395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:15.279395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:15.279395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:15.279395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:15.279395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:15.279395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:15.279395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:15.279395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:15.280387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:15.280387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:15.280387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:15.280387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:15.280387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:15.280387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:15.280387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:15.280387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:15.280387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:15.280387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:15.280387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:15.280387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:15.280387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:15.280387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:15.280387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:15.280387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:15.281832 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:15.281832 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:15.281832 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:15.281832 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:15.281832 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:15.281832 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:15.281832 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:15.281832 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:15.281832 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:15.281832 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:15.281832 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 09:20:15.281832 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:15.281832 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 153/307] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:20:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:15.288849 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d360736-e663-45bf-8091-c1c1a99e98fc None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:15.352484 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e81d1e-dc2e-447e-9b85-a23864b2d563 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:15.352831 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e81d1e-dc2e-447e-9b85-a23864b2d563 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:15.353110 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e81d1e-dc2e-447e-9b85-a23864b2d563 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:15.354837 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 154/308] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:20:15.361206 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017384b-c7e0-4cae-9af8-c4b5ec459b3a None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:15.361534 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017384b-c7e0-4cae-9af8-c4b5ec459b3a None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:15.361762 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017384b-c7e0-4cae-9af8-c4b5ec459b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:15.380478 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-1017384b-c7e0-4cae-9af8-c4b5ec459b3a None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:15.381673 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-1017384b-c7e0-4cae-9af8-c4b5ec459b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:15.416365 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d360736-e663-45bf-8091-c1c1a99e98fc None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:15.457793 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301a7a2-f1c6-4c4c-8fb6-f11baf40862a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:15.458495 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301a7a2-f1c6-4c4c-8fb6-f11baf40862a None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:15.458904 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301a7a2-f1c6-4c4c-8fb6-f11baf40862a None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:15.459820 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301a7a2-f1c6-4c4c-8fb6-f11baf40862a None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:15.459964 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301a7a2-f1c6-4c4c-8fb6-f11baf40862a None admin] RBAC: Adding query filter params (name=member) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:15.460157 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301a7a2-f1c6-4c4c-8fb6-f11baf40862a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:15.461766 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301a7a2-f1c6-4c4c-8fb6-f11baf40862a None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:15.461869 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 155/309] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:15.470904 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 155/310] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 12 09:20:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:15.475881 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017384b-c7e0-4cae-9af8-c4b5ec459b3a None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:15.486427 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301a7a2-f1c6-4c4c-8fb6-f11baf40862a None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:15.587831 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017384b-c7e0-4cae-9af8-c4b5ec459b3a None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:15.601960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301a7a2-f1c6-4c4c-8fb6-f11baf40862a None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:15.627699 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260971d-5e94-4062-bf86-cc2c40af9e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:15.628674 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260971d-5e94-4062-bf86-cc2c40af9e65 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:15.629044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260971d-5e94-4062-bf86-cc2c40af9e65 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:15.629384 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260971d-5e94-4062-bf86-cc2c40af9e65 None admin] PATH_INFO: `/v3/users/9ac9674375aa4de7ae45df80d36821cf` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:15.631338 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260971d-5e94-4062-bf86-cc2c40af9e65 None admin] RBAC: Authorizing `identity:get_user(user_id=9ac9674375aa4de7ae45df80d36821cf)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:15.632837 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260971d-5e94-4062-bf86-cc2c40af9e65 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:15.635136 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 156/311] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:20:15 2022] GET /identity/v3/users/9ac9674375aa4de7ae45df80d36821cf => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:15.642830 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260971d-5e94-4062-bf86-cc2c40af9e65 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:15.647064 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31128e-417a-4a44-b54c-255a882dc1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:15.648080 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31128e-417a-4a44-b54c-255a882dc1f6 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:15.648540 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31128e-417a-4a44-b54c-255a882dc1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:15.649013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31128e-417a-4a44-b54c-255a882dc1f6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:15.661768 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31128e-417a-4a44-b54c-255a882dc1f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:15.671730 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-4e31128e-417a-4a44-b54c-255a882dc1f6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 09:20:15.671730 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:15.671730 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:15.671730 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:15.671730 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:15.671730 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:15.671730 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:15.671730 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:15.671730 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:15.671730 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:15.671730 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:15.671730 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:15.671730 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:15.671730 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:15.671730 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:15.671730 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:15.672838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:15.672838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:15.672838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:15.672838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:15.672838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:15.672838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:15.672838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:15.672838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:15.672838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:15.672838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:15.672838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:15.672838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:15.672838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:15.672838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:15.672838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:15.672838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:15.673838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:15.673838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:15.673838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:15.673838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:15.673838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:15.673838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:15.673838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:15.673838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:15.673838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:15.673838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:15.673838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 09:20:15.673838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:15.676930 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 156/312] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:20:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:20:15.686023 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31128e-417a-4a44-b54c-255a882dc1f6 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:15.767518 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260971d-5e94-4062-bf86-cc2c40af9e65 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:15.784018 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31128e-417a-4a44-b54c-255a882dc1f6 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:15.808490 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471368f0-d992-4294-89ad-8a608697c5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:15.809528 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471368f0-d992-4294-89ad-8a608697c5e5 None admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:15.809877 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471368f0-d992-4294-89ad-8a608697c5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:15.810248 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471368f0-d992-4294-89ad-8a608697c5e5 None admin] PATH_INFO: `/v3/system/users/9ac9674375aa4de7ae45df80d36821cf/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:15.811813 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471368f0-d992-4294-89ad-8a608697c5e5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9ac9674375aa4de7ae45df80d36821cf, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:15.813257 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471368f0-d992-4294-89ad-8a608697c5e5 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:15.822436 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 157/313] 10.222.0.60 () {58 vars in 1334 bytes} [Thu May 12 09:20:15 2022] PUT /identity/v3/system/users/9ac9674375aa4de7ae45df80d36821cf/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:20:15.832255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840c942-ef77-4a13-b86a-5c23fe088d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:15.832957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840c942-ef77-4a13-b86a-5c23fe088d19 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:15.833290 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840c942-ef77-4a13-b86a-5c23fe088d19 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:15.833622 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840c942-ef77-4a13-b86a-5c23fe088d19 None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:15.834493 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5840c942-ef77-4a13-b86a-5c23fe088d19 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:15.834803 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5840c942-ef77-4a13-b86a-5c23fe088d19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:15.836297 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5840c942-ef77-4a13-b86a-5c23fe088d19 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:15.847794 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 157/314] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 12 09:20:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:15.853259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471368f0-d992-4294-89ad-8a608697c5e5 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:15.961987 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471368f0-d992-4294-89ad-8a608697c5e5 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:15.997914 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84b75f-0065-49b5-a823-eac931847f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:15.998959 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84b75f-0065-49b5-a823-eac931847f0d None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:15.999291 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84b75f-0065-49b5-a823-eac931847f0d None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:15.999567 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84b75f-0065-49b5-a823-eac931847f0d None admin] PATH_INFO: `/v3/users/0e4a7c457c544b68a914edd7b61c8e77` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:16.000822 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84b75f-0065-49b5-a823-eac931847f0d None admin] RBAC: Authorizing `identity:get_user(user_id=0e4a7c457c544b68a914edd7b61c8e77)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:16.002327 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84b75f-0065-49b5-a823-eac931847f0d None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:16.004293 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 158/315] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:20:15 2022] GET /identity/v3/users/0e4a7c457c544b68a914edd7b61c8e77 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:16.015102 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840c942-ef77-4a13-b86a-5c23fe088d19 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:16.122551 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840c942-ef77-4a13-b86a-5c23fe088d19 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:16.156244 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac09a2-e249-446a-bcc8-5192a58a325d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:16.156895 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac09a2-e249-446a-bcc8-5192a58a325d None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:16.157179 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac09a2-e249-446a-bcc8-5192a58a325d None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:16.157454 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac09a2-e249-446a-bcc8-5192a58a325d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:16.224468 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac09a2-e249-446a-bcc8-5192a58a325d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:16.225975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac09a2-e249-446a-bcc8-5192a58a325d None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:16.326355 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 158/316] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:20:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:20:16.332259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84b75f-0065-49b5-a823-eac931847f0d None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:16.438182 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84b75f-0065-49b5-a823-eac931847f0d None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:16.473309 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91694a-5c44-45cd-ae75-a1e3b80dc445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:16.474211 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91694a-5c44-45cd-ae75-a1e3b80dc445 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:16.474546 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91694a-5c44-45cd-ae75-a1e3b80dc445 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:16.474765 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91694a-5c44-45cd-ae75-a1e3b80dc445 None admin] PATH_INFO: `/v3/projects/9d1d4b4ef82c4618beda78779862fc08` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:16.475956 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91694a-5c44-45cd-ae75-a1e3b80dc445 None admin] RBAC: Authorizing `identity:get_project(project_id=9d1d4b4ef82c4618beda78779862fc08)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:16.477396 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91694a-5c44-45cd-ae75-a1e3b80dc445 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:16.479290 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 159/317] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:20:16 2022] GET /identity/v3/projects/9d1d4b4ef82c4618beda78779862fc08 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:16.484972 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac09a2-e249-446a-bcc8-5192a58a325d None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:16.582881 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac09a2-e249-446a-bcc8-5192a58a325d None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:16.618072 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b94ff-aff8-42fd-a625-0bb83e1df766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:16.618735 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b94ff-aff8-42fd-a625-0bb83e1df766 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:16.619015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b94ff-aff8-42fd-a625-0bb83e1df766 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:16.619287 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b94ff-aff8-42fd-a625-0bb83e1df766 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:16.620182 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b94ff-aff8-42fd-a625-0bb83e1df766 None admin] RBAC: Adding query filter params (role.id=62c060ea2ced4eb49bf035f7139ba8ea, scope.project.id=9d1d4b4ef82c4618beda78779862fc08, user.id=0e4a7c457c544b68a914edd7b61c8e77) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:16.620497 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b94ff-aff8-42fd-a625-0bb83e1df766 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:16.622011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b94ff-aff8-42fd-a625-0bb83e1df766 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:16.628592 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 159/318] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:20:16 2022] GET /identity/v3/role_assignments?user.id=0e4a7c457c544b68a914edd7b61c8e77&scope.project.id=9d1d4b4ef82c4618beda78779862fc08&role.id=62c060ea2ced4eb49bf035f7139ba8ea => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:17.369281 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824b9de-5f4b-45d2-aced-04906daab327 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:17.369789 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824b9de-5f4b-45d2-aced-04906daab327 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:17.369789 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824b9de-5f4b-45d2-aced-04906daab327 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:17.371264 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 160/319] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:17.376307 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb9420-ba1f-4227-9650-b57c07cfa343 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:17.376696 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb9420-ba1f-4227-9650-b57c07cfa343 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:17.376855 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb9420-ba1f-4227-9650-b57c07cfa343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:17.394376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-03fb9420-ba1f-4227-9650-b57c07cfa343 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:17.395597 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-03fb9420-ba1f-4227-9650-b57c07cfa343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:17.461856 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 160/320] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:17.484203 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824b9de-5f4b-45d2-aced-04906daab327 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:17.579861 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5d20f-5825-46ea-ac9d-00165cd7e9b3 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:17.580208 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5d20f-5825-46ea-ac9d-00165cd7e9b3 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:17.580309 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824b9de-5f4b-45d2-aced-04906daab327 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:17.580467 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5d20f-5825-46ea-ac9d-00165cd7e9b3 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:17.581885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 161/321] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:20:17.586594 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3bbe8-a2d3-41c1-bfee-8df9b29062e2 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:17.586874 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3bbe8-a2d3-41c1-bfee-8df9b29062e2 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:17.587140 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3bbe8-a2d3-41c1-bfee-8df9b29062e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:17.604064 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-1fe3bbe8-a2d3-41c1-bfee-8df9b29062e2 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:17.605496 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-1fe3bbe8-a2d3-41c1-bfee-8df9b29062e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:17.613868 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdf460-f481-4a49-8ccb-4f4bcaf211e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:17.614690 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdf460-f481-4a49-8ccb-4f4bcaf211e9 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:17.614970 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdf460-f481-4a49-8ccb-4f4bcaf211e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:17.615238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdf460-f481-4a49-8ccb-4f4bcaf211e9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:17.625403 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbdf460-f481-4a49-8ccb-4f4bcaf211e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:17.633244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-ddbdf460-f481-4a49-8ccb-4f4bcaf211e9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 09:20:17.633244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:17.633244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:17.633244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:17.633244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:17.633244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:17.633244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:17.633244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:17.633244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:17.633244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:17.633244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:17.633244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:17.633244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:17.633244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:17.633244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:17.633244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:17.634193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:17.634193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:17.634193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:17.634193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:17.634193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:17.634193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:17.634193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:17.634193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:17.634193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:17.634193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:17.634193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:17.634193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:17.634193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:17.634193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:17.634193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:17.634193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:17.635010 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:17.635010 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:17.635010 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:17.635010 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:17.635010 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:17.635010 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:17.635010 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:17.635010 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:17.635010 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:17.635010 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:17.635010 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 09:20:17.635010 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:17.635010 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 161/322] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:20:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:17.640429 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdf460-f481-4a49-8ccb-4f4bcaf211e9 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:17.674248 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 162/323] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:20:17.695905 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3bbe8-a2d3-41c1-bfee-8df9b29062e2 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:17.738374 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdf460-f481-4a49-8ccb-4f4bcaf211e9 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:17.771975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52101a0b-b0ef-4b29-acf3-2113b4df8e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:17.772920 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52101a0b-b0ef-4b29-acf3-2113b4df8e8c None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:17.773385 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52101a0b-b0ef-4b29-acf3-2113b4df8e8c None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:17.773728 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52101a0b-b0ef-4b29-acf3-2113b4df8e8c None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:17.774954 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52101a0b-b0ef-4b29-acf3-2113b4df8e8c None admin] RBAC: Adding query filter params (name=reader) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:17.774954 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52101a0b-b0ef-4b29-acf3-2113b4df8e8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:17.777329 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52101a0b-b0ef-4b29-acf3-2113b4df8e8c None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:17.790274 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 162/324] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 12 09:20:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:17.791264 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52101a0b-b0ef-4b29-acf3-2113b4df8e8c None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:17.795632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3bbe8-a2d3-41c1-bfee-8df9b29062e2 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:17.827590 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b13e1-cf2c-4ec7-8996-d9c4ed60e9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:17.828371 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b13e1-cf2c-4ec7-8996-d9c4ed60e9ab None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:17.828646 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b13e1-cf2c-4ec7-8996-d9c4ed60e9ab None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:17.828914 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b13e1-cf2c-4ec7-8996-d9c4ed60e9ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:17.830100 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b13e1-cf2c-4ec7-8996-d9c4ed60e9ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:17.831534 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b13e1-cf2c-4ec7-8996-d9c4ed60e9ab None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:17.833285 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 163/325] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:17.838785 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b13e1-cf2c-4ec7-8996-d9c4ed60e9ab None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:17.890749 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52101a0b-b0ef-4b29-acf3-2113b4df8e8c None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:17.928747 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966b010-0a35-419c-8adf-f344565ad3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:17.929655 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966b010-0a35-419c-8adf-f344565ad3d9 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:17.929976 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966b010-0a35-419c-8adf-f344565ad3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:17.930236 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966b010-0a35-419c-8adf-f344565ad3d9 None admin] PATH_INFO: `/v3/users/86593feb3736493fbddd202b7119cca4` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:17.931547 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966b010-0a35-419c-8adf-f344565ad3d9 None admin] RBAC: Authorizing `identity:get_user(user_id=86593feb3736493fbddd202b7119cca4)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:17.933018 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966b010-0a35-419c-8adf-f344565ad3d9 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:17.935294 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 163/326] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:20:17 2022] GET /identity/v3/users/86593feb3736493fbddd202b7119cca4 => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:17.941063 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966b010-0a35-419c-8adf-f344565ad3d9 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:17.944760 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b13e1-cf2c-4ec7-8996-d9c4ed60e9ab None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:17.980157 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1aef64-9eab-444f-b3cc-c1c731352c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:17.980888 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1aef64-9eab-444f-b3cc-c1c731352c19 None admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:17.981175 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1aef64-9eab-444f-b3cc-c1c731352c19 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:17.981446 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1aef64-9eab-444f-b3cc-c1c731352c19 None admin] PATH_INFO: `/v3/groups` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:17.982163 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1aef64-9eab-444f-b3cc-c1c731352c19 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:17.983606 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1aef64-9eab-444f-b3cc-c1c731352c19 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:18.009928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 164/327] 10.222.0.60 () {60 vars in 1134 bytes} [Thu May 12 09:20:17 2022] POST /identity/v3/groups => generated 226 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:20:18.058376 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966b010-0a35-419c-8adf-f344565ad3d9 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:18.100257 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40bab8-700e-4b5e-98b5-d652be278dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:18.101436 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40bab8-700e-4b5e-98b5-d652be278dcd None admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:18.102016 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40bab8-700e-4b5e-98b5-d652be278dcd None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:18.102450 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40bab8-700e-4b5e-98b5-d652be278dcd None admin] PATH_INFO: `/v3/system/users/86593feb3736493fbddd202b7119cca4/roles/62c060ea2ced4eb49bf035f7139ba8ea` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:18.104186 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40bab8-700e-4b5e-98b5-d652be278dcd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=86593feb3736493fbddd202b7119cca4, role_id=62c060ea2ced4eb49bf035f7139ba8ea)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:18.105556 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40bab8-700e-4b5e-98b5-d652be278dcd None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:18.114307 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 164/328] 10.222.0.60 () {58 vars in 1334 bytes} [Thu May 12 09:20:17 2022] PUT /identity/v3/system/users/86593feb3736493fbddd202b7119cca4/roles/62c060ea2ced4eb49bf035f7139ba8ea => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:20:18.154052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cefd9-a76f-4514-a5b8-bc42dd0c2253 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:18.154052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cefd9-a76f-4514-a5b8-bc42dd0c2253 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:18.154052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cefd9-a76f-4514-a5b8-bc42dd0c2253 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:18.154052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 165/329] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:18.156596 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6a1d1-0f1f-4130-a413-992ea332786b None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:18.156885 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6a1d1-0f1f-4130-a413-992ea332786b None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:18.157159 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6a1d1-0f1f-4130-a413-992ea332786b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:18.174793 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-79c6a1d1-0f1f-4130-a413-992ea332786b None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:18.176028 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-79c6a1d1-0f1f-4130-a413-992ea332786b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:18.249668 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 165/330] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:18.273661 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811cefd9-a76f-4514-a5b8-bc42dd0c2253 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:18.383238 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811cefd9-a76f-4514-a5b8-bc42dd0c2253 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:18.416888 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6682547-1316-4628-bbb5-3f7e373fa916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:18.417612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6682547-1316-4628-bbb5-3f7e373fa916 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:18.417887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6682547-1316-4628-bbb5-3f7e373fa916 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:18.418183 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6682547-1316-4628-bbb5-3f7e373fa916 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:18.429145 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6682547-1316-4628-bbb5-3f7e373fa916 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:18.437732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-a6682547-1316-4628-bbb5-3f7e373fa916 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 09:20:18.437732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:18.437732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:18.437732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:18.437732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:18.437732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:18.437732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:18.437732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:18.437732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:18.437732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:18.437732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:18.437732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:18.437732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:18.437732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:18.437732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:18.437732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:18.438684 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:18.438684 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:18.438684 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:18.438684 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:18.438684 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:18.438684 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:18.438684 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:18.438684 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:18.438684 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:18.438684 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:18.438684 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:18.438684 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:18.438684 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:18.438684 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:18.438684 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:18.438684 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:18.439491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:18.439491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:18.439491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:18.439491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:18.439491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:18.439491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:18.439491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:18.439491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:18.439491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:18.439491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:18.439491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 09:20:18.439491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:18.439491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 166/331] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:20:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:18.444897 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6a1d1-0f1f-4130-a413-992ea332786b None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:18.548493 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6a1d1-0f1f-4130-a413-992ea332786b None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:18.583117 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9040c-5e80-4c75-a7f0-90f350e1d972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:18.584076 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9040c-5e80-4c75-a7f0-90f350e1d972 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:18.584529 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9040c-5e80-4c75-a7f0-90f350e1d972 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:18.585000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9040c-5e80-4c75-a7f0-90f350e1d972 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:18.585932 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9040c-5e80-4c75-a7f0-90f350e1d972 None admin] RBAC: Adding query filter params (name=member) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:18.586410 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9040c-5e80-4c75-a7f0-90f350e1d972 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:18.587946 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9040c-5e80-4c75-a7f0-90f350e1d972 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:18.599309 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 166/332] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 12 09:20:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:18.605139 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6682547-1316-4628-bbb5-3f7e373fa916 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:18.714503 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6682547-1316-4628-bbb5-3f7e373fa916 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:18.763471 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b4c4a-303f-42d1-82d5-bca8f7ad22ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:18.764672 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b4c4a-303f-42d1-82d5-bca8f7ad22ce None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:18.765126 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b4c4a-303f-42d1-82d5-bca8f7ad22ce None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:18.765596 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b4c4a-303f-42d1-82d5-bca8f7ad22ce None admin] PATH_INFO: `/v3/users/9ac9674375aa4de7ae45df80d36821cf` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:18.767032 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b4c4a-303f-42d1-82d5-bca8f7ad22ce None admin] RBAC: Authorizing `identity:get_user(user_id=9ac9674375aa4de7ae45df80d36821cf)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:18.768647 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b4c4a-303f-42d1-82d5-bca8f7ad22ce None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:18.770740 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 167/333] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:20:18 2022] GET /identity/v3/users/9ac9674375aa4de7ae45df80d36821cf => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:18.776664 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9040c-5e80-4c75-a7f0-90f350e1d972 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:18.887442 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9040c-5e80-4c75-a7f0-90f350e1d972 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:18.929090 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c7fb2-1cf8-4822-b840-16b317fe86e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:18.929774 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c7fb2-1cf8-4822-b840-16b317fe86e0 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:18.930091 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c7fb2-1cf8-4822-b840-16b317fe86e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:18.930367 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c7fb2-1cf8-4822-b840-16b317fe86e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:18.931206 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c7fb2-1cf8-4822-b840-16b317fe86e0 None admin] RBAC: Adding query filter params (role.id=31076ec4ad6a42868d212118fe129d18, user.id=9ac9674375aa4de7ae45df80d36821cf, scope.system=all) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:18.931520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c7fb2-1cf8-4822-b840-16b317fe86e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:18.932952 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c7fb2-1cf8-4822-b840-16b317fe86e0 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:18.946595 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 167/334] 10.222.0.60 () {56 vars in 1308 bytes} [Thu May 12 09:20:18 2022] GET /identity/v3/role_assignments?user.id=9ac9674375aa4de7ae45df80d36821cf&scope.system=all&role.id=31076ec4ad6a42868d212118fe129d18 => generated 510 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:20.567860 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98745f4-aa66-4aba-9691-cde3ec4e18c7 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:20.568828 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98745f4-aa66-4aba-9691-cde3ec4e18c7 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:20.569307 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98745f4-aa66-4aba-9691-cde3ec4e18c7 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:20.570903 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 168/335] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:20.571396 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0d07b-f68f-4662-9c25-609d6bd743e3 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:20.571804 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0d07b-f68f-4662-9c25-609d6bd743e3 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:20.571961 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0d07b-f68f-4662-9c25-609d6bd743e3 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:20.573608 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 168/336] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:20.576751 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca0630-09aa-4f03-a4f6-56a18866ab96 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:20.577245 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca0630-09aa-4f03-a4f6-56a18866ab96 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:20.577728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca0630-09aa-4f03-a4f6-56a18866ab96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:20.588234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442914f-ddc3-4c39-aada-11b754563cf4 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:20.588520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442914f-ddc3-4c39-aada-11b754563cf4 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:20.588797 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442914f-ddc3-4c39-aada-11b754563cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:20.599131 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-2dca0630-09aa-4f03-a4f6-56a18866ab96 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:20.600615 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-2dca0630-09aa-4f03-a4f6-56a18866ab96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:20.616093 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-5442914f-ddc3-4c39-aada-11b754563cf4 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:20.616702 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-5442914f-ddc3-4c39-aada-11b754563cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:20.716917 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 169/337] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:20:20.721294 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 169/338] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:20.765944 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442914f-ddc3-4c39-aada-11b754563cf4 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:20.767204 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca0630-09aa-4f03-a4f6-56a18866ab96 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:20.877864 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442914f-ddc3-4c39-aada-11b754563cf4 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:20.914278 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a8cc2-aca0-446c-a320-25b855be22fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:20.915082 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a8cc2-aca0-446c-a320-25b855be22fa None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:20.915362 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a8cc2-aca0-446c-a320-25b855be22fa None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:20.915635 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a8cc2-aca0-446c-a320-25b855be22fa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:20.930507 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a8cc2-aca0-446c-a320-25b855be22fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:20.938861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-1c7a8cc2-aca0-446c-a320-25b855be22fa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 09:20:20.938861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:20.938861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:20.938861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:20.938861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:20.938861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:20.938861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:20.938861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:20.938861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:20.938861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:20.938861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:20.938861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:20.938861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:20.938861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:20.938861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:20.938861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:20.939817 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:20.939817 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:20.939817 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:20.939817 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:20.939817 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:20.939817 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:20.939817 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:20.939817 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:20.939817 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:20.939817 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:20.939817 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:20.939817 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:20.939817 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:20.939817 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:20.939817 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:20.939817 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:20.940653 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:20.940653 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:20.940653 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:20.940653 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:20.940653 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:20.940653 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:20.940653 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:20.940653 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:20.940653 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:20.940653 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:20.940653 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 09:20:20.940653 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:20.946840 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 170/339] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:20:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:20.953604 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca0630-09aa-4f03-a4f6-56a18866ab96 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:20.955323 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a8cc2-aca0-446c-a320-25b855be22fa None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:21.027708 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d869bb-409a-49b2-81e4-c3dfa7a71b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:21.028590 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d869bb-409a-49b2-81e4-c3dfa7a71b56 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:21.029015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d869bb-409a-49b2-81e4-c3dfa7a71b56 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:21.029319 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d869bb-409a-49b2-81e4-c3dfa7a71b56 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:21.049816 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d869bb-409a-49b2-81e4-c3dfa7a71b56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:21.069081 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-92d869bb-409a-49b2-81e4-c3dfa7a71b56 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 09:20:21.069081 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:21.069081 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:21.069081 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:21.069081 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:21.069081 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:21.069081 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:21.069081 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:21.069081 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:21.069081 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:21.069081 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:21.069081 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:21.069081 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:21.069081 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:21.069081 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:21.069081 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:21.070115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:21.070115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:21.070115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:21.070115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:21.070115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:21.070115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:21.070115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:21.070115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:21.070115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:21.070115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:21.070115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:21.070115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:21.070115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:21.070115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:21.070115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:21.070115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:21.070937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:21.070937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:21.070937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:21.070937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:21.070937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:21.070937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:21.070937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:21.070937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:21.070937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:21.070937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:21.070937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 09:20:21.070937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:21.070937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 170/340] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:20:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:21.076822 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d869bb-409a-49b2-81e4-c3dfa7a71b56 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:21.155807 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a8cc2-aca0-446c-a320-25b855be22fa None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:21.191753 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9cd19b-e596-4055-b8ce-9dae4275b636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:21.192859 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cd19b-e596-4055-b8ce-9dae4275b636 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:21.193123 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cd19b-e596-4055-b8ce-9dae4275b636 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:21.193573 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cd19b-e596-4055-b8ce-9dae4275b636 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:21.194820 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9cd19b-e596-4055-b8ce-9dae4275b636 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:21.195282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9cd19b-e596-4055-b8ce-9dae4275b636 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:21.197651 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9cd19b-e596-4055-b8ce-9dae4275b636 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:21.213618 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 171/341] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 12 09:20:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:21.216014 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9cd19b-e596-4055-b8ce-9dae4275b636 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:21.283258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d869bb-409a-49b2-81e4-c3dfa7a71b56 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:21.337928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9dd95-0465-4641-9424-521889a6c1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:21.339139 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9dd95-0465-4641-9424-521889a6c1e4 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:21.339739 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9dd95-0465-4641-9424-521889a6c1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:21.340303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9dd95-0465-4641-9424-521889a6c1e4 None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:21.341769 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9dd95-0465-4641-9424-521889a6c1e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:21.342617 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9dd95-0465-4641-9424-521889a6c1e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:21.346464 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9dd95-0465-4641-9424-521889a6c1e4 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:21.360741 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 171/342] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 12 09:20:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:21.366525 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9dd95-0465-4641-9424-521889a6c1e4 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:21.445759 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9cd19b-e596-4055-b8ce-9dae4275b636 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:21.510625 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4f6c4-52b0-482b-958a-fb42162cfc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:21.512450 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4f6c4-52b0-482b-958a-fb42162cfc7c None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:21.512931 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4f6c4-52b0-482b-958a-fb42162cfc7c None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:21.513410 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4f6c4-52b0-482b-958a-fb42162cfc7c None admin] PATH_INFO: `/v3/users/86593feb3736493fbddd202b7119cca4` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:21.514951 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4f6c4-52b0-482b-958a-fb42162cfc7c None admin] RBAC: Authorizing `identity:get_user(user_id=86593feb3736493fbddd202b7119cca4)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:21.516614 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4f6c4-52b0-482b-958a-fb42162cfc7c None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:21.518522 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 172/343] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:20:21 2022] GET /identity/v3/users/86593feb3736493fbddd202b7119cca4 => generated 293 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:21.519986 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0262e-da1b-4d4d-8f37-ced3f3c231a6 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:21.520476 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0262e-da1b-4d4d-8f37-ced3f3c231a6 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:21.520954 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0262e-da1b-4d4d-8f37-ced3f3c231a6 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:21.522386 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 173/344] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:21.528432 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823cdc2-eb0d-420e-a483-a08697fa587c None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:21.528956 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823cdc2-eb0d-420e-a483-a08697fa587c None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:21.529436 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823cdc2-eb0d-420e-a483-a08697fa587c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:21.533490 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9dd95-0465-4641-9424-521889a6c1e4 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:21.551815 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-8823cdc2-eb0d-420e-a483-a08697fa587c None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:21.553398 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-8823cdc2-eb0d-420e-a483-a08697fa587c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:21.579227 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01681a73-a899-47fe-b42d-7e18ca21f4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:21.579982 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01681a73-a899-47fe-b42d-7e18ca21f4f7 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:21.580127 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01681a73-a899-47fe-b42d-7e18ca21f4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:21.580465 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01681a73-a899-47fe-b42d-7e18ca21f4f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:21.636333 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 174/345] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:20:21.637800 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823cdc2-eb0d-420e-a483-a08697fa587c None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:21.658921 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01681a73-a899-47fe-b42d-7e18ca21f4f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:21.663299 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01681a73-a899-47fe-b42d-7e18ca21f4f7 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:21.776540 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823cdc2-eb0d-420e-a483-a08697fa587c None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:21.786772 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 172/346] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:20:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:20:21.788298 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01681a73-a899-47fe-b42d-7e18ca21f4f7 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:21.819206 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5c4bf-79f1-4da8-939c-dfc423502aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:21.820237 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5c4bf-79f1-4da8-939c-dfc423502aa8 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:21.820722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5c4bf-79f1-4da8-939c-dfc423502aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:21.821228 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5c4bf-79f1-4da8-939c-dfc423502aa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:21.822468 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5c4bf-79f1-4da8-939c-dfc423502aa8 None admin] RBAC: Adding query filter params (role.id=62c060ea2ced4eb49bf035f7139ba8ea, user.id=86593feb3736493fbddd202b7119cca4, scope.system=all) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:21.823067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5c4bf-79f1-4da8-939c-dfc423502aa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:21.825303 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5c4bf-79f1-4da8-939c-dfc423502aa8 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:21.839325 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 175/347] 10.222.0.60 () {56 vars in 1308 bytes} [Thu May 12 09:20:21 2022] GET /identity/v3/role_assignments?user.id=86593feb3736493fbddd202b7119cca4&scope.system=all&role.id=62c060ea2ced4eb49bf035f7139ba8ea => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:21.841205 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5c4bf-79f1-4da8-939c-dfc423502aa8 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:21.903757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01681a73-a899-47fe-b42d-7e18ca21f4f7 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:21.942700 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c342e77-a1b4-42fc-8125-24804ff88898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:21.943458 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c342e77-a1b4-42fc-8125-24804ff88898 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:21.943744 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c342e77-a1b4-42fc-8125-24804ff88898 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:21.944019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c342e77-a1b4-42fc-8125-24804ff88898 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:21.959816 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c342e77-a1b4-42fc-8125-24804ff88898 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:21.961469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5c4bf-79f1-4da8-939c-dfc423502aa8 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:21.968376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-5c342e77-a1b4-42fc-8125-24804ff88898 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 09:20:21.968376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:21.968376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:21.968376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:21.968376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:21.968376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:21.968376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:21.968376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:21.968376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:21.968376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:21.968376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:21.968376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:21.968376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:21.968376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:21.968376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:21.968376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:21.969529 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:21.969529 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:21.969529 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:21.969529 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:21.969529 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:21.969529 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:21.969529 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:21.969529 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:21.969529 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:21.969529 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:21.969529 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:21.969529 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:21.969529 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:21.969529 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:21.969529 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:21.969529 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:21.971699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:21.971699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:21.971699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:21.971699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:21.971699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:21.971699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:21.971699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:21.971699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:21.971699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:21.971699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:21.971699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 09:20:21.971699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:21.971699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 173/348] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 12 09:20:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:21.976558 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c342e77-a1b4-42fc-8125-24804ff88898 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:22.037677 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3744fbc-ed1d-4096-a6e6-048c886c8151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:22.038513 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3744fbc-ed1d-4096-a6e6-048c886c8151 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:22.038793 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3744fbc-ed1d-4096-a6e6-048c886c8151 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:22.039068 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3744fbc-ed1d-4096-a6e6-048c886c8151 None admin] PATH_INFO: `/v3/projects/43f5db26667c4824b9e1f2363e88395d` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:22.040713 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3744fbc-ed1d-4096-a6e6-048c886c8151 None admin] RBAC: Authorizing `identity:get_project(project_id=43f5db26667c4824b9e1f2363e88395d)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:22.042209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3744fbc-ed1d-4096-a6e6-048c886c8151 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:22.047021 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 176/349] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:20:21 2022] GET /identity/v3/projects/43f5db26667c4824b9e1f2363e88395d => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:22.054186 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3744fbc-ed1d-4096-a6e6-048c886c8151 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:22.147694 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c342e77-a1b4-42fc-8125-24804ff88898 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:22.198139 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f9b90-ab6e-41ba-959f-c1b0428cdc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:22.199257 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f9b90-ab6e-41ba-959f-c1b0428cdc6a None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:22.199789 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f9b90-ab6e-41ba-959f-c1b0428cdc6a None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:22.200286 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f9b90-ab6e-41ba-959f-c1b0428cdc6a None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:22.201274 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f9b90-ab6e-41ba-959f-c1b0428cdc6a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:22.202966 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f9b90-ab6e-41ba-959f-c1b0428cdc6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:22.204613 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f9b90-ab6e-41ba-959f-c1b0428cdc6a None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:22.236164 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 174/350] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:20:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:22.247587 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f9b90-ab6e-41ba-959f-c1b0428cdc6a None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:22.275975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3744fbc-ed1d-4096-a6e6-048c886c8151 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:22.368207 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7dca4-2e9a-4c52-812a-1c8f205c7fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:22.369020 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7dca4-2e9a-4c52-812a-1c8f205c7fd9 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:22.369684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7dca4-2e9a-4c52-812a-1c8f205c7fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:22.369684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7dca4-2e9a-4c52-812a-1c8f205c7fd9 None admin] PATH_INFO: `/v3/groups/2cb8aebaaa21420ea37fb2c6cbfe5ba5` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:22.382169 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7dca4-2e9a-4c52-812a-1c8f205c7fd9 None admin] RBAC: Authorizing `identity:get_group(group_id=2cb8aebaaa21420ea37fb2c6cbfe5ba5)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:22.383652 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7dca4-2e9a-4c52-812a-1c8f205c7fd9 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:22.385503 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 177/351] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 12 09:20:22 2022] GET /identity/v3/groups/2cb8aebaaa21420ea37fb2c6cbfe5ba5 => generated 226 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:22.386931 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f0354-eaa3-4c3c-a2aa-a3be4b154b55 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:22.387217 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f0354-eaa3-4c3c-a2aa-a3be4b154b55 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:22.387493 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f0354-eaa3-4c3c-a2aa-a3be4b154b55 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:22.389793 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 178/352] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:22.395329 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f0354-eaa3-4c3c-a2aa-a3be4b154b55 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:22.396918 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f9b90-ab6e-41ba-959f-c1b0428cdc6a None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:22.442128 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730dc5a-aee3-4afd-9cd7-acdf8d524929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:22.442778 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730dc5a-aee3-4afd-9cd7-acdf8d524929 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:22.443100 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730dc5a-aee3-4afd-9cd7-acdf8d524929 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:22.443378 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730dc5a-aee3-4afd-9cd7-acdf8d524929 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:22.520401 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730dc5a-aee3-4afd-9cd7-acdf8d524929 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:22.521883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730dc5a-aee3-4afd-9cd7-acdf8d524929 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:22.563823 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f0354-eaa3-4c3c-a2aa-a3be4b154b55 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:22.611217 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc77e1-fe60-48d5-a968-05aa209f15e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:22.611876 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc77e1-fe60-48d5-a968-05aa209f15e8 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:22.612152 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc77e1-fe60-48d5-a968-05aa209f15e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:22.612417 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc77e1-fe60-48d5-a968-05aa209f15e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:22.614421 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc77e1-fe60-48d5-a968-05aa209f15e8 None admin] RBAC: Adding query filter params (group.id=2cb8aebaaa21420ea37fb2c6cbfe5ba5, role.id=31076ec4ad6a42868d212118fe129d18, scope.project.id=43f5db26667c4824b9e1f2363e88395d) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:22.614965 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc77e1-fe60-48d5-a968-05aa209f15e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:22.617381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc77e1-fe60-48d5-a968-05aa209f15e8 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:22.624902 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 179/353] 10.222.0.60 () {56 vars in 1376 bytes} [Thu May 12 09:20:22 2022] GET /identity/v3/role_assignments?group.id=2cb8aebaaa21420ea37fb2c6cbfe5ba5&scope.project.id=43f5db26667c4824b9e1f2363e88395d&role.id=31076ec4ad6a42868d212118fe129d18 => generated 260 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:22.626834 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49bf97-d824-496e-b5a5-d67a34159824 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:22.627648 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49bf97-d824-496e-b5a5-d67a34159824 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:22.628417 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49bf97-d824-496e-b5a5-d67a34159824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:22.655055 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-0d49bf97-d824-496e-b5a5-d67a34159824 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:22.657831 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-0d49bf97-d824-496e-b5a5-d67a34159824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:22.663535 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 175/354] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:20:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:20:22.671102 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730dc5a-aee3-4afd-9cd7-acdf8d524929 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:22.747962 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 180/355] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:22.781260 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730dc5a-aee3-4afd-9cd7-acdf8d524929 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:22.796153 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49bf97-d824-496e-b5a5-d67a34159824 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:22.869533 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e69d36-6b21-4761-b18e-dc68865c178f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:22.870925 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e69d36-6b21-4761-b18e-dc68865c178f None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:22.870925 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e69d36-6b21-4761-b18e-dc68865c178f None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:22.871143 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e69d36-6b21-4761-b18e-dc68865c178f None admin] PATH_INFO: `/v3/projects/43f5db26667c4824b9e1f2363e88395d` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:22.872800 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e69d36-6b21-4761-b18e-dc68865c178f None admin] RBAC: Authorizing `identity:get_project(project_id=43f5db26667c4824b9e1f2363e88395d)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:22.874353 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e69d36-6b21-4761-b18e-dc68865c178f None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:22.876737 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 176/356] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:20:22 2022] GET /identity/v3/projects/43f5db26667c4824b9e1f2363e88395d => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:22.882329 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e69d36-6b21-4761-b18e-dc68865c178f None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:22.936895 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49bf97-d824-496e-b5a5-d67a34159824 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:22.978933 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be9de1-af07-4060-a9c1-a6e1892a93c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:22.980078 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be9de1-af07-4060-a9c1-a6e1892a93c8 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:22.980554 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be9de1-af07-4060-a9c1-a6e1892a93c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:22.981085 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be9de1-af07-4060-a9c1-a6e1892a93c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:22.994489 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be9de1-af07-4060-a9c1-a6e1892a93c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:23.005579 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-79be9de1-af07-4060-a9c1-a6e1892a93c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 09:20:23.005579 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:23.005579 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:23.005579 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:23.005579 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:23.005579 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:23.005579 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:23.005579 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:23.005579 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:23.005579 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:23.005579 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:23.005579 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:23.005579 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:23.005579 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:23.005579 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:23.005579 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:23.006536 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:23.006536 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:23.006536 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:23.006536 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:23.006536 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:23.006536 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:23.006536 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:23.006536 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:23.006536 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:23.006536 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:23.006536 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:23.006536 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:23.006536 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:23.006536 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:23.006536 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:23.006536 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:23.007321 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:23.007321 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:23.007321 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:23.007321 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:23.007321 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:23.007321 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:23.007321 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:23.007321 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:23.007321 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:23.007321 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:23.007321 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 09:20:23.007321 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:23.007935 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 181/357] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:20:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:23.010625 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e69d36-6b21-4761-b18e-dc68865c178f None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:23.014087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be9de1-af07-4060-a9c1-a6e1892a93c8 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:23.080206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6d0a9-debf-4ab5-87dd-d185210bc167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:23.081079 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6d0a9-debf-4ab5-87dd-d185210bc167 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:23.081357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6d0a9-debf-4ab5-87dd-d185210bc167 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:23.081625 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6d0a9-debf-4ab5-87dd-d185210bc167 None admin] PATH_INFO: `/v3/groups/2cb8aebaaa21420ea37fb2c6cbfe5ba5` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:23.087225 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6d0a9-debf-4ab5-87dd-d185210bc167 None admin] RBAC: Authorizing `identity:get_group(group_id=2cb8aebaaa21420ea37fb2c6cbfe5ba5)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:23.088685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6d0a9-debf-4ab5-87dd-d185210bc167 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:23.091113 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 177/358] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 12 09:20:22 2022] GET /identity/v3/groups/2cb8aebaaa21420ea37fb2c6cbfe5ba5 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:23.110010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c0b87-8dfe-49a9-9a6f-492379b661f8 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:23.110301 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c0b87-8dfe-49a9-9a6f-492379b661f8 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:23.110578 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c0b87-8dfe-49a9-9a6f-492379b661f8 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:23.112307 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 178/359] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:23.113007 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c0b87-8dfe-49a9-9a6f-492379b661f8 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:23.191346 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be9de1-af07-4060-a9c1-a6e1892a93c8 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:23.239134 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c0b87-8dfe-49a9-9a6f-492379b661f8 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:23.245271 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64a0c9-4c98-4c93-a8ac-4f6470680a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:23.245997 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64a0c9-4c98-4c93-a8ac-4f6470680a04 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:23.246320 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64a0c9-4c98-4c93-a8ac-4f6470680a04 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:23.246604 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64a0c9-4c98-4c93-a8ac-4f6470680a04 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:23.247365 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64a0c9-4c98-4c93-a8ac-4f6470680a04 None admin] RBAC: Adding query filter params (name=member) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:23.247671 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64a0c9-4c98-4c93-a8ac-4f6470680a04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:23.249545 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64a0c9-4c98-4c93-a8ac-4f6470680a04 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:23.261066 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 182/360] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 12 09:20:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:23.262907 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b484265-5f19-40b2-ae43-fbc9fd133951 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:23.263196 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b484265-5f19-40b2-ae43-fbc9fd133951 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:23.263761 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b484265-5f19-40b2-ae43-fbc9fd133951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:23.281751 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b75dc-a2c2-48c1-b21e-96d93fe47dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:23.282461 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b75dc-a2c2-48c1-b21e-96d93fe47dd4 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:23.282742 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b75dc-a2c2-48c1-b21e-96d93fe47dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:23.283017 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b75dc-a2c2-48c1-b21e-96d93fe47dd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:23.283948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b75dc-a2c2-48c1-b21e-96d93fe47dd4 None admin] RBAC: Adding query filter params (group.id=2cb8aebaaa21420ea37fb2c6cbfe5ba5, role.id=7d5eb6a968a74fb0a30eb1e80603005c, scope.project.id=43f5db26667c4824b9e1f2363e88395d) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:23.284216 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b75dc-a2c2-48c1-b21e-96d93fe47dd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:23.285696 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b75dc-a2c2-48c1-b21e-96d93fe47dd4 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:23.285806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-6b484265-5f19-40b2-ae43-fbc9fd133951 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:23.286917 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-6b484265-5f19-40b2-ae43-fbc9fd133951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:23.292016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 179/361] 10.222.0.60 () {56 vars in 1376 bytes} [Thu May 12 09:20:23 2022] GET /identity/v3/role_assignments?group.id=2cb8aebaaa21420ea37fb2c6cbfe5ba5&scope.project.id=43f5db26667c4824b9e1f2363e88395d&role.id=7d5eb6a968a74fb0a30eb1e80603005c => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:23.292945 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b75dc-a2c2-48c1-b21e-96d93fe47dd4 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:23.405094 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 183/362] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:23.406613 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c44f51-3be6-408e-8710-d1dccd3bfc10 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:23.406905 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c44f51-3be6-408e-8710-d1dccd3bfc10 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:23.407180 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c44f51-3be6-408e-8710-d1dccd3bfc10 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:23.415510 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 184/363] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:23 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:23.422177 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3d52e-2e08-415b-aee6-95dae70249c2 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:23.422545 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3d52e-2e08-415b-aee6-95dae70249c2 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:23.422822 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3d52e-2e08-415b-aee6-95dae70249c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:23.452176 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-62d3d52e-2e08-415b-aee6-95dae70249c2 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:23.453352 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-62d3d52e-2e08-415b-aee6-95dae70249c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:23.456807 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b75dc-a2c2-48c1-b21e-96d93fe47dd4 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:23.509404 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317e0a2-e4b7-4d04-9ad7-016e803a800b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:23.510170 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317e0a2-e4b7-4d04-9ad7-016e803a800b None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:23.510456 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317e0a2-e4b7-4d04-9ad7-016e803a800b None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:23.510727 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317e0a2-e4b7-4d04-9ad7-016e803a800b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:23.543279 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 185/364] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:20:23.544610 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3d52e-2e08-415b-aee6-95dae70249c2 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:23.611275 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317e0a2-e4b7-4d04-9ad7-016e803a800b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:23.613091 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317e0a2-e4b7-4d04-9ad7-016e803a800b None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:23.653507 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3d52e-2e08-415b-aee6-95dae70249c2 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:23.701325 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd64fca-bebf-47ed-bcc8-03419e1554ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:23.702161 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd64fca-bebf-47ed-bcc8-03419e1554ea None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:23.702497 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd64fca-bebf-47ed-bcc8-03419e1554ea None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:23.702718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd64fca-bebf-47ed-bcc8-03419e1554ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:23.718182 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 180/365] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:20:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:20:23.718884 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317e0a2-e4b7-4d04-9ad7-016e803a800b None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:23.722998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd64fca-bebf-47ed-bcc8-03419e1554ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:23.730146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-dfd64fca-bebf-47ed-bcc8-03419e1554ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:20:23.730146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:23.730146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:23.730146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:23.730146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:23.730146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:23.730146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:23.730146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:23.730146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:23.730146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:23.730146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:23.730146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:23.730146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:23.730146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:23.730146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:23.730146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:23.731124 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:23.731124 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:23.731124 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:23.731124 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:23.731124 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:23.731124 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:23.731124 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:23.731124 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:23.731124 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:23.731124 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:23.731124 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:23.731124 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:23.731124 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:23.731124 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:23.731124 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:23.731124 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:23.731922 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:23.731922 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:23.731922 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:23.731922 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:23.731922 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:23.731922 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:23.731922 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:23.731922 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:23.731922 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:23.731922 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:23.731922 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:20:23.731922 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:23.731922 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 186/366] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:20:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:23.732604 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd64fca-bebf-47ed-bcc8-03419e1554ea None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:23.841802 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317e0a2-e4b7-4d04-9ad7-016e803a800b None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:23.851871 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd64fca-bebf-47ed-bcc8-03419e1554ea None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:23.882885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c24e1c-6176-4f48-b42e-fbc0a75b7dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:23.884498 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c24e1c-6176-4f48-b42e-fbc0a75b7dcb None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:23.884924 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c24e1c-6176-4f48-b42e-fbc0a75b7dcb None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:23.885335 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c24e1c-6176-4f48-b42e-fbc0a75b7dcb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:23.897204 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c24e1c-6176-4f48-b42e-fbc0a75b7dcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:23.897525 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e1104-4b59-4ee9-a00b-e26dc86a9c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:23.898827 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e1104-4b59-4ee9-a00b-e26dc86a9c8d None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:23.899374 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e1104-4b59-4ee9-a00b-e26dc86a9c8d None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:23.899910 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e1104-4b59-4ee9-a00b-e26dc86a9c8d None admin] PATH_INFO: `/v3/projects/9d1d4b4ef82c4618beda78779862fc08` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:23.902083 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e1104-4b59-4ee9-a00b-e26dc86a9c8d None admin] RBAC: Authorizing `identity:get_project(project_id=9d1d4b4ef82c4618beda78779862fc08)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:23.904767 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e1104-4b59-4ee9-a00b-e26dc86a9c8d None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:23.907151 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-a5c24e1c-6176-4f48-b42e-fbc0a75b7dcb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 09:20:23.907151 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:23.907151 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:23.907151 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:23.907151 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:23.907151 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:23.907151 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:23.907151 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:23.907151 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:23.907151 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:23.907151 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:23.907151 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:23.907151 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:23.907151 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:23.907151 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:23.907151 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:23.908211 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:23.908211 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:23.908211 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:23.908211 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:23.908211 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:23.908211 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:23.908211 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:23.908211 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:23.908211 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:23.908211 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:23.908211 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:23.908211 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:23.908211 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:23.908211 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:23.908211 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:23.908211 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:23.909186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:23.909186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:23.909186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:23.909186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:23.909186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:23.909186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:23.909186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:23.909186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:23.909186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:23.909186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:23.909186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 09:20:23.909186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:23.911027 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 187/367] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:20:23 2022] GET /identity/v3/projects/9d1d4b4ef82c4618beda78779862fc08 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:23.911338 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 181/368] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 12 09:20:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:23.915537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e1104-4b59-4ee9-a00b-e26dc86a9c8d None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:23.916530 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c24e1c-6176-4f48-b42e-fbc0a75b7dcb None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:24.030385 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c24e1c-6176-4f48-b42e-fbc0a75b7dcb None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:24.060742 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e1104-4b59-4ee9-a00b-e26dc86a9c8d None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:24.070640 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69c142-5308-474d-b437-2c81dfedab25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:24.071670 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69c142-5308-474d-b437-2c81dfedab25 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:24.072052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69c142-5308-474d-b437-2c81dfedab25 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:24.072442 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69c142-5308-474d-b437-2c81dfedab25 None admin] PATH_INFO: `/v3/groups/2cb8aebaaa21420ea37fb2c6cbfe5ba5` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:24.073747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e69c142-5308-474d-b437-2c81dfedab25 None admin] RBAC: Authorizing `identity:get_group(group_id=2cb8aebaaa21420ea37fb2c6cbfe5ba5)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:24.075918 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e69c142-5308-474d-b437-2c81dfedab25 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:24.078238 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 182/369] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 12 09:20:23 2022] GET /identity/v3/groups/2cb8aebaaa21420ea37fb2c6cbfe5ba5 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:24.079091 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69c142-5308-474d-b437-2c81dfedab25 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:24.114751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd678fd-c1f2-4f3c-a227-a781ae57e399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:24.115728 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd678fd-c1f2-4f3c-a227-a781ae57e399 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:24.116174 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd678fd-c1f2-4f3c-a227-a781ae57e399 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:24.116612 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd678fd-c1f2-4f3c-a227-a781ae57e399 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:24.118365 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd678fd-c1f2-4f3c-a227-a781ae57e399 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:24.118859 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd678fd-c1f2-4f3c-a227-a781ae57e399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:24.120687 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd678fd-c1f2-4f3c-a227-a781ae57e399 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:24.133053 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 188/370] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:20:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:24.134016 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd678fd-c1f2-4f3c-a227-a781ae57e399 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:24.205304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69c142-5308-474d-b437-2c81dfedab25 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:24.233459 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd678fd-c1f2-4f3c-a227-a781ae57e399 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:24.239970 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622fe28-5cae-4355-8c2a-306653e1c2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:24.240958 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622fe28-5cae-4355-8c2a-306653e1c2f2 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:24.241491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622fe28-5cae-4355-8c2a-306653e1c2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:24.241991 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622fe28-5cae-4355-8c2a-306653e1c2f2 None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:24.242937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622fe28-5cae-4355-8c2a-306653e1c2f2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:24.243468 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622fe28-5cae-4355-8c2a-306653e1c2f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:24.245034 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622fe28-5cae-4355-8c2a-306653e1c2f2 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:24.254182 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 183/371] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:20:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:24.255504 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622fe28-5cae-4355-8c2a-306653e1c2f2 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:24.269757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc18dbd-c224-49d3-87cf-d9988256aa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:24.270580 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc18dbd-c224-49d3-87cf-d9988256aa4f None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:24.271104 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc18dbd-c224-49d3-87cf-d9988256aa4f None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:24.271104 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc18dbd-c224-49d3-87cf-d9988256aa4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:24.271982 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc18dbd-c224-49d3-87cf-d9988256aa4f None admin] RBAC: Adding query filter params (group.id=2cb8aebaaa21420ea37fb2c6cbfe5ba5, role.id=31076ec4ad6a42868d212118fe129d18, scope.project.id=9d1d4b4ef82c4618beda78779862fc08) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:24.272343 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc18dbd-c224-49d3-87cf-d9988256aa4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:24.273759 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc18dbd-c224-49d3-87cf-d9988256aa4f None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:24.280283 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 189/372] 10.222.0.60 () {56 vars in 1376 bytes} [Thu May 12 09:20:24 2022] GET /identity/v3/role_assignments?group.id=2cb8aebaaa21420ea37fb2c6cbfe5ba5&scope.project.id=9d1d4b4ef82c4618beda78779862fc08&role.id=31076ec4ad6a42868d212118fe129d18 => generated 260 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:24.282667 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc18dbd-c224-49d3-87cf-d9988256aa4f None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:24.368823 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622fe28-5cae-4355-8c2a-306653e1c2f2 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:24.411245 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0b352-5258-4ec9-96b5-5fd620728d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:24.411703 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc18dbd-c224-49d3-87cf-d9988256aa4f None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:24.412516 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0b352-5258-4ec9-96b5-5fd620728d34 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:24.413004 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0b352-5258-4ec9-96b5-5fd620728d34 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:24.413469 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0b352-5258-4ec9-96b5-5fd620728d34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:24.457500 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580df265-aa89-42a0-8d52-f5d6495f3941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:24.458501 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580df265-aa89-42a0-8d52-f5d6495f3941 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:24.459039 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580df265-aa89-42a0-8d52-f5d6495f3941 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:24.459489 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580df265-aa89-42a0-8d52-f5d6495f3941 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:24.486773 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c0b352-5258-4ec9-96b5-5fd620728d34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:24.488571 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c0b352-5258-4ec9-96b5-5fd620728d34 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:24.548276 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580df265-aa89-42a0-8d52-f5d6495f3941 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:24.550098 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580df265-aa89-42a0-8d52-f5d6495f3941 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:24.592434 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 184/373] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:20:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:20:24.597996 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0b352-5258-4ec9-96b5-5fd620728d34 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:24.673884 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 190/374] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:20:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:20:24.679459 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580df265-aa89-42a0-8d52-f5d6495f3941 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:24.708075 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0b352-5258-4ec9-96b5-5fd620728d34 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:24.742101 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d7c7f-4e8a-486b-bb45-4c205a20fdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:24.743750 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d7c7f-4e8a-486b-bb45-4c205a20fdb4 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:24.744246 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d7c7f-4e8a-486b-bb45-4c205a20fdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:24.744716 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d7c7f-4e8a-486b-bb45-4c205a20fdb4 None admin] PATH_INFO: `/v3/projects/796065237e2244ba911db9225d3aa52c` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:24.746168 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d7c7f-4e8a-486b-bb45-4c205a20fdb4 None admin] RBAC: Authorizing `identity:get_project(project_id=796065237e2244ba911db9225d3aa52c)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:24.748360 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d7c7f-4e8a-486b-bb45-4c205a20fdb4 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:24.750601 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 185/375] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:20:24 2022] GET /identity/v3/projects/796065237e2244ba911db9225d3aa52c => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:24.759155 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d7c7f-4e8a-486b-bb45-4c205a20fdb4 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:24.799538 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580df265-aa89-42a0-8d52-f5d6495f3941 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:24.848792 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed4d30-9a54-4afa-8a50-06aab49ef0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:24.849717 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed4d30-9a54-4afa-8a50-06aab49ef0b5 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:24.850028 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed4d30-9a54-4afa-8a50-06aab49ef0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:24.850302 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed4d30-9a54-4afa-8a50-06aab49ef0b5 None admin] PATH_INFO: `/v3/projects/9d1d4b4ef82c4618beda78779862fc08` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:24.853925 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed4d30-9a54-4afa-8a50-06aab49ef0b5 None admin] RBAC: Authorizing `identity:get_project(project_id=9d1d4b4ef82c4618beda78779862fc08)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:24.853925 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed4d30-9a54-4afa-8a50-06aab49ef0b5 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:24.854805 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 191/376] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:20:24 2022] GET /identity/v3/projects/9d1d4b4ef82c4618beda78779862fc08 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:24.861291 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed4d30-9a54-4afa-8a50-06aab49ef0b5 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:24.965454 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d7c7f-4e8a-486b-bb45-4c205a20fdb4 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:24.978615 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed4d30-9a54-4afa-8a50-06aab49ef0b5 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:25.029754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5e5ee-90b0-49c7-af60-0c5e0eb8ea83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:25.030634 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5e5ee-90b0-49c7-af60-0c5e0eb8ea83 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:25.030912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5e5ee-90b0-49c7-af60-0c5e0eb8ea83 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:25.031179 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5e5ee-90b0-49c7-af60-0c5e0eb8ea83 None admin] PATH_INFO: `/v3/groups/18679d69ce094eb599b7097d9a7302d2` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:25.037143 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25859c-7b32-4ad0-b553-4f192e948858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:25.038031 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25859c-7b32-4ad0-b553-4f192e948858 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:25.038308 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25859c-7b32-4ad0-b553-4f192e948858 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:25.039586 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25859c-7b32-4ad0-b553-4f192e948858 None admin] PATH_INFO: `/v3/groups/2cb8aebaaa21420ea37fb2c6cbfe5ba5` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:25.040911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25859c-7b32-4ad0-b553-4f192e948858 None admin] RBAC: Authorizing `identity:get_group(group_id=2cb8aebaaa21420ea37fb2c6cbfe5ba5)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:25.042378 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25859c-7b32-4ad0-b553-4f192e948858 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:25.045217 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5e5ee-90b0-49c7-af60-0c5e0eb8ea83 None admin] RBAC: Authorizing `identity:get_group(group_id=18679d69ce094eb599b7097d9a7302d2)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:25.049915 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e5e5ee-90b0-49c7-af60-0c5e0eb8ea83 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:25.051701 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 186/378] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 12 09:20:24 2022] GET /identity/v3/groups/18679d69ce094eb599b7097d9a7302d2 => generated 229 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:25.051813 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 192/378] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 12 09:20:24 2022] GET /identity/v3/groups/2cb8aebaaa21420ea37fb2c6cbfe5ba5 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:25.054254 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5e5ee-90b0-49c7-af60-0c5e0eb8ea83 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:25.059030 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25859c-7b32-4ad0-b553-4f192e948858 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:25.209828 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25859c-7b32-4ad0-b553-4f192e948858 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:25.255032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97009aea-5e80-474d-8c60-6ca28b47aa8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:25.255957 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97009aea-5e80-474d-8c60-6ca28b47aa8f None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:25.256234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97009aea-5e80-474d-8c60-6ca28b47aa8f None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:25.256503 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97009aea-5e80-474d-8c60-6ca28b47aa8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:25.257331 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97009aea-5e80-474d-8c60-6ca28b47aa8f None admin] RBAC: Adding query filter params (group.id=18679d69ce094eb599b7097d9a7302d2, role.id=8f01c4c38fa44034a54c1f8cd2d2db1a, scope.project.id=796065237e2244ba911db9225d3aa52c) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:25.257638 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97009aea-5e80-474d-8c60-6ca28b47aa8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:25.259089 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97009aea-5e80-474d-8c60-6ca28b47aa8f None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:25.271233 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e5e5ee-90b0-49c7-af60-0c5e0eb8ea83 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:25.274852 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 193/379] 10.222.0.60 () {56 vars in 1376 bytes} [Thu May 12 09:20:25 2022] GET /identity/v3/role_assignments?group.id=18679d69ce094eb599b7097d9a7302d2&scope.project.id=796065237e2244ba911db9225d3aa52c&role.id=8f01c4c38fa44034a54c1f8cd2d2db1a => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:25.321496 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74567049-19d0-4fd7-928b-5a650afbf991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:25.322206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74567049-19d0-4fd7-928b-5a650afbf991 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:25.322501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74567049-19d0-4fd7-928b-5a650afbf991 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:25.322766 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74567049-19d0-4fd7-928b-5a650afbf991 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:25.323591 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74567049-19d0-4fd7-928b-5a650afbf991 None admin] RBAC: Adding query filter params (group.id=2cb8aebaaa21420ea37fb2c6cbfe5ba5, role.id=7d5eb6a968a74fb0a30eb1e80603005c, scope.project.id=9d1d4b4ef82c4618beda78779862fc08) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:25.323896 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74567049-19d0-4fd7-928b-5a650afbf991 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:25.325870 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74567049-19d0-4fd7-928b-5a650afbf991 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:25.331471 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 187/380] 10.222.0.60 () {56 vars in 1376 bytes} [Thu May 12 09:20:25 2022] GET /identity/v3/role_assignments?group.id=2cb8aebaaa21420ea37fb2c6cbfe5ba5&scope.project.id=9d1d4b4ef82c4618beda78779862fc08&role.id=7d5eb6a968a74fb0a30eb1e80603005c => generated 260 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:25.397806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7dd0ab-b491-4227-8321-b6c61546db30 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:25.398148 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7dd0ab-b491-4227-8321-b6c61546db30 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:25.398383 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7dd0ab-b491-4227-8321-b6c61546db30 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:25.399914 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 194/381] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:25.415957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efd5e7-86f1-4896-974c-8219822b5407 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:25.416296 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efd5e7-86f1-4896-974c-8219822b5407 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:25.416512 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efd5e7-86f1-4896-974c-8219822b5407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:25.439285 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-64efd5e7-86f1-4896-974c-8219822b5407 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:25.440570 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-64efd5e7-86f1-4896-974c-8219822b5407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:25.528448 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 188/382] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:25.552392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7dd0ab-b491-4227-8321-b6c61546db30 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:25.691288 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7dd0ab-b491-4227-8321-b6c61546db30 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:25.733032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daa8ba-d8fc-4525-8d30-3f06d34c60e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:25.733841 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daa8ba-d8fc-4525-8d30-3f06d34c60e6 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:25.734146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daa8ba-d8fc-4525-8d30-3f06d34c60e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:25.734417 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daa8ba-d8fc-4525-8d30-3f06d34c60e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:25.751515 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84daa8ba-d8fc-4525-8d30-3f06d34c60e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:25.759557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-84daa8ba-d8fc-4525-8d30-3f06d34c60e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 09:20:25.759557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:25.759557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:25.759557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:25.759557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:25.759557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:25.759557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:25.759557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:25.759557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:25.759557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:25.759557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:25.759557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:25.759557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:25.759557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:25.759557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:25.759557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:25.762623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:25.762623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:25.762623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:25.762623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:25.762623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:25.762623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:25.762623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:25.762623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:25.762623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:25.762623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:25.762623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:25.762623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:25.762623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:25.762623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:25.762623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:25.762623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:25.764731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:25.764731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:25.764731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:25.764731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:25.764731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:25.764731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:25.764731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:25.764731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:25.764731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:25.764731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:25.764731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 09:20:25.764731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:25.764731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 195/383] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:20:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:25.770994 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efd5e7-86f1-4896-974c-8219822b5407 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:25.912720 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efd5e7-86f1-4896-974c-8219822b5407 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:25.960080 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2bb53-7f94-49be-80ee-c8cb04bd1660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:25.960689 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2bb53-7f94-49be-80ee-c8cb04bd1660 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:25.960972 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2bb53-7f94-49be-80ee-c8cb04bd1660 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:25.961247 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2bb53-7f94-49be-80ee-c8cb04bd1660 None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:25.962038 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2bb53-7f94-49be-80ee-c8cb04bd1660 None admin] RBAC: Adding query filter params (name=member) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:25.962349 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2bb53-7f94-49be-80ee-c8cb04bd1660 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:25.963750 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2bb53-7f94-49be-80ee-c8cb04bd1660 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:25.978075 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 189/384] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 12 09:20:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:25.983343 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daa8ba-d8fc-4525-8d30-3f06d34c60e6 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:26.128696 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daa8ba-d8fc-4525-8d30-3f06d34c60e6 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:26.167741 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4f5ae-e5bf-482e-b046-622d8569d0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:26.168696 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4f5ae-e5bf-482e-b046-622d8569d0a5 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:26.168975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4f5ae-e5bf-482e-b046-622d8569d0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:26.169289 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4f5ae-e5bf-482e-b046-622d8569d0a5 None admin] PATH_INFO: `/v3/groups/2cb8aebaaa21420ea37fb2c6cbfe5ba5` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:26.174637 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4f5ae-e5bf-482e-b046-622d8569d0a5 None admin] RBAC: Authorizing `identity:get_group(group_id=2cb8aebaaa21420ea37fb2c6cbfe5ba5)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:26.176139 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4f5ae-e5bf-482e-b046-622d8569d0a5 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:26.178105 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 196/385] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 12 09:20:25 2022] GET /identity/v3/groups/2cb8aebaaa21420ea37fb2c6cbfe5ba5 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:26.183212 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2bb53-7f94-49be-80ee-c8cb04bd1660 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:26.315993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554761e-e10c-4d61-af43-a93bb647b398 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:26.316350 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554761e-e10c-4d61-af43-a93bb647b398 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:26.316527 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554761e-e10c-4d61-af43-a93bb647b398 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:26.317867 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 197/386] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:20:26.323183 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4729413-34bd-479c-8f9f-c79d11b83cd6 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:26.323474 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4729413-34bd-479c-8f9f-c79d11b83cd6 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:26.323752 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4729413-34bd-479c-8f9f-c79d11b83cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:26.333516 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2bb53-7f94-49be-80ee-c8cb04bd1660 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:26.341395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-a4729413-34bd-479c-8f9f-c79d11b83cd6 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:26.342608 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-a4729413-34bd-479c-8f9f-c79d11b83cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:26.396502 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8e0d1-1eb9-4cbc-b3f7-90302e8d062f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:26.397376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8e0d1-1eb9-4cbc-b3f7-90302e8d062f None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:26.397664 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8e0d1-1eb9-4cbc-b3f7-90302e8d062f None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:26.397958 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8e0d1-1eb9-4cbc-b3f7-90302e8d062f None admin] PATH_INFO: `/v3/projects/43f5db26667c4824b9e1f2363e88395d` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:26.401277 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8e0d1-1eb9-4cbc-b3f7-90302e8d062f None admin] RBAC: Authorizing `identity:get_project(project_id=43f5db26667c4824b9e1f2363e88395d)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:26.403327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8e0d1-1eb9-4cbc-b3f7-90302e8d062f None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:26.407460 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 190/387] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:20:26 2022] GET /identity/v3/projects/43f5db26667c4824b9e1f2363e88395d => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:26.413221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8e0d1-1eb9-4cbc-b3f7-90302e8d062f None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:26.439315 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 198/388] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:20:26.471871 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4729413-34bd-479c-8f9f-c79d11b83cd6 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:26.600122 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8e0d1-1eb9-4cbc-b3f7-90302e8d062f None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:26.602764 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4729413-34bd-479c-8f9f-c79d11b83cd6 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:26.640868 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab5406-ea4f-402d-bcc0-35053e8d903c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:26.641685 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab5406-ea4f-402d-bcc0-35053e8d903c None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:26.641993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab5406-ea4f-402d-bcc0-35053e8d903c None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:26.642270 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab5406-ea4f-402d-bcc0-35053e8d903c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:26.660949 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab5406-ea4f-402d-bcc0-35053e8d903c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:26.669176 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-f3ab5406-ea4f-402d-bcc0-35053e8d903c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 09:20:26.669176 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:26.669176 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:26.669176 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:26.669176 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:26.669176 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:26.669176 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:26.669176 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:26.669176 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:26.669176 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:26.669176 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:26.669176 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:26.669176 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:26.669176 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:26.669176 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:26.669176 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:26.670104 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:26.670104 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:26.670104 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:26.670104 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:26.670104 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:26.670104 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:26.670104 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:26.670104 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:26.670104 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:26.670104 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:26.670104 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:26.670104 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:26.670104 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:26.670104 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:26.670104 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:26.670104 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:26.670905 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:26.670905 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:26.670905 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:26.670905 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:26.670905 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:26.670905 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:26.670905 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:26.670905 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:26.670905 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:26.670905 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:26.670905 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 09:20:26.670905 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:26.673019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74ecd0-e637-4ec4-b659-aed292e9ce10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:26.673019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74ecd0-e637-4ec4-b659-aed292e9ce10 None admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:26.673019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74ecd0-e637-4ec4-b659-aed292e9ce10 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:26.673019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74ecd0-e637-4ec4-b659-aed292e9ce10 None admin] PATH_INFO: `/v3/projects/43f5db26667c4824b9e1f2363e88395d/groups/2cb8aebaaa21420ea37fb2c6cbfe5ba5/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:26.675080 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74ecd0-e637-4ec4-b659-aed292e9ce10 None admin] RBAC: Authorizing `identity:create_grant(project_id=43f5db26667c4824b9e1f2363e88395d, group_id=2cb8aebaaa21420ea37fb2c6cbfe5ba5, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:26.676422 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74ecd0-e637-4ec4-b659-aed292e9ce10 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:26.679097 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 199/389] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 12 09:20:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:20:26.685877 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab5406-ea4f-402d-bcc0-35053e8d903c None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:26.702865 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 191/390] 10.222.0.60 () {58 vars in 1442 bytes} [Thu May 12 09:20:26 2022] PUT /identity/v3/projects/43f5db26667c4824b9e1f2363e88395d/groups/2cb8aebaaa21420ea37fb2c6cbfe5ba5/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:20:26.806292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab5406-ea4f-402d-bcc0-35053e8d903c None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:26.850363 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e608a2f-df90-4a22-b47e-35748c928aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:26.851430 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e608a2f-df90-4a22-b47e-35748c928aa5 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:26.851927 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e608a2f-df90-4a22-b47e-35748c928aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:26.852410 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e608a2f-df90-4a22-b47e-35748c928aa5 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:26.853684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e608a2f-df90-4a22-b47e-35748c928aa5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:26.854230 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e608a2f-df90-4a22-b47e-35748c928aa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:26.856411 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e608a2f-df90-4a22-b47e-35748c928aa5 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:26.865743 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 200/391] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:20:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:26.872184 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74ecd0-e637-4ec4-b659-aed292e9ce10 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:27.035627 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74ecd0-e637-4ec4-b659-aed292e9ce10 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:27.075387 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa002b33-2aa2-4378-89bc-621c9f800125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:27.076262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa002b33-2aa2-4378-89bc-621c9f800125 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:27.076546 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa002b33-2aa2-4378-89bc-621c9f800125 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:27.076822 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa002b33-2aa2-4378-89bc-621c9f800125 None admin] PATH_INFO: `/v3/groups/2cb8aebaaa21420ea37fb2c6cbfe5ba5` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:27.078078 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa002b33-2aa2-4378-89bc-621c9f800125 None admin] RBAC: Authorizing `identity:get_group(group_id=2cb8aebaaa21420ea37fb2c6cbfe5ba5)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:27.079546 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa002b33-2aa2-4378-89bc-621c9f800125 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:27.081531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 192/392] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 12 09:20:26 2022] GET /identity/v3/groups/2cb8aebaaa21420ea37fb2c6cbfe5ba5 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:27.086705 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e608a2f-df90-4a22-b47e-35748c928aa5 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:27.213116 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e608a2f-df90-4a22-b47e-35748c928aa5 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:27.246074 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed5655-576a-4e41-a9da-7002d85aca57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:27.247466 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed5655-576a-4e41-a9da-7002d85aca57 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:27.247747 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed5655-576a-4e41-a9da-7002d85aca57 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:27.248017 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed5655-576a-4e41-a9da-7002d85aca57 None admin] PATH_INFO: `/v3/projects/43f5db26667c4824b9e1f2363e88395d` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:27.249207 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed5655-576a-4e41-a9da-7002d85aca57 None admin] RBAC: Authorizing `identity:get_project(project_id=43f5db26667c4824b9e1f2363e88395d)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:27.250678 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed5655-576a-4e41-a9da-7002d85aca57 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:27.252351 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 201/393] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:20:27 2022] GET /identity/v3/projects/43f5db26667c4824b9e1f2363e88395d => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:27.258276 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa002b33-2aa2-4378-89bc-621c9f800125 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:27.401413 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa002b33-2aa2-4378-89bc-621c9f800125 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:27.440893 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d09713-c492-44d8-be36-02acdccbccf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:27.441784 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d09713-c492-44d8-be36-02acdccbccf0 None admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:27.442108 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d09713-c492-44d8-be36-02acdccbccf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:27.442385 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d09713-c492-44d8-be36-02acdccbccf0 None admin] PATH_INFO: `/v3/projects/43f5db26667c4824b9e1f2363e88395d/groups/2cb8aebaaa21420ea37fb2c6cbfe5ba5/roles/7d5eb6a968a74fb0a30eb1e80603005c` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:27.444606 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d09713-c492-44d8-be36-02acdccbccf0 None admin] RBAC: Authorizing `identity:create_grant(project_id=43f5db26667c4824b9e1f2363e88395d, group_id=2cb8aebaaa21420ea37fb2c6cbfe5ba5, role_id=7d5eb6a968a74fb0a30eb1e80603005c)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:27.446109 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d09713-c492-44d8-be36-02acdccbccf0 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:27.464104 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 193/394] 10.222.0.60 () {58 vars in 1442 bytes} [Thu May 12 09:20:27 2022] PUT /identity/v3/projects/43f5db26667c4824b9e1f2363e88395d/groups/2cb8aebaaa21420ea37fb2c6cbfe5ba5/roles/7d5eb6a968a74fb0a30eb1e80603005c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:20:27.592123 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a75c56-7561-4ce4-ab3f-ad4d549b9ecd None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:27.592457 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a75c56-7561-4ce4-ab3f-ad4d549b9ecd None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:27.592684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a75c56-7561-4ce4-ab3f-ad4d549b9ecd None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:27.594366 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 202/395] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:27.599652 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97503fa-36a3-4016-a31d-e714c083ca27 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:27.599983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97503fa-36a3-4016-a31d-e714c083ca27 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:27.600219 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97503fa-36a3-4016-a31d-e714c083ca27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:27.623232 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-f97503fa-36a3-4016-a31d-e714c083ca27 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:27.630958 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-f97503fa-36a3-4016-a31d-e714c083ca27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:27.712221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 194/396] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:27.733052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a75c56-7561-4ce4-ab3f-ad4d549b9ecd None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:27.843625 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a75c56-7561-4ce4-ab3f-ad4d549b9ecd None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:27.880049 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758c880-3320-4c94-b15f-9df4f773cf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:27.881176 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758c880-3320-4c94-b15f-9df4f773cf6f None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:27.881467 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758c880-3320-4c94-b15f-9df4f773cf6f None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:27.881790 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758c880-3320-4c94-b15f-9df4f773cf6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:27.893409 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758c880-3320-4c94-b15f-9df4f773cf6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:27.901484 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-2758c880-3320-4c94-b15f-9df4f773cf6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 09:20:27.901484 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:27.901484 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:27.901484 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:27.901484 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:27.901484 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:27.901484 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:27.901484 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:27.901484 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:27.901484 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:27.901484 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:27.901484 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:27.901484 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:27.901484 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:27.901484 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:27.901484 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:27.902482 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:27.902482 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:27.902482 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:27.902482 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:27.902482 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:27.902482 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:27.902482 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:27.902482 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:27.902482 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:27.902482 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:27.902482 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:27.902482 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:27.902482 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:27.902482 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:27.902482 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:27.902482 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:27.903300 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:27.903300 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:27.903300 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:27.903300 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:27.903300 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:27.903300 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:27.903300 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:27.903300 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:27.903300 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:27.903300 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:27.903300 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 09:20:27.903300 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:27.903300 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 203/397] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:20:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:27.908740 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97503fa-36a3-4016-a31d-e714c083ca27 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:28.012810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97503fa-36a3-4016-a31d-e714c083ca27 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:28.050159 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0bfbc-3c0a-45b7-98b1-802b7c0d910f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:28.050848 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0bfbc-3c0a-45b7-98b1-802b7c0d910f None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:28.051132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0bfbc-3c0a-45b7-98b1-802b7c0d910f None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:28.051407 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0bfbc-3c0a-45b7-98b1-802b7c0d910f None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:28.052165 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0bfbc-3c0a-45b7-98b1-802b7c0d910f None admin] RBAC: Adding query filter params (name=member) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:28.052474 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0bfbc-3c0a-45b7-98b1-802b7c0d910f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:28.053864 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0bfbc-3c0a-45b7-98b1-802b7c0d910f None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:28.068300 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 195/398] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 12 09:20:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:28.069802 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758c880-3320-4c94-b15f-9df4f773cf6f None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:28.228311 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758c880-3320-4c94-b15f-9df4f773cf6f None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:28.262804 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129cadf-5aeb-4d85-9e43-f8e2171e3fce None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:28.263188 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129cadf-5aeb-4d85-9e43-f8e2171e3fce None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:28.263365 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129cadf-5aeb-4d85-9e43-f8e2171e3fce None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:28.265010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 196/399] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:28.269954 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6971dd-1eb0-447b-9f35-82fa8cc4cfbd None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:28.270235 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6971dd-1eb0-447b-9f35-82fa8cc4cfbd None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:28.270511 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6971dd-1eb0-447b-9f35-82fa8cc4cfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:28.281273 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cebedf-f34e-48bb-a4c8-bc29cd1277c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:28.282473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cebedf-f34e-48bb-a4c8-bc29cd1277c0 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:28.282965 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cebedf-f34e-48bb-a4c8-bc29cd1277c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:28.283478 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cebedf-f34e-48bb-a4c8-bc29cd1277c0 None admin] PATH_INFO: `/v3/groups/2cb8aebaaa21420ea37fb2c6cbfe5ba5` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:28.284880 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cebedf-f34e-48bb-a4c8-bc29cd1277c0 None admin] RBAC: Authorizing `identity:get_group(group_id=2cb8aebaaa21420ea37fb2c6cbfe5ba5)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:28.286557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cebedf-f34e-48bb-a4c8-bc29cd1277c0 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:28.288713 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 204/400] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 12 09:20:28 2022] GET /identity/v3/groups/2cb8aebaaa21420ea37fb2c6cbfe5ba5 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:28.296298 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cebedf-f34e-48bb-a4c8-bc29cd1277c0 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:28.296460 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-bc6971dd-1eb0-447b-9f35-82fa8cc4cfbd None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:28.297596 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-bc6971dd-1eb0-447b-9f35-82fa8cc4cfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:28.371932 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 197/401] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:28.395971 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6971dd-1eb0-447b-9f35-82fa8cc4cfbd None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:28.440387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cebedf-f34e-48bb-a4c8-bc29cd1277c0 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:28.494511 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25ace2-066a-41d4-989b-7a35682ff86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:28.496943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25ace2-066a-41d4-989b-7a35682ff86c None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:28.496943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25ace2-066a-41d4-989b-7a35682ff86c None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:28.496943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25ace2-066a-41d4-989b-7a35682ff86c None admin] PATH_INFO: `/v3/projects/9d1d4b4ef82c4618beda78779862fc08` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:28.498793 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25ace2-066a-41d4-989b-7a35682ff86c None admin] RBAC: Authorizing `identity:get_project(project_id=9d1d4b4ef82c4618beda78779862fc08)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:28.500243 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25ace2-066a-41d4-989b-7a35682ff86c None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:28.502136 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 205/402] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:20:28 2022] GET /identity/v3/projects/9d1d4b4ef82c4618beda78779862fc08 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:28.508009 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654f89b-f360-435b-967f-d9088d232f27 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:28.508274 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654f89b-f360-435b-967f-d9088d232f27 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:28.508558 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654f89b-f360-435b-967f-d9088d232f27 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:28.511222 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 206/403] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:28.512500 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654f89b-f360-435b-967f-d9088d232f27 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:28.522197 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6971dd-1eb0-447b-9f35-82fa8cc4cfbd None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:28.566608 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6194764-e2b5-4090-a0c8-24120d695a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:28.568125 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6194764-e2b5-4090-a0c8-24120d695a67 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:28.568948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6194764-e2b5-4090-a0c8-24120d695a67 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:28.569695 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6194764-e2b5-4090-a0c8-24120d695a67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:28.583093 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6194764-e2b5-4090-a0c8-24120d695a67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:28.594132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-b6194764-e2b5-4090-a0c8-24120d695a67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:20:28.594132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:28.594132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:28.594132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:28.594132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:28.594132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:28.594132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:28.594132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:28.594132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:28.594132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:28.594132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:28.594132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:28.594132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:28.594132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:28.594132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:28.594132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:28.595057 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:28.595057 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:28.595057 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:28.595057 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:28.595057 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:28.595057 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:28.595057 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:28.595057 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:28.595057 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:28.595057 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:28.595057 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:28.595057 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:28.595057 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:28.595057 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:28.595057 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:28.595057 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:28.595865 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:28.595865 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:28.595865 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:28.595865 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:28.595865 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:28.595865 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:28.595865 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:28.595865 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:28.595865 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:28.595865 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:28.595865 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:20:28.595865 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:28.599196 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 198/404] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:20:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:20:28.600680 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a205e84-655f-4bbc-bd56-d1962d606ec2 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:28.601136 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a205e84-655f-4bbc-bd56-d1962d606ec2 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:28.601561 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a205e84-655f-4bbc-bd56-d1962d606ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:28.629966 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-0a205e84-655f-4bbc-bd56-d1962d606ec2 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:28.631904 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-0a205e84-655f-4bbc-bd56-d1962d606ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:28.633614 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654f89b-f360-435b-967f-d9088d232f27 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:28.674681 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b9582-88ec-40fd-b143-3ce99722c940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:28.674681 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b9582-88ec-40fd-b143-3ce99722c940 None admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:28.675165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b9582-88ec-40fd-b143-3ce99722c940 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:28.675585 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b9582-88ec-40fd-b143-3ce99722c940 None admin] PATH_INFO: `/v3/projects/9d1d4b4ef82c4618beda78779862fc08/groups/2cb8aebaaa21420ea37fb2c6cbfe5ba5/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:28.679333 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b9582-88ec-40fd-b143-3ce99722c940 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d1d4b4ef82c4618beda78779862fc08, group_id=2cb8aebaaa21420ea37fb2c6cbfe5ba5, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:28.680933 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b9582-88ec-40fd-b143-3ce99722c940 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:28.706120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 207/405] 10.222.0.60 () {58 vars in 1442 bytes} [Thu May 12 09:20:28 2022] PUT /identity/v3/projects/9d1d4b4ef82c4618beda78779862fc08/groups/2cb8aebaaa21420ea37fb2c6cbfe5ba5/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:20:28.707003 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b9582-88ec-40fd-b143-3ce99722c940 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:28.735322 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 199/406] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:28.797543 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a205e84-655f-4bbc-bd56-d1962d606ec2 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:28.836723 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b9582-88ec-40fd-b143-3ce99722c940 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:28.884477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d167ac7-da2d-4c79-ab8a-325069fa5c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:28.885163 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d167ac7-da2d-4c79-ab8a-325069fa5c64 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:28.885446 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d167ac7-da2d-4c79-ab8a-325069fa5c64 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:28.885721 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d167ac7-da2d-4c79-ab8a-325069fa5c64 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:28.886514 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d167ac7-da2d-4c79-ab8a-325069fa5c64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:28.887372 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d167ac7-da2d-4c79-ab8a-325069fa5c64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:28.889224 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d167ac7-da2d-4c79-ab8a-325069fa5c64 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:28.899130 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 208/407] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:20:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:28.905568 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d167ac7-da2d-4c79-ab8a-325069fa5c64 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:28.976790 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a205e84-655f-4bbc-bd56-d1962d606ec2 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:29.010208 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d167ac7-da2d-4c79-ab8a-325069fa5c64 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:29.024082 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ac75d-307e-440a-93e0-9088a61559de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:29.024903 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ac75d-307e-440a-93e0-9088a61559de None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:29.025182 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ac75d-307e-440a-93e0-9088a61559de None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:29.025453 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ac75d-307e-440a-93e0-9088a61559de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:29.038689 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ac75d-307e-440a-93e0-9088a61559de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:29.046032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da6dd3-c2fb-4c6a-b922-1a8e1855ff74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:29.046904 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da6dd3-c2fb-4c6a-b922-1a8e1855ff74 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:29.047187 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da6dd3-c2fb-4c6a-b922-1a8e1855ff74 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:29.047465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da6dd3-c2fb-4c6a-b922-1a8e1855ff74 None admin] PATH_INFO: `/v3/groups/18679d69ce094eb599b7097d9a7302d2` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:29.047883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-a81ac75d-307e-440a-93e0-9088a61559de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 09:20:29.047883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:29.047883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:29.047883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:29.047883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:29.047883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:29.047883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:29.047883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:29.047883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:29.047883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:29.047883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:29.047883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:29.047883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:29.047883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:29.047883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:29.047883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:29.050357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:29.050357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:29.050357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:29.050357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:29.050357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:29.050357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:29.050357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:29.050357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:29.050357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:29.050357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:29.050357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:29.050357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:29.050357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:29.050357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:29.050357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:29.050357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:29.052462 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:29.052462 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:29.052462 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:29.052462 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:29.052462 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:29.052462 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:29.052462 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:29.052462 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:29.052462 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:29.052462 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:29.052462 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 09:20:29.052462 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:29.054060 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da6dd3-c2fb-4c6a-b922-1a8e1855ff74 None admin] RBAC: Authorizing `identity:get_group(group_id=18679d69ce094eb599b7097d9a7302d2)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:29.054223 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 200/408] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 12 09:20:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:20:29.054368 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da6dd3-c2fb-4c6a-b922-1a8e1855ff74 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:29.054368 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 209/409] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 12 09:20:28 2022] GET /identity/v3/groups/18679d69ce094eb599b7097d9a7302d2 => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:29.058032 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ac75d-307e-440a-93e0-9088a61559de None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:29.058245 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da6dd3-c2fb-4c6a-b922-1a8e1855ff74 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:29.169443 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ac75d-307e-440a-93e0-9088a61559de None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:29.175660 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da6dd3-c2fb-4c6a-b922-1a8e1855ff74 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:29.204075 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92acd4c-dedb-41db-9df3-66e7a8abf726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:29.204749 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92acd4c-dedb-41db-9df3-66e7a8abf726 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:29.205034 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92acd4c-dedb-41db-9df3-66e7a8abf726 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:29.205309 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92acd4c-dedb-41db-9df3-66e7a8abf726 None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:29.206161 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92acd4c-dedb-41db-9df3-66e7a8abf726 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:29.206485 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92acd4c-dedb-41db-9df3-66e7a8abf726 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:29.207995 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92acd4c-dedb-41db-9df3-66e7a8abf726 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:29.210737 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768fb77-3d1e-40ae-9775-edb1a123c798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:29.211614 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768fb77-3d1e-40ae-9775-edb1a123c798 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:29.211895 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768fb77-3d1e-40ae-9775-edb1a123c798 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:29.212169 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768fb77-3d1e-40ae-9775-edb1a123c798 None admin] PATH_INFO: `/v3/projects/796065237e2244ba911db9225d3aa52c` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:29.213383 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768fb77-3d1e-40ae-9775-edb1a123c798 None admin] RBAC: Authorizing `identity:get_project(project_id=796065237e2244ba911db9225d3aa52c)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:29.215451 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768fb77-3d1e-40ae-9775-edb1a123c798 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:29.217189 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 210/410] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:20:29 2022] GET /identity/v3/projects/796065237e2244ba911db9225d3aa52c => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:29.221626 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 201/411] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:20:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:29.223051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768fb77-3d1e-40ae-9775-edb1a123c798 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:29.224903 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92acd4c-dedb-41db-9df3-66e7a8abf726 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:29.323719 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768fb77-3d1e-40ae-9775-edb1a123c798 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:29.326474 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92acd4c-dedb-41db-9df3-66e7a8abf726 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:29.358907 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d59014-9f04-4bd6-8645-870407b52718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:29.359799 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d59014-9f04-4bd6-8645-870407b52718 None admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:29.360084 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d59014-9f04-4bd6-8645-870407b52718 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:29.360359 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d59014-9f04-4bd6-8645-870407b52718 None admin] PATH_INFO: `/v3/projects/796065237e2244ba911db9225d3aa52c/groups/18679d69ce094eb599b7097d9a7302d2/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:29.362177 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f7100-dee0-43d1-9b4b-21123f8f64d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:29.362396 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d59014-9f04-4bd6-8645-870407b52718 None admin] RBAC: Authorizing `identity:create_grant(project_id=796065237e2244ba911db9225d3aa52c, group_id=18679d69ce094eb599b7097d9a7302d2, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:29.363041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f7100-dee0-43d1-9b4b-21123f8f64d3 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:29.363325 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f7100-dee0-43d1-9b4b-21123f8f64d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:29.363601 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f7100-dee0-43d1-9b4b-21123f8f64d3 None admin] PATH_INFO: `/v3/groups/2cb8aebaaa21420ea37fb2c6cbfe5ba5` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:29.363827 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d59014-9f04-4bd6-8645-870407b52718 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:29.364794 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f7100-dee0-43d1-9b4b-21123f8f64d3 None admin] RBAC: Authorizing `identity:get_group(group_id=2cb8aebaaa21420ea37fb2c6cbfe5ba5)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:29.366249 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f7100-dee0-43d1-9b4b-21123f8f64d3 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:29.368317 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 202/412] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 12 09:20:29 2022] GET /identity/v3/groups/2cb8aebaaa21420ea37fb2c6cbfe5ba5 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:29.373998 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f7100-dee0-43d1-9b4b-21123f8f64d3 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:29.385909 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 211/413] 10.222.0.60 () {58 vars in 1442 bytes} [Thu May 12 09:20:29 2022] PUT /identity/v3/projects/796065237e2244ba911db9225d3aa52c/groups/18679d69ce094eb599b7097d9a7302d2/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:20:29.487009 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f7100-dee0-43d1-9b4b-21123f8f64d3 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:29.523859 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435bb92-ff54-466b-bb8a-c5bb96e6a289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:29.524746 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435bb92-ff54-466b-bb8a-c5bb96e6a289 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:29.525028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435bb92-ff54-466b-bb8a-c5bb96e6a289 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:29.525306 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435bb92-ff54-466b-bb8a-c5bb96e6a289 None admin] PATH_INFO: `/v3/projects/9d1d4b4ef82c4618beda78779862fc08` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:29.526579 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435bb92-ff54-466b-bb8a-c5bb96e6a289 None admin] RBAC: Authorizing `identity:get_project(project_id=9d1d4b4ef82c4618beda78779862fc08)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:29.528605 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435bb92-ff54-466b-bb8a-c5bb96e6a289 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:29.530837 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 203/414] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:20:29 2022] GET /identity/v3/projects/9d1d4b4ef82c4618beda78779862fc08 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:29.536308 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d59014-9f04-4bd6-8645-870407b52718 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:29.664962 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d59014-9f04-4bd6-8645-870407b52718 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:29.702300 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5b84b-e114-4cd4-bd89-c742c9afedef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:29.703256 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5b84b-e114-4cd4-bd89-c742c9afedef None admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:29.703546 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5b84b-e114-4cd4-bd89-c742c9afedef None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:29.703822 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5b84b-e114-4cd4-bd89-c742c9afedef None admin] PATH_INFO: `/v3/projects/9d1d4b4ef82c4618beda78779862fc08/groups/2cb8aebaaa21420ea37fb2c6cbfe5ba5/roles/7d5eb6a968a74fb0a30eb1e80603005c` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:29.707101 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5b84b-e114-4cd4-bd89-c742c9afedef None admin] RBAC: Authorizing `identity:create_grant(project_id=9d1d4b4ef82c4618beda78779862fc08, group_id=2cb8aebaaa21420ea37fb2c6cbfe5ba5, role_id=7d5eb6a968a74fb0a30eb1e80603005c)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:29.708555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5b84b-e114-4cd4-bd89-c742c9afedef None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:29.723581 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 212/415] 10.222.0.60 () {58 vars in 1442 bytes} [Thu May 12 09:20:29 2022] PUT /identity/v3/projects/9d1d4b4ef82c4618beda78779862fc08/groups/2cb8aebaaa21420ea37fb2c6cbfe5ba5/roles/7d5eb6a968a74fb0a30eb1e80603005c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:20:29.840109 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf46cb8-72f7-44e6-84d2-4de7a6b57354 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:29.840440 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf46cb8-72f7-44e6-84d2-4de7a6b57354 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:29.840669 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf46cb8-72f7-44e6-84d2-4de7a6b57354 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:29.842393 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 204/416] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:29.848218 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c3d30-ba25-40da-a7cb-8f1e38406919 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:29.848519 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c3d30-ba25-40da-a7cb-8f1e38406919 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:29.848774 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c3d30-ba25-40da-a7cb-8f1e38406919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:29.871848 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-305c3d30-ba25-40da-a7cb-8f1e38406919 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:29.873053 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-305c3d30-ba25-40da-a7cb-8f1e38406919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:29.973143 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 213/417] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:29.998785 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf46cb8-72f7-44e6-84d2-4de7a6b57354 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:30.143565 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf46cb8-72f7-44e6-84d2-4de7a6b57354 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:30.189363 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff48f46-c5aa-4cb3-82c9-d1da1de15f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:30.190197 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff48f46-c5aa-4cb3-82c9-d1da1de15f74 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:30.190491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff48f46-c5aa-4cb3-82c9-d1da1de15f74 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:30.190771 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff48f46-c5aa-4cb3-82c9-d1da1de15f74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:30.202161 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff48f46-c5aa-4cb3-82c9-d1da1de15f74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:30.218087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-fff48f46-c5aa-4cb3-82c9-d1da1de15f74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 09:20:30.218087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:30.218087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:30.218087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:30.218087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:30.218087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:30.218087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:30.218087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:30.218087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:30.218087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:30.218087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:30.218087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:30.218087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:30.218087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:30.218087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:30.218087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:30.219040 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:30.219040 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:30.219040 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:30.219040 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:30.219040 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:30.219040 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:30.219040 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:30.219040 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:30.219040 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:30.219040 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:30.219040 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:30.219040 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:30.219040 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:30.219040 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:30.219040 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:30.219040 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:30.219853 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:30.219853 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:30.219853 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:30.219853 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:30.219853 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:30.219853 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:30.219853 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:30.219853 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:30.219853 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:30.219853 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:30.219853 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 09:20:30.219853 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:30.219853 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 205/418] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:20:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:30.226788 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c3d30-ba25-40da-a7cb-8f1e38406919 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:30.345109 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c3d30-ba25-40da-a7cb-8f1e38406919 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:30.381549 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91396fdb-4450-4a42-8a2c-8ec02401e83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:30.382295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91396fdb-4450-4a42-8a2c-8ec02401e83b None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:30.382580 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91396fdb-4450-4a42-8a2c-8ec02401e83b None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:30.382856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91396fdb-4450-4a42-8a2c-8ec02401e83b None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:30.383636 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91396fdb-4450-4a42-8a2c-8ec02401e83b None admin] RBAC: Adding query filter params (name=member) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:30.383944 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91396fdb-4450-4a42-8a2c-8ec02401e83b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:30.385395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91396fdb-4450-4a42-8a2c-8ec02401e83b None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:30.396208 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 214/419] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 12 09:20:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:30.407017 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff48f46-c5aa-4cb3-82c9-d1da1de15f74 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:30.541543 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff48f46-c5aa-4cb3-82c9-d1da1de15f74 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:30.558587 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93ae4d-83e1-4bda-98e3-81b2d498c5cc None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:30.558920 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93ae4d-83e1-4bda-98e3-81b2d498c5cc None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:30.559157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93ae4d-83e1-4bda-98e3-81b2d498c5cc None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:30.560780 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 215/420] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:20:30.567038 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fae7e-2eea-4382-82a8-99076446640a None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:30.567328 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fae7e-2eea-4382-82a8-99076446640a None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:30.567649 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fae7e-2eea-4382-82a8-99076446640a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:30.579090 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94616a-e4f1-4e26-92a4-a06828ce7a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:30.579746 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94616a-e4f1-4e26-92a4-a06828ce7a0c None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:30.580271 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94616a-e4f1-4e26-92a4-a06828ce7a0c None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:30.580271 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94616a-e4f1-4e26-92a4-a06828ce7a0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:30.604147 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-d35fae7e-2eea-4382-82a8-99076446640a None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:30.610506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-d35fae7e-2eea-4382-82a8-99076446640a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:30.721924 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94616a-e4f1-4e26-92a4-a06828ce7a0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:30.721924 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94616a-e4f1-4e26-92a4-a06828ce7a0c None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:30.754171 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 216/421] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:30.798208 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fae7e-2eea-4382-82a8-99076446640a None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:30.868583 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 206/422] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:20:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:20:30.875330 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94616a-e4f1-4e26-92a4-a06828ce7a0c None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:30.967789 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fae7e-2eea-4382-82a8-99076446640a None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:31.031713 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0820f94-1343-4191-95b7-97dd636fe01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:31.032538 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0820f94-1343-4191-95b7-97dd636fe01f None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:31.032821 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0820f94-1343-4191-95b7-97dd636fe01f None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:31.033097 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0820f94-1343-4191-95b7-97dd636fe01f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:31.054978 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94616a-e4f1-4e26-92a4-a06828ce7a0c None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:31.064345 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0820f94-1343-4191-95b7-97dd636fe01f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:31.073862 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-b0820f94-1343-4191-95b7-97dd636fe01f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 09:20:31.073862 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:31.073862 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:31.073862 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:31.073862 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:31.073862 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:31.073862 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:31.073862 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:31.073862 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:31.073862 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:31.073862 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:31.073862 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:31.073862 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:31.073862 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:31.073862 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:31.073862 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:31.075420 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:31.075420 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:31.075420 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:31.075420 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:31.075420 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:31.075420 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:31.075420 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:31.075420 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:31.075420 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:31.075420 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:31.075420 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:31.075420 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:31.075420 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:31.075420 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:31.075420 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:31.075420 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:31.076224 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:31.076224 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:31.076224 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:31.076224 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:31.076224 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:31.076224 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:31.076224 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:31.076224 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:31.076224 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:31.076224 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:31.076224 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 09:20:31.076224 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:31.076224 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 217/423] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 12 09:20:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:31.081794 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0820f94-1343-4191-95b7-97dd636fe01f None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:31.132479 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd860c-e1cf-4874-8dd8-315fd89bb113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:31.133346 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd860c-e1cf-4874-8dd8-315fd89bb113 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:31.133626 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd860c-e1cf-4874-8dd8-315fd89bb113 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:31.133923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd860c-e1cf-4874-8dd8-315fd89bb113 None admin] PATH_INFO: `/v3/projects/43f5db26667c4824b9e1f2363e88395d` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:31.139772 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd860c-e1cf-4874-8dd8-315fd89bb113 None admin] RBAC: Authorizing `identity:get_project(project_id=43f5db26667c4824b9e1f2363e88395d)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:31.141348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd860c-e1cf-4874-8dd8-315fd89bb113 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:31.144889 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 207/424] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:20:30 2022] GET /identity/v3/projects/43f5db26667c4824b9e1f2363e88395d => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:31.150366 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd860c-e1cf-4874-8dd8-315fd89bb113 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:31.215819 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0820f94-1343-4191-95b7-97dd636fe01f None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:31.253346 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d30dc-7e0c-41a8-b998-89b6c1cb15f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:31.254111 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d30dc-7e0c-41a8-b998-89b6c1cb15f1 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:31.254396 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d30dc-7e0c-41a8-b998-89b6c1cb15f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:31.254673 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d30dc-7e0c-41a8-b998-89b6c1cb15f1 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:31.256116 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d30dc-7e0c-41a8-b998-89b6c1cb15f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:31.256427 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d30dc-7e0c-41a8-b998-89b6c1cb15f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:31.257989 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d30dc-7e0c-41a8-b998-89b6c1cb15f1 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:31.268027 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 218/425] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:20:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:31.273551 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d30dc-7e0c-41a8-b998-89b6c1cb15f1 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:31.365578 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd860c-e1cf-4874-8dd8-315fd89bb113 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:31.434755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086dde96-dbc4-4538-ac8d-d2c9261f3c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:31.435919 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dde96-dbc4-4538-ac8d-d2c9261f3c1e None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:31.436349 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dde96-dbc4-4538-ac8d-d2c9261f3c1e None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:31.436788 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dde96-dbc4-4538-ac8d-d2c9261f3c1e None admin] PATH_INFO: `/v3/groups/2cb8aebaaa21420ea37fb2c6cbfe5ba5` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:31.438170 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086dde96-dbc4-4538-ac8d-d2c9261f3c1e None admin] RBAC: Authorizing `identity:get_group(group_id=2cb8aebaaa21420ea37fb2c6cbfe5ba5)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:31.439607 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086dde96-dbc4-4538-ac8d-d2c9261f3c1e None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:31.441474 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 208/426] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 12 09:20:31 2022] GET /identity/v3/groups/2cb8aebaaa21420ea37fb2c6cbfe5ba5 => generated 226 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:31.444533 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d30dc-7e0c-41a8-b998-89b6c1cb15f1 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:31.446870 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086dde96-dbc4-4538-ac8d-d2c9261f3c1e None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:31.491865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14150c-d49b-4551-9445-ffa936fecbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:31.494025 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14150c-d49b-4551-9445-ffa936fecbf7 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:31.494524 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14150c-d49b-4551-9445-ffa936fecbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:31.495001 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14150c-d49b-4551-9445-ffa936fecbf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:31.613396 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14150c-d49b-4551-9445-ffa936fecbf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:31.615855 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14150c-d49b-4551-9445-ffa936fecbf7 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:31.645979 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086dde96-dbc4-4538-ac8d-d2c9261f3c1e None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:31.715951 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7f4c4-f4da-4adf-92a3-96ec2c7554ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:31.718345 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7f4c4-f4da-4adf-92a3-96ec2c7554ac None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:31.719057 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7f4c4-f4da-4adf-92a3-96ec2c7554ac None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:31.720518 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7f4c4-f4da-4adf-92a3-96ec2c7554ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:31.721563 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7f4c4-f4da-4adf-92a3-96ec2c7554ac None admin] RBAC: Adding query filter params (group.id=2cb8aebaaa21420ea37fb2c6cbfe5ba5, role.id=31076ec4ad6a42868d212118fe129d18, scope.project.id=43f5db26667c4824b9e1f2363e88395d) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:31.722765 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7f4c4-f4da-4adf-92a3-96ec2c7554ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:31.725103 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7f4c4-f4da-4adf-92a3-96ec2c7554ac None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:31.735385 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 209/427] 10.222.0.60 () {56 vars in 1376 bytes} [Thu May 12 09:20:31 2022] GET /identity/v3/role_assignments?group.id=2cb8aebaaa21420ea37fb2c6cbfe5ba5&scope.project.id=43f5db26667c4824b9e1f2363e88395d&role.id=31076ec4ad6a42868d212118fe129d18 => generated 611 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:31.802199 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 219/428] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:20:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 09:20:31.819734 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7f4c4-f4da-4adf-92a3-96ec2c7554ac None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:31.882713 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d77c0-376e-4a20-8fbb-e860ae937411 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:31.883335 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d77c0-376e-4a20-8fbb-e860ae937411 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:31.883834 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d77c0-376e-4a20-8fbb-e860ae937411 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:31.885567 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 220/429] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:31.891651 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcf39c-eca0-4c01-b20d-f0b945dcb047 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:31.892248 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcf39c-eca0-4c01-b20d-f0b945dcb047 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:31.892731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcf39c-eca0-4c01-b20d-f0b945dcb047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:31.926125 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-36bcf39c-eca0-4c01-b20d-f0b945dcb047 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:31.927657 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-36bcf39c-eca0-4c01-b20d-f0b945dcb047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:32.042317 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7f4c4-f4da-4adf-92a3-96ec2c7554ac None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:32.078481 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 221/430] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:32.105678 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a135416-82cd-4cb7-a2d0-490ae596aecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:32.110747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a135416-82cd-4cb7-a2d0-490ae596aecb None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:32.111027 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a135416-82cd-4cb7-a2d0-490ae596aecb None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:32.111310 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a135416-82cd-4cb7-a2d0-490ae596aecb None admin] PATH_INFO: `/v3/projects/43f5db26667c4824b9e1f2363e88395d` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:32.112852 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a135416-82cd-4cb7-a2d0-490ae596aecb None admin] RBAC: Authorizing `identity:get_project(project_id=43f5db26667c4824b9e1f2363e88395d)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:32.116624 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a135416-82cd-4cb7-a2d0-490ae596aecb None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:32.118679 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 210/431] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:20:31 2022] GET /identity/v3/projects/43f5db26667c4824b9e1f2363e88395d => generated 298 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:32.124255 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcf39c-eca0-4c01-b20d-f0b945dcb047 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:32.147100 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a135416-82cd-4cb7-a2d0-490ae596aecb None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:32.289662 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a135416-82cd-4cb7-a2d0-490ae596aecb None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:32.292663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcf39c-eca0-4c01-b20d-f0b945dcb047 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:32.332358 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624bcd5-bca3-4bff-8bb7-3c205c6a8b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:32.333576 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624bcd5-bca3-4bff-8bb7-3c205c6a8b08 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:32.334099 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624bcd5-bca3-4bff-8bb7-3c205c6a8b08 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:32.334510 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624bcd5-bca3-4bff-8bb7-3c205c6a8b08 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:32.346459 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4f53d-8bad-49b9-bd8e-bdc3140f252d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:32.348574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624bcd5-bca3-4bff-8bb7-3c205c6a8b08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:32.349347 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4f53d-8bad-49b9-bd8e-bdc3140f252d None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:32.349683 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4f53d-8bad-49b9-bd8e-bdc3140f252d None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:32.349992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4f53d-8bad-49b9-bd8e-bdc3140f252d None admin] PATH_INFO: `/v3/groups/2cb8aebaaa21420ea37fb2c6cbfe5ba5` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:32.351380 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4f53d-8bad-49b9-bd8e-bdc3140f252d None admin] RBAC: Authorizing `identity:get_group(group_id=2cb8aebaaa21420ea37fb2c6cbfe5ba5)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:32.353014 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4f53d-8bad-49b9-bd8e-bdc3140f252d None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:32.357703 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 222/432] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 12 09:20:32 2022] GET /identity/v3/groups/2cb8aebaaa21420ea37fb2c6cbfe5ba5 => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:32.359732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-d624bcd5-bca3-4bff-8bb7-3c205c6a8b08 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 09:20:32.359732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:32.359732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:32.359732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:32.359732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:32.359732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:32.359732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:32.359732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:32.359732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:32.359732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:32.359732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:32.359732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:32.359732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:32.359732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:32.359732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:32.359732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:32.360630 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:32.360630 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:32.360630 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:32.360630 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:32.360630 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:32.360630 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:32.360630 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:32.360630 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:32.360630 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:32.360630 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:32.360630 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:32.360630 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:32.360630 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:32.360630 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:32.360630 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:32.360630 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:32.361451 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:32.361451 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:32.361451 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:32.361451 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:32.361451 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:32.361451 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:32.361451 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:32.361451 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:32.361451 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:32.361451 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:32.361451 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 09:20:32.361451 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:32.364185 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 211/433] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:20:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:32.365500 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624bcd5-bca3-4bff-8bb7-3c205c6a8b08 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:32.365885 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d0a6b-9e92-4e86-8115-6fcc3dec83d1 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:32.372434 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d0a6b-9e92-4e86-8115-6fcc3dec83d1 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:32.372727 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d0a6b-9e92-4e86-8115-6fcc3dec83d1 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:32.374701 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 223/434] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:32 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:32.375469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d0a6b-9e92-4e86-8115-6fcc3dec83d1 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:32.484416 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624bcd5-bca3-4bff-8bb7-3c205c6a8b08 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:32.495310 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d0a6b-9e92-4e86-8115-6fcc3dec83d1 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:32.516916 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63080ff8-e3da-493d-a558-b51eed253041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:32.517569 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63080ff8-e3da-493d-a558-b51eed253041 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:32.517851 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63080ff8-e3da-493d-a558-b51eed253041 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:32.518150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63080ff8-e3da-493d-a558-b51eed253041 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:32.518973 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63080ff8-e3da-493d-a558-b51eed253041 None admin] RBAC: Adding query filter params (group.id=2cb8aebaaa21420ea37fb2c6cbfe5ba5, role.id=7d5eb6a968a74fb0a30eb1e80603005c, scope.project.id=43f5db26667c4824b9e1f2363e88395d) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:32.519289 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63080ff8-e3da-493d-a558-b51eed253041 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:32.520729 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63080ff8-e3da-493d-a558-b51eed253041 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:32.526299 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 212/435] 10.222.0.60 () {56 vars in 1376 bytes} [Thu May 12 09:20:32 2022] GET /identity/v3/role_assignments?group.id=2cb8aebaaa21420ea37fb2c6cbfe5ba5&scope.project.id=43f5db26667c4824b9e1f2363e88395d&role.id=7d5eb6a968a74fb0a30eb1e80603005c => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:32.528017 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf7a05-423b-43a1-a9eb-2d57145d9aaf None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:32.528126 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d69f9-af79-4443-a1bc-ce0b20ded3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:32.528311 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf7a05-423b-43a1-a9eb-2d57145d9aaf None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:32.528586 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf7a05-423b-43a1-a9eb-2d57145d9aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:32.528748 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d69f9-af79-4443-a1bc-ce0b20ded3ba None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:32.529027 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d69f9-af79-4443-a1bc-ce0b20ded3ba None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:32.529297 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d69f9-af79-4443-a1bc-ce0b20ded3ba None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:32.530123 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d69f9-af79-4443-a1bc-ce0b20ded3ba None admin] RBAC: Adding query filter params (name=member) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:32.530434 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d69f9-af79-4443-a1bc-ce0b20ded3ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:32.531798 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d69f9-af79-4443-a1bc-ce0b20ded3ba None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:32.540772 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 224/436] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 12 09:20:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:32.542164 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501249da-a732-4b14-95ab-9f265981f051 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:32.542450 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501249da-a732-4b14-95ab-9f265981f051 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:32.542719 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501249da-a732-4b14-95ab-9f265981f051 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:32.544633 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 225/437] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:32.549689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501249da-a732-4b14-95ab-9f265981f051 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:32.551597 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-bccf7a05-423b-43a1-a9eb-2d57145d9aaf None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:32.552805 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-bccf7a05-423b-43a1-a9eb-2d57145d9aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:32.622604 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 213/438] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:32.634278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a79480-1464-4b3a-84b6-6a6fca25e8dd None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:32.634278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a79480-1464-4b3a-84b6-6a6fca25e8dd None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:32.634278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a79480-1464-4b3a-84b6-6a6fca25e8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:32.650383 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-97a79480-1464-4b3a-84b6-6a6fca25e8dd None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:32.651601 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-97a79480-1464-4b3a-84b6-6a6fca25e8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:32.672002 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501249da-a732-4b14-95ab-9f265981f051 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:32.707070 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdaf91-fdde-49c9-a78d-fbe2433f58ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:32.707720 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdaf91-fdde-49c9-a78d-fbe2433f58ca None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:32.708033 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdaf91-fdde-49c9-a78d-fbe2433f58ca None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:32.708280 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdaf91-fdde-49c9-a78d-fbe2433f58ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:32.724914 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 214/439] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:32.725631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a79480-1464-4b3a-84b6-6a6fca25e8dd None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:32.782909 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccdaf91-fdde-49c9-a78d-fbe2433f58ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:32.784288 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccdaf91-fdde-49c9-a78d-fbe2433f58ca None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:32.832563 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a79480-1464-4b3a-84b6-6a6fca25e8dd None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:32.869393 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e609d13-ec2d-401b-a49f-1bcd8c24ad16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:32.870231 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e609d13-ec2d-401b-a49f-1bcd8c24ad16 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:32.870513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e609d13-ec2d-401b-a49f-1bcd8c24ad16 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:32.870789 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e609d13-ec2d-401b-a49f-1bcd8c24ad16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:32.888473 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e609d13-ec2d-401b-a49f-1bcd8c24ad16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:32.898923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-2e609d13-ec2d-401b-a49f-1bcd8c24ad16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:20:32.898923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:32.898923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:32.898923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:32.898923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:32.898923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:32.898923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:32.898923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:32.898923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:32.898923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:32.898923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:32.898923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:32.898923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:32.898923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:32.898923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:32.898923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:32.900046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:32.900046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:32.900046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:32.900046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:32.900046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:32.900046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:32.900046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:32.900046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:32.900046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:32.900046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:32.900046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:32.900046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:32.900046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:32.900046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:32.900046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:32.900046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:32.900880 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:32.900880 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:32.900880 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:32.900880 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:32.900880 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:32.900880 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:32.900880 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:32.900880 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:32.900880 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:32.900880 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:32.900880 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:20:32.900880 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:32.900880 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 215/440] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:20:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:32.900880 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e609d13-ec2d-401b-a49f-1bcd8c24ad16 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:32.904504 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 226/441] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:20:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:20:32.910084 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdaf91-fdde-49c9-a78d-fbe2433f58ca None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:33.002497 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e609d13-ec2d-401b-a49f-1bcd8c24ad16 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:33.007253 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdaf91-fdde-49c9-a78d-fbe2433f58ca None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:33.034144 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0aef5-7e8c-48fc-8242-73bdf66b31d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:33.034870 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0aef5-7e8c-48fc-8242-73bdf66b31d9 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:33.035148 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0aef5-7e8c-48fc-8242-73bdf66b31d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:33.035415 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0aef5-7e8c-48fc-8242-73bdf66b31d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:33.039535 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7197eb7-16f3-4a13-bffe-6a1530dd4cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:33.040390 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7197eb7-16f3-4a13-bffe-6a1530dd4cf8 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:33.040693 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7197eb7-16f3-4a13-bffe-6a1530dd4cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:33.040970 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7197eb7-16f3-4a13-bffe-6a1530dd4cf8 None admin] PATH_INFO: `/v3/projects/9d1d4b4ef82c4618beda78779862fc08` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:33.042208 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7197eb7-16f3-4a13-bffe-6a1530dd4cf8 None admin] RBAC: Authorizing `identity:get_project(project_id=9d1d4b4ef82c4618beda78779862fc08)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:33.043665 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7197eb7-16f3-4a13-bffe-6a1530dd4cf8 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:33.045013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0aef5-7e8c-48fc-8242-73bdf66b31d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:33.045330 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 227/442] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:20:32 2022] GET /identity/v3/projects/9d1d4b4ef82c4618beda78779862fc08 => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:33.046101 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7197eb7-16f3-4a13-bffe-6a1530dd4cf8 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:33.052962 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-38e0aef5-7e8c-48fc-8242-73bdf66b31d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 09:20:33.052962 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:33.052962 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:33.052962 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:33.052962 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:33.052962 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:33.052962 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:33.052962 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:33.052962 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:33.052962 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:33.052962 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:33.052962 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:33.052962 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:33.052962 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:33.052962 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:33.052962 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:33.054105 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:33.054105 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:33.054105 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:33.054105 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:33.054105 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:33.054105 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:33.054105 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:33.054105 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:33.054105 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:33.054105 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:33.054105 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:33.054105 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:33.054105 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:33.054105 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:33.054105 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:33.054105 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:33.055135 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:33.055135 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:33.055135 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:33.055135 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:33.055135 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:33.055135 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:33.055135 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:33.055135 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:33.055135 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:33.055135 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:33.055135 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 09:20:33.055135 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:33.055135 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 216/443] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 12 09:20:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:33.055135 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0aef5-7e8c-48fc-8242-73bdf66b31d9 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:33.141638 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7197eb7-16f3-4a13-bffe-6a1530dd4cf8 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:33.148593 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0aef5-7e8c-48fc-8242-73bdf66b31d9 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:33.173481 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea79e0-30c7-446f-9031-234799cf3020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:33.174172 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea79e0-30c7-446f-9031-234799cf3020 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:33.174454 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea79e0-30c7-446f-9031-234799cf3020 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:33.174725 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea79e0-30c7-446f-9031-234799cf3020 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:33.175458 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea79e0-30c7-446f-9031-234799cf3020 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:33.175763 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea79e0-30c7-446f-9031-234799cf3020 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:33.177114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea79e0-30c7-446f-9031-234799cf3020 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:33.180083 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d5c86-b716-4569-acaa-03b761672c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:33.180918 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d5c86-b716-4569-acaa-03b761672c01 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:33.181194 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d5c86-b716-4569-acaa-03b761672c01 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:33.181463 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d5c86-b716-4569-acaa-03b761672c01 None admin] PATH_INFO: `/v3/groups/2cb8aebaaa21420ea37fb2c6cbfe5ba5` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:33.182646 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d5c86-b716-4569-acaa-03b761672c01 None admin] RBAC: Authorizing `identity:get_group(group_id=2cb8aebaaa21420ea37fb2c6cbfe5ba5)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:33.184601 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d5c86-b716-4569-acaa-03b761672c01 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:33.185298 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 228/444] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:20:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:33.186109 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea79e0-30c7-446f-9031-234799cf3020 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:33.186482 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 217/445] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 12 09:20:33 2022] GET /identity/v3/groups/2cb8aebaaa21420ea37fb2c6cbfe5ba5 => generated 226 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:33.190601 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d5c86-b716-4569-acaa-03b761672c01 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:33.283552 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d5c86-b716-4569-acaa-03b761672c01 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:33.284289 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea79e0-30c7-446f-9031-234799cf3020 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:33.314793 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe3eb5-1d41-4a47-8c7e-ec8540a89ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:33.315070 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ad372-0fad-447f-a62c-4852429c8ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:33.315430 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe3eb5-1d41-4a47-8c7e-ec8540a89ff4 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:33.315713 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe3eb5-1d41-4a47-8c7e-ec8540a89ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:33.315814 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ad372-0fad-447f-a62c-4852429c8ad4 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:33.315986 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ad372-0fad-447f-a62c-4852429c8ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:33.316095 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe3eb5-1d41-4a47-8c7e-ec8540a89ff4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:33.316254 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ad372-0fad-447f-a62c-4852429c8ad4 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:33.316985 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ad372-0fad-447f-a62c-4852429c8ad4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:33.317286 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ad372-0fad-447f-a62c-4852429c8ad4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:33.318674 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ad372-0fad-447f-a62c-4852429c8ad4 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:33.326822 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 229/446] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:20:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:33.327600 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ad372-0fad-447f-a62c-4852429c8ad4 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:33.379557 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe3eb5-1d41-4a47-8c7e-ec8540a89ff4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:33.381269 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe3eb5-1d41-4a47-8c7e-ec8540a89ff4 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:33.419111 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ad372-0fad-447f-a62c-4852429c8ad4 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:33.450009 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1fe549-36c9-403c-9bd0-f3402f2f281d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:33.450642 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fe549-36c9-403c-9bd0-f3402f2f281d None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:33.450927 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fe549-36c9-403c-9bd0-f3402f2f281d None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:33.451196 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fe549-36c9-403c-9bd0-f3402f2f281d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:33.452001 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1fe549-36c9-403c-9bd0-f3402f2f281d None admin] RBAC: Adding query filter params (group.id=2cb8aebaaa21420ea37fb2c6cbfe5ba5, role.id=31076ec4ad6a42868d212118fe129d18, scope.project.id=9d1d4b4ef82c4618beda78779862fc08) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:33.452306 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1fe549-36c9-403c-9bd0-f3402f2f281d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:33.453709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1fe549-36c9-403c-9bd0-f3402f2f281d None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:33.459257 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 230/447] 10.222.0.60 () {56 vars in 1376 bytes} [Thu May 12 09:20:33 2022] GET /identity/v3/role_assignments?group.id=2cb8aebaaa21420ea37fb2c6cbfe5ba5&scope.project.id=9d1d4b4ef82c4618beda78779862fc08&role.id=31076ec4ad6a42868d212118fe129d18 => generated 611 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:33.460014 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1fe549-36c9-403c-9bd0-f3402f2f281d None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:33.473268 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 218/448] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:20:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 09:20:33.479219 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe3eb5-1d41-4a47-8c7e-ec8540a89ff4 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:33.581951 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe3eb5-1d41-4a47-8c7e-ec8540a89ff4 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:33.582137 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1fe549-36c9-403c-9bd0-f3402f2f281d None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:33.619620 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ef2ed-2c8a-4b17-ba32-7ad88e08f265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:33.620150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d5aab-e859-42ec-9732-87989343aaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:33.620476 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ef2ed-2c8a-4b17-ba32-7ad88e08f265 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:33.620752 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ef2ed-2c8a-4b17-ba32-7ad88e08f265 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:33.620852 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d5aab-e859-42ec-9732-87989343aaa4 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:33.621167 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ef2ed-2c8a-4b17-ba32-7ad88e08f265 None admin] PATH_INFO: `/v3/projects/796065237e2244ba911db9225d3aa52c` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:33.621778 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d5aab-e859-42ec-9732-87989343aaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:33.621989 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d5aab-e859-42ec-9732-87989343aaa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:33.623401 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ef2ed-2c8a-4b17-ba32-7ad88e08f265 None admin] RBAC: Authorizing `identity:get_project(project_id=796065237e2244ba911db9225d3aa52c)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:33.624915 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ef2ed-2c8a-4b17-ba32-7ad88e08f265 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:33.629952 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 219/449] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:20:33 2022] GET /identity/v3/projects/796065237e2244ba911db9225d3aa52c => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:33.632517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ef2ed-2c8a-4b17-ba32-7ad88e08f265 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:33.702978 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d5aab-e859-42ec-9732-87989343aaa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:33.705088 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d5aab-e859-42ec-9732-87989343aaa4 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:33.749274 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ef2ed-2c8a-4b17-ba32-7ad88e08f265 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:33.786809 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6982b-9123-43f5-8b3b-4e74ff60b164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:33.787741 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6982b-9123-43f5-8b3b-4e74ff60b164 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:33.787938 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6982b-9123-43f5-8b3b-4e74ff60b164 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:33.788203 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6982b-9123-43f5-8b3b-4e74ff60b164 None admin] PATH_INFO: `/v3/groups/18679d69ce094eb599b7097d9a7302d2` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:33.789384 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6982b-9123-43f5-8b3b-4e74ff60b164 None admin] RBAC: Authorizing `identity:get_group(group_id=18679d69ce094eb599b7097d9a7302d2)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:33.790851 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6982b-9123-43f5-8b3b-4e74ff60b164 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:33.792456 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 220/450] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 12 09:20:33 2022] GET /identity/v3/groups/18679d69ce094eb599b7097d9a7302d2 => generated 229 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:33.798288 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6982b-9123-43f5-8b3b-4e74ff60b164 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:33.817792 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 231/451] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:20:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:20:33.824913 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d5aab-e859-42ec-9732-87989343aaa4 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:33.899700 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6982b-9123-43f5-8b3b-4e74ff60b164 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:33.917801 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d5aab-e859-42ec-9732-87989343aaa4 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:33.932407 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa734bc-cfc0-4913-87c4-fdea035661ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:33.933047 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa734bc-cfc0-4913-87c4-fdea035661ef None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:33.933323 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa734bc-cfc0-4913-87c4-fdea035661ef None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:33.934134 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa734bc-cfc0-4913-87c4-fdea035661ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:33.934946 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa734bc-cfc0-4913-87c4-fdea035661ef None admin] RBAC: Adding query filter params (group.id=18679d69ce094eb599b7097d9a7302d2, role.id=8f01c4c38fa44034a54c1f8cd2d2db1a, scope.project.id=796065237e2244ba911db9225d3aa52c) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:33.935248 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa734bc-cfc0-4913-87c4-fdea035661ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:33.936677 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa734bc-cfc0-4913-87c4-fdea035661ef None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:33.942195 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 221/452] 10.222.0.60 () {56 vars in 1376 bytes} [Thu May 12 09:20:33 2022] GET /identity/v3/role_assignments?group.id=18679d69ce094eb599b7097d9a7302d2&scope.project.id=796065237e2244ba911db9225d3aa52c&role.id=8f01c4c38fa44034a54c1f8cd2d2db1a => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:33.950304 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541f9ac-5e77-4494-a5a7-5ae28f0bf0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:33.951197 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541f9ac-5e77-4494-a5a7-5ae28f0bf0fe None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:33.951473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541f9ac-5e77-4494-a5a7-5ae28f0bf0fe None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:33.951743 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541f9ac-5e77-4494-a5a7-5ae28f0bf0fe None admin] PATH_INFO: `/v3/projects/9d1d4b4ef82c4618beda78779862fc08` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:33.953011 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541f9ac-5e77-4494-a5a7-5ae28f0bf0fe None admin] RBAC: Authorizing `identity:get_project(project_id=9d1d4b4ef82c4618beda78779862fc08)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:33.954521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541f9ac-5e77-4494-a5a7-5ae28f0bf0fe None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:33.956284 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 232/453] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:20:33 2022] GET /identity/v3/projects/9d1d4b4ef82c4618beda78779862fc08 => generated 302 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:33.962068 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa734bc-cfc0-4913-87c4-fdea035661ef None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:34.064655 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa734bc-cfc0-4913-87c4-fdea035661ef None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:34.097699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a53938-8eae-4704-906d-8c1490c2eabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:34.100454 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a53938-8eae-4704-906d-8c1490c2eabf None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:34.100454 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a53938-8eae-4704-906d-8c1490c2eabf None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:34.100454 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a53938-8eae-4704-906d-8c1490c2eabf None admin] PATH_INFO: `/v3/groups/2cb8aebaaa21420ea37fb2c6cbfe5ba5` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:34.100454 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a53938-8eae-4704-906d-8c1490c2eabf None admin] RBAC: Authorizing `identity:get_group(group_id=2cb8aebaaa21420ea37fb2c6cbfe5ba5)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:34.101847 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a53938-8eae-4704-906d-8c1490c2eabf None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:34.103567 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 222/454] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 12 09:20:33 2022] GET /identity/v3/groups/2cb8aebaaa21420ea37fb2c6cbfe5ba5 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:34.109838 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541f9ac-5e77-4494-a5a7-5ae28f0bf0fe None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:34.204769 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541f9ac-5e77-4494-a5a7-5ae28f0bf0fe None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:34.235956 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316c65f-91e5-4612-b131-45be496ed4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:34.236595 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316c65f-91e5-4612-b131-45be496ed4cb None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:34.236876 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316c65f-91e5-4612-b131-45be496ed4cb None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:34.237148 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316c65f-91e5-4612-b131-45be496ed4cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:34.237982 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316c65f-91e5-4612-b131-45be496ed4cb None admin] RBAC: Adding query filter params (group.id=2cb8aebaaa21420ea37fb2c6cbfe5ba5, role.id=7d5eb6a968a74fb0a30eb1e80603005c, scope.project.id=9d1d4b4ef82c4618beda78779862fc08) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:34.238290 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316c65f-91e5-4612-b131-45be496ed4cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:34.239699 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316c65f-91e5-4612-b131-45be496ed4cb None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:34.245160 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 233/455] 10.222.0.60 () {56 vars in 1376 bytes} [Thu May 12 09:20:34 2022] GET /identity/v3/role_assignments?group.id=2cb8aebaaa21420ea37fb2c6cbfe5ba5&scope.project.id=9d1d4b4ef82c4618beda78779862fc08&role.id=7d5eb6a968a74fb0a30eb1e80603005c => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:37.259781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed91c1d-00a1-43b8-99d3-de1c4c493ff2 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:37.260832 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed91c1d-00a1-43b8-99d3-de1c4c493ff2 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:37.261330 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed91c1d-00a1-43b8-99d3-de1c4c493ff2 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:37.263223 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 223/456] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:37.268659 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a8ecd-a3cc-4cd8-85ee-e849b020cc61 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:37.269481 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a8ecd-a3cc-4cd8-85ee-e849b020cc61 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:37.269990 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a8ecd-a3cc-4cd8-85ee-e849b020cc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:37.290942 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-2d8a8ecd-a3cc-4cd8-85ee-e849b020cc61 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:37.292142 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-2d8a8ecd-a3cc-4cd8-85ee-e849b020cc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:37.310765 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c959ce-aa63-4657-8b77-61cf9dee6647 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:37.311053 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c959ce-aa63-4657-8b77-61cf9dee6647 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:37.311321 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c959ce-aa63-4657-8b77-61cf9dee6647 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:37.313134 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 224/457] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:20:37.317874 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df221e60-9eb3-4eb7-8e68-a536fc8ae2c1 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:37.318378 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df221e60-9eb3-4eb7-8e68-a536fc8ae2c1 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:37.318834 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df221e60-9eb3-4eb7-8e68-a536fc8ae2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:37.345822 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-df221e60-9eb3-4eb7-8e68-a536fc8ae2c1 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:37.347496 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-df221e60-9eb3-4eb7-8e68-a536fc8ae2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:37.377802 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 234/458] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:37.379158 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1087a-e66b-4bbd-969f-708d6ff8097e None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:37.379622 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1087a-e66b-4bbd-969f-708d6ff8097e None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:37.380050 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1087a-e66b-4bbd-969f-708d6ff8097e None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:37.382203 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 235/459] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:37.395888 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e83c6-e70a-4fd4-80e2-5e40a1b4d8ec None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:37.396402 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e83c6-e70a-4fd4-80e2-5e40a1b4d8ec None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:37.396825 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e83c6-e70a-4fd4-80e2-5e40a1b4d8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:37.424582 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-9d3e83c6-e70a-4fd4-80e2-5e40a1b4d8ec None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:37.426028 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-9d3e83c6-e70a-4fd4-80e2-5e40a1b4d8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:37.446030 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 225/460] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:20:37.447339 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df221e60-9eb3-4eb7-8e68-a536fc8ae2c1 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:37.496701 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 236/461] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:37.497939 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e83c6-e70a-4fd4-80e2-5e40a1b4d8ec None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:37.570748 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df221e60-9eb3-4eb7-8e68-a536fc8ae2c1 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:37.613492 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6e9bd-f178-4ee7-9e2e-4553c8686967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:37.614728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6e9bd-f178-4ee7-9e2e-4553c8686967 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:37.615450 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6e9bd-f178-4ee7-9e2e-4553c8686967 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:37.616128 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6e9bd-f178-4ee7-9e2e-4553c8686967 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:37.618105 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e83c6-e70a-4fd4-80e2-5e40a1b4d8ec None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:37.628805 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6e9bd-f178-4ee7-9e2e-4553c8686967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:37.631064 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6e9bd-f178-4ee7-9e2e-4553c8686967 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:37.652984 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-27a6e9bd-f178-4ee7-9e2e-4553c8686967 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:37.652984 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:37.652984 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:37.652984 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:37.652984 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:37.652984 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:37.652984 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:37.652984 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:37.652984 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:37.652984 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:37.652984 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:37.652984 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:37.652984 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:37.652984 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:37.652984 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:37.654119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:37.654119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:37.654119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:37.654119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:37.654119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:37.654119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:37.654119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:37.654119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:37.654119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:37.654119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:37.654119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:37.654119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:37.654119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:37.654119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:37.654119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:37.654119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:37.654119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:37.655085 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:37.655085 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:37.655085 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:37.655085 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:37.655085 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 226/462] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:37.655085 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6e9bd-f178-4ee7-9e2e-4553c8686967 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:37.660356 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e40850-4466-4f64-ac3e-640eb410c2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:37.661530 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e40850-4466-4f64-ac3e-640eb410c2b2 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:37.662065 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e40850-4466-4f64-ac3e-640eb410c2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:37.662518 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e40850-4466-4f64-ac3e-640eb410c2b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:37.673380 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e40850-4466-4f64-ac3e-640eb410c2b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:37.674902 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e40850-4466-4f64-ac3e-640eb410c2b2 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:37.692876 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-70e40850-4466-4f64-ac3e-640eb410c2b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:37.692876 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:37.692876 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:37.692876 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:37.692876 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:37.692876 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:37.692876 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:37.692876 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:37.692876 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:37.692876 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:37.692876 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:37.692876 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:37.692876 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:37.692876 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:37.692876 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:37.693734 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:37.693734 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:37.693734 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:37.693734 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:37.693734 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:37.693734 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:37.693734 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:37.693734 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:37.693734 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:37.693734 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:37.693734 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:37.693734 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:37.693734 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:37.693734 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:37.693734 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:37.693734 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:37.693734 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:37.694631 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:37.694631 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:37.694631 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:37.694631 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:37.694631 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 237/463] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:37.694895 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e40850-4466-4f64-ac3e-640eb410c2b2 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:37.753959 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6e9bd-f178-4ee7-9e2e-4553c8686967 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:37.786745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021fb763-994b-44c1-8651-6c1af9d7397c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:37.787553 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fb763-994b-44c1-8651-6c1af9d7397c None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:37.787833 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fb763-994b-44c1-8651-6c1af9d7397c None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:37.788102 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fb763-994b-44c1-8651-6c1af9d7397c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:37.790158 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e40850-4466-4f64-ac3e-640eb410c2b2 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:37.798161 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021fb763-994b-44c1-8651-6c1af9d7397c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:37.799616 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021fb763-994b-44c1-8651-6c1af9d7397c None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:37.816887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-021fb763-994b-44c1-8651-6c1af9d7397c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:37.816887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:37.816887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:37.816887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:37.816887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:37.816887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:37.816887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:37.816887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:37.816887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:37.816887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:37.816887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:37.816887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:37.816887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:37.816887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:37.816887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:37.817768 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:37.817768 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:37.817768 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:37.817768 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:37.817768 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:37.817768 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:37.817768 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:37.817768 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:37.817768 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:37.817768 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:37.817768 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:37.817768 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:37.817768 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:37.817768 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:37.817768 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:37.817768 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:37.817768 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:37.823793 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:37.823793 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:37.823793 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:37.823793 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:37.823793 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 227/464] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:37.823793 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc93ae1-fa16-4f6f-8438-c7837c6f3b9b None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:37.823793 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc93ae1-fa16-4f6f-8438-c7837c6f3b9b None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:37.823793 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc93ae1-fa16-4f6f-8438-c7837c6f3b9b None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:37.823793 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 228/465] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:37.824340 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc93ae1-fa16-4f6f-8438-c7837c6f3b9b None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:37.830074 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83b7f6-c604-4b85-a812-113c03bf7893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:37.830760 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83b7f6-c604-4b85-a812-113c03bf7893 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:37.831042 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83b7f6-c604-4b85-a812-113c03bf7893 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:37.831306 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83b7f6-c604-4b85-a812-113c03bf7893 None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:37.832023 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83b7f6-c604-4b85-a812-113c03bf7893 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:37.832325 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83b7f6-c604-4b85-a812-113c03bf7893 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:37.833676 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83b7f6-c604-4b85-a812-113c03bf7893 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:37.849969 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 238/466] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:37.849969 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83b7f6-c604-4b85-a812-113c03bf7893 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:37.930961 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc93ae1-fa16-4f6f-8438-c7837c6f3b9b None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:37.950601 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83b7f6-c604-4b85-a812-113c03bf7893 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:37.966053 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cac96-a13d-458c-9716-efec8d658705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:37.966682 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cac96-a13d-458c-9716-efec8d658705 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:37.966960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cac96-a13d-458c-9716-efec8d658705 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:37.967227 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cac96-a13d-458c-9716-efec8d658705 None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:37.967936 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622cac96-a13d-458c-9716-efec8d658705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:37.968237 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622cac96-a13d-458c-9716-efec8d658705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:37.969598 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622cac96-a13d-458c-9716-efec8d658705 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:37.985829 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65770813-adf8-4462-b9f8-1df9aa1fc7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:37.986764 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65770813-adf8-4462-b9f8-1df9aa1fc7eb None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:37.986873 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 229/467] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:37.987275 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65770813-adf8-4462-b9f8-1df9aa1fc7eb None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:37.987683 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65770813-adf8-4462-b9f8-1df9aa1fc7eb None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:37.988038 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35c6d9-a919-45a6-b9c0-c00e7c732d9d None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:37.988319 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35c6d9-a919-45a6-b9c0-c00e7c732d9d None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:37.988591 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35c6d9-a919-45a6-b9c0-c00e7c732d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:37.988967 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65770813-adf8-4462-b9f8-1df9aa1fc7eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:37.989401 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65770813-adf8-4462-b9f8-1df9aa1fc7eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:37.990946 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65770813-adf8-4462-b9f8-1df9aa1fc7eb None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:38.006063 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 239/468] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:38.007345 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65770813-adf8-4462-b9f8-1df9aa1fc7eb None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:38.008689 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-9e35c6d9-a919-45a6-b9c0-c00e7c732d9d None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:38.009877 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-9e35c6d9-a919-45a6-b9c0-c00e7c732d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:38.075461 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 230/469] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:38.076600 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e35c6d9-a919-45a6-b9c0-c00e7c732d9d None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:38.120788 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65770813-adf8-4462-b9f8-1df9aa1fc7eb None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:38.153784 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f1705-8098-41d1-901e-8441faf1075f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:38.154489 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f1705-8098-41d1-901e-8441faf1075f None admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:38.154766 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f1705-8098-41d1-901e-8441faf1075f None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:38.155035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f1705-8098-41d1-901e-8441faf1075f None admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:38.155729 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f1705-8098-41d1-901e-8441faf1075f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:38.157150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f1705-8098-41d1-901e-8441faf1075f None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:38.186017 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 240/470] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 12 09:20:38 2022] POST /identity/v3/users => generated 248 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:20:38.186017 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f1705-8098-41d1-901e-8441faf1075f None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:38.186327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e35c6d9-a919-45a6-b9c0-c00e7c732d9d None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:38.215799 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b7e4a-7ae9-4736-b188-37d208f88776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:38.216637 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b7e4a-7ae9-4736-b188-37d208f88776 None admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:38.216991 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b7e4a-7ae9-4736-b188-37d208f88776 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:38.217272 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b7e4a-7ae9-4736-b188-37d208f88776 None admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:38.218016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b7e4a-7ae9-4736-b188-37d208f88776 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:38.219502 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b7e4a-7ae9-4736-b188-37d208f88776 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:38.249948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 231/471] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 12 09:20:38 2022] POST /identity/v3/users => generated 246 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:20:38.250985 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b7e4a-7ae9-4736-b188-37d208f88776 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:38.388477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f1705-8098-41d1-901e-8441faf1075f None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:38.436830 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e1616-c584-4b92-94c1-76e013db6b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:38.437452 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e1616-c584-4b92-94c1-76e013db6b30 None admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:38.437736 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e1616-c584-4b92-94c1-76e013db6b30 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:38.438050 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e1616-c584-4b92-94c1-76e013db6b30 None admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:38.438776 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e1616-c584-4b92-94c1-76e013db6b30 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:38.440253 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e1616-c584-4b92-94c1-76e013db6b30 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:38.444341 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b7e4a-7ae9-4736-b188-37d208f88776 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:38.469341 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 241/472] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 12 09:20:38 2022] POST /identity/v3/users => generated 248 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:20:38.493767 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a476d-0f1b-4a77-b055-d63ee0cbb482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:38.494992 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a476d-0f1b-4a77-b055-d63ee0cbb482 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:38.495447 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a476d-0f1b-4a77-b055-d63ee0cbb482 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:38.495931 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a476d-0f1b-4a77-b055-d63ee0cbb482 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:38.508293 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a476d-0f1b-4a77-b055-d63ee0cbb482 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:38.509779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a476d-0f1b-4a77-b055-d63ee0cbb482 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:38.528783 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-909a476d-0f1b-4a77-b055-d63ee0cbb482 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:38.528783 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:38.528783 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:38.528783 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:38.528783 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:38.528783 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:38.528783 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:38.528783 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:38.528783 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:38.528783 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:38.528783 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:38.528783 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:38.528783 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:38.528783 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:38.528783 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:38.529708 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:38.529708 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:38.529708 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:38.529708 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:38.529708 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:38.529708 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:38.529708 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:38.529708 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:38.529708 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:38.529708 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:38.529708 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:38.529708 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:38.529708 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:38.529708 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:38.529708 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:38.529708 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:38.529708 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:38.530638 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:38.530638 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:38.530638 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:38.530638 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:38.530638 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 232/473] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:38.537184 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e1616-c584-4b92-94c1-76e013db6b30 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:38.546258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7183d-f6ae-401e-9dd4-80af3f83d401 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:38.546892 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7183d-f6ae-401e-9dd4-80af3f83d401 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:38.547356 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7183d-f6ae-401e-9dd4-80af3f83d401 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:38.550056 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 233/474] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:20:38.555735 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0137c0c-7f6e-472a-8685-329f064e6473 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:38.556456 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0137c0c-7f6e-472a-8685-329f064e6473 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:38.556920 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0137c0c-7f6e-472a-8685-329f064e6473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:38.575409 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-e0137c0c-7f6e-472a-8685-329f064e6473 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:38.576937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-e0137c0c-7f6e-472a-8685-329f064e6473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:38.660122 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 234/475] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:20:38.677238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e1616-c584-4b92-94c1-76e013db6b30 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:38.688862 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0137c0c-7f6e-472a-8685-329f064e6473 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:38.713869 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63257d73-41fa-4016-aa3a-842e8cdcb20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:38.714967 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63257d73-41fa-4016-aa3a-842e8cdcb20d None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:38.715450 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63257d73-41fa-4016-aa3a-842e8cdcb20d None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:38.715943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63257d73-41fa-4016-aa3a-842e8cdcb20d None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:38.716861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63257d73-41fa-4016-aa3a-842e8cdcb20d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:38.717381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63257d73-41fa-4016-aa3a-842e8cdcb20d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:38.719463 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63257d73-41fa-4016-aa3a-842e8cdcb20d None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:38.732932 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 242/476] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:38.738654 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63257d73-41fa-4016-aa3a-842e8cdcb20d None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:38.792621 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0137c0c-7f6e-472a-8685-329f064e6473 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:38.828346 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def80238-5783-4aa4-beb6-f44e18370c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:38.829026 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def80238-5783-4aa4-beb6-f44e18370c0f None admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:38.829307 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def80238-5783-4aa4-beb6-f44e18370c0f None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:38.829584 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def80238-5783-4aa4-beb6-f44e18370c0f None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:38.830369 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def80238-5783-4aa4-beb6-f44e18370c0f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:38.831778 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def80238-5783-4aa4-beb6-f44e18370c0f None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:38.841570 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.sql.core [None req-def80238-5783-4aa4-beb6-f44e18370c0f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 12 09:20:38.841570 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 12 09:20:38.841570 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [parameters: {'id': '75dbcb8938f74d69b041d0b19edaf757', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 12 09:20:38.841570 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79815) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 12 09:20:38.844260 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63257d73-41fa-4016-aa3a-842e8cdcb20d None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:38.859361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-def80238-5783-4aa4-beb6-f44e18370c0f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 12 09:20:38.859361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:38.859361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 09:20:38.859361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 09:20:38.859361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 09:20:38.859361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 09:20:38.859361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 09:20:38.859361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application result = self._query(query) May 12 09:20:38.859361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 09:20:38.859361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application conn.query(q) May 12 09:20:38.859361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 09:20:38.859361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 09:20:38.859361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 09:20:38.859361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application result.read() May 12 09:20:38.859361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 09:20:38.860304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 09:20:38.860304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 09:20:38.860304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 09:20:38.860304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 09:20:38.860304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 09:20:38.860304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 09:20:38.860304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 09:20:38.860304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 12 09:20:38.860304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:38.860304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 12 09:20:38.860304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:38.860304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:38.860304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 12 09:20:38.860304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 12 09:20:38.860304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 12 09:20:38.860304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return ref.to_dict() May 12 09:20:38.860304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 09:20:38.860304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application next(self.gen) May 12 09:20:38.861228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 12 09:20:38.861228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application yield resource May 12 09:20:38.861228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 09:20:38.861228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application next(self.gen) May 12 09:20:38.861228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 12 09:20:38.861228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application self.session.rollback() May 12 09:20:38.861228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 09:20:38.861228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application self.force_reraise() May 12 09:20:38.861228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 09:20:38.861228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise self.value May 12 09:20:38.861228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 12 09:20:38.861228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 12 09:20:38.861228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 12 09:20:38.861228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application session.commit() May 12 09:20:38.861228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 12 09:20:38.861228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 12 09:20:38.861228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 12 09:20:38.864818 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application self._prepare_impl() May 12 09:20:38.864818 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 12 09:20:38.864818 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application self.session.flush() May 12 09:20:38.864818 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 12 09:20:38.864818 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application self._flush(objects) May 12 09:20:38.864818 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 12 09:20:38.864818 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 12 09:20:38.864818 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 12 09:20:38.864818 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application compat.raise_( May 12 09:20:38.864818 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 09:20:38.864818 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception May 12 09:20:38.864818 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 12 09:20:38.864818 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application flush_context.execute() May 12 09:20:38.864818 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 12 09:20:38.864818 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rec.execute(self) May 12 09:20:38.864818 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 12 09:20:38.864818 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 12 09:20:38.865754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 12 09:20:38.865754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application _emit_insert_statements( May 12 09:20:38.865754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 12 09:20:38.865754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application c = connection._execute_20( May 12 09:20:38.865754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 12 09:20:38.865754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 12 09:20:38.865754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 12 09:20:38.865754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 12 09:20:38.865754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 12 09:20:38.865754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ret = self._execute_context( May 12 09:20:38.865754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 12 09:20:38.865754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 12 09:20:38.865754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 12 09:20:38.865754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 12 09:20:38.865754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 09:20:38.865754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception May 12 09:20:38.867179 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 09:20:38.867179 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 09:20:38.867179 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 09:20:38.867179 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 09:20:38.867179 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 09:20:38.867179 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application result = self._query(query) May 12 09:20:38.867179 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 09:20:38.867179 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application conn.query(q) May 12 09:20:38.867179 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 09:20:38.867179 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 09:20:38.867179 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 09:20:38.867179 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application result.read() May 12 09:20:38.867179 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 09:20:38.867179 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 09:20:38.867179 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 09:20:38.867179 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 09:20:38.868019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 09:20:38.868019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 09:20:38.868019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 09:20:38.868019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 09:20:38.868019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 12 09:20:38.868019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 12 09:20:38.868019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [parameters: {'id': '75dbcb8938f74d69b041d0b19edaf757', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 12 09:20:38.868019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 12 09:20:38.868019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:38.868019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 09:20:38.868019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:38.868019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:38.868019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:38.868019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:38.868019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:38.868019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:38.869169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:38.869169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:38.869169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:38.869169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:38.869169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:38.869169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:38.869169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 12 09:20:38.869169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 12 09:20:38.869169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:38.869169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:38.869169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 12 09:20:38.869169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 12 09:20:38.869169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 12 09:20:38.869169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 12 09:20:38.869169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 12 09:20:38.869169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:38.870014 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 235/477] 10.222.0.60 () {60 vars in 1131 bytes} [Thu May 12 09:20:38 2022] POST /identity/v3/roles => generated 144 bytes in 173 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 12 09:20:38.870014 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def80238-5783-4aa4-beb6-f44e18370c0f None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:38.896182 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2772da0-74d6-4087-9138-ef0060bca947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:38.897180 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2772da0-74d6-4087-9138-ef0060bca947 None admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:38.897640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2772da0-74d6-4087-9138-ef0060bca947 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:38.898166 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2772da0-74d6-4087-9138-ef0060bca947 None admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:38.899612 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2772da0-74d6-4087-9138-ef0060bca947 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:38.901780 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2772da0-74d6-4087-9138-ef0060bca947 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:38.929499 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 243/478] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 12 09:20:38 2022] POST /identity/v3/users => generated 249 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:20:38.992377 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def80238-5783-4aa4-beb6-f44e18370c0f None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:39.032259 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b1cc2-5f59-446a-b61b-32f64143f516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:39.033087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b1cc2-5f59-446a-b61b-32f64143f516 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:39.033371 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b1cc2-5f59-446a-b61b-32f64143f516 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:39.033651 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b1cc2-5f59-446a-b61b-32f64143f516 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:39.051906 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b1cc2-5f59-446a-b61b-32f64143f516 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:39.061024 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-5e1b1cc2-5f59-446a-b61b-32f64143f516 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 09:20:39.061024 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:39.061024 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:39.061024 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:39.061024 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:39.061024 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:39.061024 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:39.061024 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:39.061024 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:39.061024 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:39.061024 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:39.061024 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:39.061024 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:39.061024 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:39.061024 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:39.061024 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:39.062215 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:39.062215 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:39.062215 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:39.062215 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:39.062215 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:39.062215 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:39.062215 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:39.062215 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:39.062215 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:39.062215 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:39.062215 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:39.062215 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:39.062215 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:39.062215 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:39.062215 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:39.062215 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:39.063303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:39.063303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:39.063303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:39.063303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:39.063303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:39.063303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:39.063303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:39.063303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:39.063303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:39.063303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:39.063303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 09:20:39.063303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:39.063303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 236/479] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 12 09:20:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:39.069734 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2772da0-74d6-4087-9138-ef0060bca947 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:39.217891 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2772da0-74d6-4087-9138-ef0060bca947 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:39.262515 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d11ca-cfaf-4560-8f2b-3114e3c2ddb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:39.263110 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d11ca-cfaf-4560-8f2b-3114e3c2ddb7 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:39.263388 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d11ca-cfaf-4560-8f2b-3114e3c2ddb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:39.263660 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d11ca-cfaf-4560-8f2b-3114e3c2ddb7 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:39.264407 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d11ca-cfaf-4560-8f2b-3114e3c2ddb7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:39.264710 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d11ca-cfaf-4560-8f2b-3114e3c2ddb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:39.266089 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d11ca-cfaf-4560-8f2b-3114e3c2ddb7 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:39.274550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 244/480] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:20:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:41.078276 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c07d0b-bbad-4d25-86d7-0363b67f6e68 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:41.079181 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c07d0b-bbad-4d25-86d7-0363b67f6e68 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:41.079601 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c07d0b-bbad-4d25-86d7-0363b67f6e68 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:41.081382 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 237/481] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:41.086620 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5434c-0ba3-45e0-8ea6-feb28bea1285 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:41.087382 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5434c-0ba3-45e0-8ea6-feb28bea1285 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:41.087825 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5434c-0ba3-45e0-8ea6-feb28bea1285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:41.120288 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-97b5434c-0ba3-45e0-8ea6-feb28bea1285 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:41.121768 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-97b5434c-0ba3-45e0-8ea6-feb28bea1285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:41.128065 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654257c1-f8b9-4ee9-b3e3-57c60a1e12de None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:41.128553 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654257c1-f8b9-4ee9-b3e3-57c60a1e12de None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:41.128974 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654257c1-f8b9-4ee9-b3e3-57c60a1e12de None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:41.130816 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 238/482] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:41.150531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6e486-68ae-4c8f-9b10-dc9a9f3645fc None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:41.151015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6e486-68ae-4c8f-9b10-dc9a9f3645fc None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:41.151460 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6e486-68ae-4c8f-9b10-dc9a9f3645fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:41.182919 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-52c6e486-68ae-4c8f-9b10-dc9a9f3645fc None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:41.184869 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-52c6e486-68ae-4c8f-9b10-dc9a9f3645fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:41.193329 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 245/483] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:41.216503 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5434c-0ba3-45e0-8ea6-feb28bea1285 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:41.315080 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5434c-0ba3-45e0-8ea6-feb28bea1285 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:41.335615 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 239/484] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:20:41.350918 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988e541-41a8-4d58-9929-3302bef88f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:41.351918 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988e541-41a8-4d58-9929-3302bef88f4f None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:41.352343 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988e541-41a8-4d58-9929-3302bef88f4f None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:41.352786 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988e541-41a8-4d58-9929-3302bef88f4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:41.363199 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988e541-41a8-4d58-9929-3302bef88f4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:41.371522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6e486-68ae-4c8f-9b10-dc9a9f3645fc None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:41.371987 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-e988e541-41a8-4d58-9929-3302bef88f4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 09:20:41.371987 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:41.371987 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:41.371987 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:41.371987 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:41.371987 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:41.371987 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:41.371987 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:41.371987 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:41.371987 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:41.371987 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:41.371987 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:41.371987 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:41.371987 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:41.371987 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:41.371987 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:41.373106 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:41.373106 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:41.373106 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:41.373106 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:41.373106 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:41.373106 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:41.373106 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:41.373106 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:41.373106 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:41.373106 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:41.373106 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:41.373106 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:41.373106 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:41.373106 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:41.373106 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:41.373106 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:41.374157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:41.374157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:41.374157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:41.374157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:41.374157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:41.374157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:41.374157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:41.374157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:41.374157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:41.374157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:41.374157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 09:20:41.374157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:41.376528 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 246/485] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 12 09:20:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:20:41.382685 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988e541-41a8-4d58-9929-3302bef88f4f None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:41.485875 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988e541-41a8-4d58-9929-3302bef88f4f None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:41.521426 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c70e7-6513-41a6-bceb-8053cbd73c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:41.522379 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c70e7-6513-41a6-bceb-8053cbd73c46 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:41.522829 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c70e7-6513-41a6-bceb-8053cbd73c46 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:41.523248 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c70e7-6513-41a6-bceb-8053cbd73c46 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:41.524145 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c70e7-6513-41a6-bceb-8053cbd73c46 None admin] RBAC: Adding query filter params (name=service) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:41.524594 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c70e7-6513-41a6-bceb-8053cbd73c46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:41.526151 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c70e7-6513-41a6-bceb-8053cbd73c46 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:41.535405 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 247/486] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 12 09:20:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:41.540630 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c70e7-6513-41a6-bceb-8053cbd73c46 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:41.636044 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6e486-68ae-4c8f-9b10-dc9a9f3645fc None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:41.660914 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c70e7-6513-41a6-bceb-8053cbd73c46 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:41.695079 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024972da-d8b9-444d-ae55-011f355ccad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:41.695884 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024972da-d8b9-444d-ae55-011f355ccad6 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:41.696166 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024972da-d8b9-444d-ae55-011f355ccad6 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:41.696441 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024972da-d8b9-444d-ae55-011f355ccad6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:41.700096 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f2793-1869-472c-82e0-00f29a511991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:41.701118 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f2793-1869-472c-82e0-00f29a511991 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:41.701592 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f2793-1869-472c-82e0-00f29a511991 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:41.702073 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f2793-1869-472c-82e0-00f29a511991 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:41.707692 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024972da-d8b9-444d-ae55-011f355ccad6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:41.709152 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024972da-d8b9-444d-ae55-011f355ccad6 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:41.716347 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f2793-1869-472c-82e0-00f29a511991 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:41.724138 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-610f2793-1869-472c-82e0-00f29a511991 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 09:20:41.724138 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:41.724138 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:41.724138 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:41.724138 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:41.724138 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:41.724138 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:41.724138 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:41.724138 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:41.724138 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:41.724138 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:41.724138 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:41.724138 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:41.724138 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:41.724138 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:41.724138 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:41.725016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:41.725016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:41.725016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:41.725016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:41.725016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:41.725016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:41.725016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:41.725016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:41.725016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:41.725016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:41.725016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:41.725016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:41.725016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:41.725016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:41.725016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:41.725016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:41.725837 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:41.725837 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:41.725837 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:41.725837 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:41.725837 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:41.725837 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:41.725837 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:41.725837 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:41.725837 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:41.725837 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:41.725837 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 09:20:41.725837 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:41.725837 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 240/487] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 12 09:20:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:20:41.734431 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f360f-114f-49af-93cd-6e682fe60479 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:41.734431 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f360f-114f-49af-93cd-6e682fe60479 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:41.734431 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f360f-114f-49af-93cd-6e682fe60479 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:41.734431 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 241/488] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:41.735779 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-024972da-d8b9-444d-ae55-011f355ccad6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:41.735779 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:41.735779 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:41.735779 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:41.735779 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:41.735779 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:41.735779 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:41.735779 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:41.735779 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:41.735779 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:41.735779 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:41.735779 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:41.735779 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:41.735779 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:41.735779 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:41.736598 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:41.736598 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:41.736598 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:41.736598 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:41.736598 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:41.736598 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:41.736598 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:41.736598 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:41.736598 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:41.736598 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:41.736598 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:41.736598 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:41.736598 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:41.736598 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:41.736598 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:41.736598 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:41.736598 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:41.737440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:41.737440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:41.737440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:41.737440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:41.737440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 248/489] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:20:41.737712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f360f-114f-49af-93cd-6e682fe60479 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:41.739623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78179353-d307-4880-9d30-1f8a4a146eeb None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:41.739904 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78179353-d307-4880-9d30-1f8a4a146eeb None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:41.740176 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78179353-d307-4880-9d30-1f8a4a146eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:41.763511 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-78179353-d307-4880-9d30-1f8a4a146eeb None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:41.764845 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-78179353-d307-4880-9d30-1f8a4a146eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:41.837938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 249/490] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:41.837938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78179353-d307-4880-9d30-1f8a4a146eeb None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:41.860473 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f360f-114f-49af-93cd-6e682fe60479 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:41.897287 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94484e58-f261-4589-974a-cc9d96192220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:41.897871 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94484e58-f261-4589-974a-cc9d96192220 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:41.898176 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94484e58-f261-4589-974a-cc9d96192220 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:41.898447 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94484e58-f261-4589-974a-cc9d96192220 None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:41.899189 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94484e58-f261-4589-974a-cc9d96192220 None admin] RBAC: Adding query filter params (name=service) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:41.899493 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94484e58-f261-4589-974a-cc9d96192220 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:41.900867 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94484e58-f261-4589-974a-cc9d96192220 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:41.913393 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 242/491] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 12 09:20:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:41.913393 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbe00d-23df-4b41-97d2-afc21d2fcbb1 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:41.913393 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbe00d-23df-4b41-97d2-afc21d2fcbb1 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:41.913393 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbe00d-23df-4b41-97d2-afc21d2fcbb1 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:41.913393 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 243/492] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:41.913393 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbe00d-23df-4b41-97d2-afc21d2fcbb1 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:41.936578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78179353-d307-4880-9d30-1f8a4a146eeb None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:41.970193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9fc4f-9fc3-4050-a1a2-81c8526158b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:41.971111 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9fc4f-9fc3-4050-a1a2-81c8526158b1 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:41.971541 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9fc4f-9fc3-4050-a1a2-81c8526158b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:41.971810 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9fc4f-9fc3-4050-a1a2-81c8526158b1 None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:41.972528 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9fc4f-9fc3-4050-a1a2-81c8526158b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:41.972833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9fc4f-9fc3-4050-a1a2-81c8526158b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:41.974210 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9fc4f-9fc3-4050-a1a2-81c8526158b1 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:41.985010 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 250/493] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:41.985792 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9fc4f-9fc3-4050-a1a2-81c8526158b1 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:42.015801 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbe00d-23df-4b41-97d2-afc21d2fcbb1 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:42.049345 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb9a00-a309-4c29-9626-2dc2cf5802f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:42.050174 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb9a00-a309-4c29-9626-2dc2cf5802f0 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:42.050526 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb9a00-a309-4c29-9626-2dc2cf5802f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:42.050799 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb9a00-a309-4c29-9626-2dc2cf5802f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:42.060585 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb9a00-a309-4c29-9626-2dc2cf5802f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:42.068351 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-9ddb9a00-a309-4c29-9626-2dc2cf5802f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 09:20:42.068351 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:42.068351 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:42.068351 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:42.068351 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:42.068351 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:42.068351 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:42.068351 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:42.068351 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:42.068351 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:42.068351 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:42.068351 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:42.068351 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:42.068351 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:42.068351 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:42.068351 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:42.069446 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:42.069446 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:42.069446 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:42.069446 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:42.069446 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:42.069446 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:42.069446 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:42.069446 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:42.069446 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:42.069446 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:42.069446 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:42.069446 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:42.069446 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:42.069446 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:42.069446 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:42.069446 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:42.075621 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:42.075621 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:42.075621 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:42.075621 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:42.075621 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:42.075621 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:42.075621 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:42.075621 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:42.075621 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:42.075621 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:42.075621 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 09:20:42.075621 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:42.075621 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 244/494] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 12 09:20:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:42.075621 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31ffb0-5fc9-4ab5-ae23-170842b31cb2 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:42.076603 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31ffb0-5fc9-4ab5-ae23-170842b31cb2 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:42.076603 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31ffb0-5fc9-4ab5-ae23-170842b31cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:42.087535 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-6e31ffb0-5fc9-4ab5-ae23-170842b31cb2 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:42.088690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-6e31ffb0-5fc9-4ab5-ae23-170842b31cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:42.090974 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9fc4f-9fc3-4050-a1a2-81c8526158b1 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:42.123519 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d7372-c27d-488f-9524-e59c828cb02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:42.124309 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d7372-c27d-488f-9524-e59c828cb02d None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:42.124587 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d7372-c27d-488f-9524-e59c828cb02d None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:42.124856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d7372-c27d-488f-9524-e59c828cb02d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:42.135532 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d7372-c27d-488f-9524-e59c828cb02d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:42.137542 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d7372-c27d-488f-9524-e59c828cb02d None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:42.152948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 245/495] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:42.153477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-072d7372-c27d-488f-9524-e59c828cb02d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:42.153477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:42.153477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:42.153477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:42.153477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:42.153477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:42.153477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:42.153477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:42.153477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:42.153477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:42.153477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:42.153477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:42.153477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:42.153477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:42.153477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:42.154318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:42.154318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:42.154318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:42.154318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:42.154318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:42.154318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:42.154318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:42.154318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:42.154318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:42.154318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:42.154318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:42.154318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:42.154318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:42.154318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:42.154318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:42.154318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:42.154318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:42.155180 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:42.155180 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:42.155180 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:42.155180 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:42.155398 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31ffb0-5fc9-4ab5-ae23-170842b31cb2 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:42.155468 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 251/496] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:42.155999 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43be780-4e3b-4e91-8e2d-c110643751b1 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:42.156161 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43be780-4e3b-4e91-8e2d-c110643751b1 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:42.156475 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43be780-4e3b-4e91-8e2d-c110643751b1 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:42.157761 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 252/497] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:42.158317 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43be780-4e3b-4e91-8e2d-c110643751b1 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:42.248297 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31ffb0-5fc9-4ab5-ae23-170842b31cb2 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:42.254649 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43be780-4e3b-4e91-8e2d-c110643751b1 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:42.280468 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94589e-eb18-4112-8814-13540eeef141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:42.281245 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94589e-eb18-4112-8814-13540eeef141 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:42.281520 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94589e-eb18-4112-8814-13540eeef141 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:42.281785 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94589e-eb18-4112-8814-13540eeef141 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:42.286317 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb86266-c45a-45f8-97e8-cbb20159c185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:42.286960 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb86266-c45a-45f8-97e8-cbb20159c185 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:42.287234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb86266-c45a-45f8-97e8-cbb20159c185 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:42.287500 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb86266-c45a-45f8-97e8-cbb20159c185 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:42.288224 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb86266-c45a-45f8-97e8-cbb20159c185 None admin] RBAC: Adding query filter params (name=service) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:42.288518 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb86266-c45a-45f8-97e8-cbb20159c185 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:42.288607 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94589e-eb18-4112-8814-13540eeef141 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:42.289859 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb86266-c45a-45f8-97e8-cbb20159c185 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:42.290062 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94589e-eb18-4112-8814-13540eeef141 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:42.297551 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 253/498] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 12 09:20:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:42.298353 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb86266-c45a-45f8-97e8-cbb20159c185 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:42.305728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-3d94589e-eb18-4112-8814-13540eeef141 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 09:20:42.305728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:42.305728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:42.305728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:42.305728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:42.305728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:42.305728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:42.305728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:42.305728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:42.305728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:42.305728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:42.305728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:42.305728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:20:42.305728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:20:42.305728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:20:42.305728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:20:42.306669 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:42.306669 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:42.306669 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:20:42.306669 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:20:42.306669 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:20:42.306669 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:20:42.306669 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:42.306669 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:42.306669 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:42.306669 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:42.306669 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:42.306669 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:42.306669 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:42.306669 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:42.306669 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:42.306669 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:42.306669 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:42.306669 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:42.307583 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:42.307583 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:42.307583 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:20:42.307583 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:20:42.307583 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:20:42.307583 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:20:42.307583 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:20:42.307583 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:20:42.307583 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 09:20:42.307583 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:42.307583 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 246/499] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:20:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:42.308286 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd38078-255b-4b8b-8775-eefade358f3a None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:42.308453 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd38078-255b-4b8b-8775-eefade358f3a None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:42.308789 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd38078-255b-4b8b-8775-eefade358f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:42.325191 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-6dd38078-255b-4b8b-8775-eefade358f3a None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:42.326400 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-6dd38078-255b-4b8b-8775-eefade358f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:42.389206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 247/500] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:42.390026 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd38078-255b-4b8b-8775-eefade358f3a None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:42.395044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb86266-c45a-45f8-97e8-cbb20159c185 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:42.427041 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cbb9c-dc60-4f07-a458-a98cae54bbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:42.427720 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cbb9c-dc60-4f07-a458-a98cae54bbe7 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:42.428089 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cbb9c-dc60-4f07-a458-a98cae54bbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:42.428368 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cbb9c-dc60-4f07-a458-a98cae54bbe7 None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:42.429075 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44cbb9c-dc60-4f07-a458-a98cae54bbe7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:42.429379 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44cbb9c-dc60-4f07-a458-a98cae54bbe7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:42.430761 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44cbb9c-dc60-4f07-a458-a98cae54bbe7 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:42.441747 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 254/501] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:42.442550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cbb9c-dc60-4f07-a458-a98cae54bbe7 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:42.481721 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd38078-255b-4b8b-8775-eefade358f3a None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:42.513175 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a662db9-e004-4e31-830e-fc5bfd844152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:42.513976 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a662db9-e004-4e31-830e-fc5bfd844152 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:42.514257 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a662db9-e004-4e31-830e-fc5bfd844152 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:42.514525 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a662db9-e004-4e31-830e-fc5bfd844152 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:42.523972 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a662db9-e004-4e31-830e-fc5bfd844152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:42.525421 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a662db9-e004-4e31-830e-fc5bfd844152 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:42.534118 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cbb9c-dc60-4f07-a458-a98cae54bbe7 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:42.542360 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-6a662db9-e004-4e31-830e-fc5bfd844152 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:42.542360 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:42.542360 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:42.542360 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:42.542360 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:42.542360 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:42.542360 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:42.542360 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:42.542360 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:42.542360 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:42.542360 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:42.542360 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:42.542360 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:42.542360 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:42.542360 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:42.543258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:42.543258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:42.543258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:42.543258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:42.543258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:42.543258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:42.543258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:42.543258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:42.543258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:42.543258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:42.543258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:42.543258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:42.543258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:42.543258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:42.543258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:42.543258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:42.543258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:42.544200 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:42.544200 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:42.544200 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:42.544200 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:42.544200 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 248/502] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:42.544464 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a662db9-e004-4e31-830e-fc5bfd844152 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:42.565829 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de803e8-b7b6-47d0-9080-558c99d9f56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:42.566648 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de803e8-b7b6-47d0-9080-558c99d9f56e None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:42.566924 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de803e8-b7b6-47d0-9080-558c99d9f56e None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:42.567193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de803e8-b7b6-47d0-9080-558c99d9f56e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:42.577062 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de803e8-b7b6-47d0-9080-558c99d9f56e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:42.578510 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de803e8-b7b6-47d0-9080-558c99d9f56e None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:42.595709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-7de803e8-b7b6-47d0-9080-558c99d9f56e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:42.595709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:42.595709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:42.595709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:42.595709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:42.595709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:42.595709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:42.595709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:42.595709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:42.595709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:42.595709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:42.595709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:42.595709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:42.595709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:42.595709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:42.596703 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:42.596703 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:42.596703 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:42.596703 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:42.596703 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:42.596703 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:42.596703 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:42.596703 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:42.596703 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:42.596703 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:42.596703 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:42.596703 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:42.596703 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:42.596703 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:42.596703 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:42.596703 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:42.596703 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:42.597573 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:42.597573 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:42.597573 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:42.597573 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:42.601318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 255/503] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:42.602094 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de803e8-b7b6-47d0-9080-558c99d9f56e None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:42.640392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a662db9-e004-4e31-830e-fc5bfd844152 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:42.671451 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b33d5-4bfc-4b77-99a7-b2a88a14d3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:42.672171 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b33d5-4bfc-4b77-99a7-b2a88a14d3af None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:42.672455 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b33d5-4bfc-4b77-99a7-b2a88a14d3af None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:42.672729 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b33d5-4bfc-4b77-99a7-b2a88a14d3af None admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:42.673552 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b33d5-4bfc-4b77-99a7-b2a88a14d3af None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:42.673863 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b33d5-4bfc-4b77-99a7-b2a88a14d3af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:42.675339 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b33d5-4bfc-4b77-99a7-b2a88a14d3af None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:42.692911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de803e8-b7b6-47d0-9080-558c99d9f56e None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:42.710823 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 249/504] 10.222.0.60 () {56 vars in 1137 bytes} [Thu May 12 09:20:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:42.711625 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b33d5-4bfc-4b77-99a7-b2a88a14d3af None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:42.726547 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4300fb-e4b8-4892-8d2c-48d7752ec1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:42.727354 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4300fb-e4b8-4892-8d2c-48d7752ec1aa None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:42.727623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4300fb-e4b8-4892-8d2c-48d7752ec1aa None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:42.727887 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4300fb-e4b8-4892-8d2c-48d7752ec1aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:42.737372 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4300fb-e4b8-4892-8d2c-48d7752ec1aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:42.745001 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-2b4300fb-e4b8-4892-8d2c-48d7752ec1aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 09:20:42.745001 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:42.745001 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:42.745001 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:42.745001 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:42.745001 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:42.745001 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:42.745001 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:42.745001 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:42.745001 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:42.745001 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:42.745001 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:42.745001 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:42.745001 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:42.745001 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:42.745001 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:42.746454 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:42.746454 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:42.746454 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:42.746454 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:42.746454 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:42.746454 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:42.746454 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:42.746454 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:42.746454 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:42.746454 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:42.746454 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:42.746454 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:42.746454 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:42.746454 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:42.746454 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:42.746454 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:42.747249 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:42.747249 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:42.747249 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:42.747249 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:42.747249 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:42.747249 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:42.747249 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:42.747249 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:42.747249 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:42.747249 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:42.747249 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 09:20:42.747249 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:42.747249 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 256/505] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 12 09:20:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:42.748618 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4300fb-e4b8-4892-8d2c-48d7752ec1aa None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:42.805803 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b33d5-4bfc-4b77-99a7-b2a88a14d3af None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:42.838062 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4300fb-e4b8-4892-8d2c-48d7752ec1aa None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:42.838287 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b24c3f-c7f6-4a5e-a0f7-e6fae1f2bca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:42.839073 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b24c3f-c7f6-4a5e-a0f7-e6fae1f2bca3 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:42.839353 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b24c3f-c7f6-4a5e-a0f7-e6fae1f2bca3 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:42.840158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b24c3f-c7f6-4a5e-a0f7-e6fae1f2bca3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:42.846984 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b24c3f-c7f6-4a5e-a0f7-e6fae1f2bca3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:42.848424 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b24c3f-c7f6-4a5e-a0f7-e6fae1f2bca3 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:42.862303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-f8b24c3f-c7f6-4a5e-a0f7-e6fae1f2bca3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 09:20:42.862303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:42.862303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:42.862303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:42.862303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:42.862303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:42.862303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:42.862303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:42.862303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:42.862303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:42.862303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:42.862303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:42.862303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:20:42.862303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:20:42.862303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:20:42.862303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:20:42.863276 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:42.863276 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:42.863276 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:20:42.863276 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:20:42.863276 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:20:42.863276 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:20:42.863276 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:42.863276 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:42.863276 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:42.863276 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:42.863276 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:42.863276 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:42.863276 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:42.863276 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:42.863276 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:42.863276 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:42.863276 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:42.863276 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:42.864194 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:42.864194 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:42.864194 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:20:42.864194 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:20:42.864194 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:20:42.864194 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:20:42.864194 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:20:42.864194 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:20:42.864194 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 09:20:42.864194 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:42.864194 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 250/506] 10.222.0.60 () {56 vars in 1093 bytes} [Thu May 12 09:20:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:42.864194 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b24c3f-c7f6-4a5e-a0f7-e6fae1f2bca3 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:42.870297 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff0af3-4ef2-470e-8562-7ce3fc594722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:42.871447 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff0af3-4ef2-470e-8562-7ce3fc594722 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:42.871723 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff0af3-4ef2-470e-8562-7ce3fc594722 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:42.871991 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff0af3-4ef2-470e-8562-7ce3fc594722 None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:42.872701 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff0af3-4ef2-470e-8562-7ce3fc594722 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:42.872998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff0af3-4ef2-470e-8562-7ce3fc594722 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:42.874393 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff0af3-4ef2-470e-8562-7ce3fc594722 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:42.886120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 257/507] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:42.886933 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff0af3-4ef2-470e-8562-7ce3fc594722 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:42.955655 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b24c3f-c7f6-4a5e-a0f7-e6fae1f2bca3 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:42.976681 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff0af3-4ef2-470e-8562-7ce3fc594722 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:42.989632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e132d-cd2d-4dfa-89b5-02d43fcabbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:42.990332 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e132d-cd2d-4dfa-89b5-02d43fcabbf9 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:42.990614 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e132d-cd2d-4dfa-89b5-02d43fcabbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:42.990887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e132d-cd2d-4dfa-89b5-02d43fcabbf9 None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:42.991601 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e132d-cd2d-4dfa-89b5-02d43fcabbf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:42.991934 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e132d-cd2d-4dfa-89b5-02d43fcabbf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:42.993304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e132d-cd2d-4dfa-89b5-02d43fcabbf9 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:43.004920 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 251/508] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:43.006006 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e132d-cd2d-4dfa-89b5-02d43fcabbf9 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:43.020136 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427692af-c8df-4e5b-976f-aca7ab60e3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:43.020975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427692af-c8df-4e5b-976f-aca7ab60e3f1 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:43.021353 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427692af-c8df-4e5b-976f-aca7ab60e3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:43.021634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427692af-c8df-4e5b-976f-aca7ab60e3f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:43.084210 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427692af-c8df-4e5b-976f-aca7ab60e3f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:43.085831 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427692af-c8df-4e5b-976f-aca7ab60e3f1 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:43.100191 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e132d-cd2d-4dfa-89b5-02d43fcabbf9 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:43.129862 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5b636-babf-47cc-8986-962d91ed68c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:43.130790 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5b636-babf-47cc-8986-962d91ed68c4 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:43.131065 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5b636-babf-47cc-8986-962d91ed68c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:43.131334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5b636-babf-47cc-8986-962d91ed68c4 None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:43.132062 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5b636-babf-47cc-8986-962d91ed68c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:43.132362 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5b636-babf-47cc-8986-962d91ed68c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:43.133710 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5b636-babf-47cc-8986-962d91ed68c4 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:43.141654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 252/509] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 12 09:20:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:43.142438 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5b636-babf-47cc-8986-962d91ed68c4 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:43.186030 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 258/510] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:20:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:20:43.187439 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427692af-c8df-4e5b-976f-aca7ab60e3f1 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:43.235370 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5b636-babf-47cc-8986-962d91ed68c4 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:43.266780 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d1ea3-5adc-4b78-a246-de1c66fbfe41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:43.267426 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d1ea3-5adc-4b78-a246-de1c66fbfe41 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:43.267702 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d1ea3-5adc-4b78-a246-de1c66fbfe41 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:43.267972 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d1ea3-5adc-4b78-a246-de1c66fbfe41 None admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:43.268786 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d1ea3-5adc-4b78-a246-de1c66fbfe41 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:43.269115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d1ea3-5adc-4b78-a246-de1c66fbfe41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:43.270557 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d1ea3-5adc-4b78-a246-de1c66fbfe41 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:43.277629 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427692af-c8df-4e5b-976f-aca7ab60e3f1 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:43.287113 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 253/511] 10.222.0.60 () {56 vars in 1133 bytes} [Thu May 12 09:20:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:43.287874 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d1ea3-5adc-4b78-a246-de1c66fbfe41 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:43.310244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9803e-2f84-4acc-9500-ab21f81730c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:43.310900 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9803e-2f84-4acc-9500-ab21f81730c1 None admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:43.311173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9803e-2f84-4acc-9500-ab21f81730c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:43.311438 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9803e-2f84-4acc-9500-ab21f81730c1 None admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:43.312121 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9803e-2f84-4acc-9500-ab21f81730c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:43.313525 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9803e-2f84-4acc-9500-ab21f81730c1 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:43.331847 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 259/512] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 12 09:20:43 2022] POST /identity/v3/users => generated 247 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:20:43.346176 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9803e-2f84-4acc-9500-ab21f81730c1 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:43.388202 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d1ea3-5adc-4b78-a246-de1c66fbfe41 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:43.425005 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b02b8-4eb5-41e3-9074-be8c012be93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:43.425822 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b02b8-4eb5-41e3-9074-be8c012be93d None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:43.426136 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b02b8-4eb5-41e3-9074-be8c012be93d None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:43.426408 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b02b8-4eb5-41e3-9074-be8c012be93d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:43.434908 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b02b8-4eb5-41e3-9074-be8c012be93d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:43.436392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b02b8-4eb5-41e3-9074-be8c012be93d None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:43.438561 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9803e-2f84-4acc-9500-ab21f81730c1 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:43.451719 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-501b02b8-4eb5-41e3-9074-be8c012be93d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 09:20:43.451719 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:43.451719 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:43.451719 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:43.451719 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:43.451719 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:43.451719 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:43.451719 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:43.451719 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:43.451719 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:43.451719 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:43.451719 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:43.451719 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:20:43.451719 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:20:43.451719 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:20:43.451719 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:20:43.452712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:43.452712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:43.452712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:20:43.452712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:20:43.452712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:20:43.452712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:20:43.452712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:43.452712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:43.452712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:43.452712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:43.452712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:43.452712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:43.452712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:43.452712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:43.452712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:43.452712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:43.452712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:43.452712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:43.459107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:43.459107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:43.459107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:20:43.459107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:20:43.459107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:20:43.459107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:20:43.459107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:20:43.459107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:20:43.459107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 09:20:43.459107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:43.459107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 254/513] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:20:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:43.459107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b02b8-4eb5-41e3-9074-be8c012be93d None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:43.474411 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99fd1f-7cb6-40c1-b67b-dda99e14bef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:43.475209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99fd1f-7cb6-40c1-b67b-dda99e14bef8 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:43.475485 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99fd1f-7cb6-40c1-b67b-dda99e14bef8 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:43.475755 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99fd1f-7cb6-40c1-b67b-dda99e14bef8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:43.486981 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99fd1f-7cb6-40c1-b67b-dda99e14bef8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:43.488359 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99fd1f-7cb6-40c1-b67b-dda99e14bef8 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:43.507457 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-0f99fd1f-7cb6-40c1-b67b-dda99e14bef8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:43.507457 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:43.507457 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:43.507457 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:43.507457 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:43.507457 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:43.507457 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:43.507457 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:43.507457 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:43.507457 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:43.507457 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:43.507457 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:43.507457 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:43.507457 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:43.507457 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:43.509035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:43.509035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:43.509035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:43.509035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:43.509035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:43.509035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:43.509035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:43.509035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:43.509035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:43.509035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:43.509035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:43.509035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:43.509035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:43.509035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:43.509035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:43.509035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:43.509035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:43.514900 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:43.514900 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:43.514900 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:43.514900 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:43.514900 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 260/514] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:43.514900 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99fd1f-7cb6-40c1-b67b-dda99e14bef8 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:43.558066 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b02b8-4eb5-41e3-9074-be8c012be93d None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:43.592729 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28324592-ba45-48a8-bdee-50748655cc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:43.593534 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28324592-ba45-48a8-bdee-50748655cc51 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:43.593816 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28324592-ba45-48a8-bdee-50748655cc51 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:43.594148 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28324592-ba45-48a8-bdee-50748655cc51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:43.604748 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28324592-ba45-48a8-bdee-50748655cc51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:43.606293 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28324592-ba45-48a8-bdee-50748655cc51 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:43.614120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99fd1f-7cb6-40c1-b67b-dda99e14bef8 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:43.623894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-28324592-ba45-48a8-bdee-50748655cc51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:43.623894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:43.623894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:43.623894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:43.623894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:43.623894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:43.623894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:43.623894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:43.623894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:43.623894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:43.623894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:43.623894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:43.623894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:43.623894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:43.623894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:43.624754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:43.624754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:43.624754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:43.624754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:43.624754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:43.624754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:43.624754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:43.624754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:43.624754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:43.624754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:43.624754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:43.624754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:43.624754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:43.624754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:43.624754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:43.624754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:43.624754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:43.625614 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:43.625614 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:43.625614 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:43.625614 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:43.626803 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 255/515] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:43.627623 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28324592-ba45-48a8-bdee-50748655cc51 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:43.649178 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be4481-a436-40a0-87e5-f9c1f83766fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:43.649835 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be4481-a436-40a0-87e5-f9c1f83766fe None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:43.650150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be4481-a436-40a0-87e5-f9c1f83766fe None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:43.650421 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be4481-a436-40a0-87e5-f9c1f83766fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:43.716247 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be4481-a436-40a0-87e5-f9c1f83766fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:43.717715 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be4481-a436-40a0-87e5-f9c1f83766fe None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:43.722524 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28324592-ba45-48a8-bdee-50748655cc51 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:43.756591 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b6bf2-00eb-4ae9-b755-dc713391b2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:43.757186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b6bf2-00eb-4ae9-b755-dc713391b2b9 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:43.757468 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b6bf2-00eb-4ae9-b755-dc713391b2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:43.757744 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b6bf2-00eb-4ae9-b755-dc713391b2b9 None admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:43.758622 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b6bf2-00eb-4ae9-b755-dc713391b2b9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:43.758932 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b6bf2-00eb-4ae9-b755-dc713391b2b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:43.760379 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b6bf2-00eb-4ae9-b755-dc713391b2b9 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:43.778626 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 256/516] 10.222.0.60 () {56 vars in 1137 bytes} [Thu May 12 09:20:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:43.779450 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b6bf2-00eb-4ae9-b755-dc713391b2b9 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:43.816864 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 261/517] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:20:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:20:43.817721 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be4481-a436-40a0-87e5-f9c1f83766fe None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:43.880913 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b6bf2-00eb-4ae9-b755-dc713391b2b9 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:43.914196 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2e3b3-d234-42f4-aad8-873ea34812eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:43.914823 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be4481-a436-40a0-87e5-f9c1f83766fe None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:43.914948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2e3b3-d234-42f4-aad8-873ea34812eb None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:43.915139 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2e3b3-d234-42f4-aad8-873ea34812eb None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:43.915416 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2e3b3-d234-42f4-aad8-873ea34812eb None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:43.916140 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2e3b3-d234-42f4-aad8-873ea34812eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:43.916440 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2e3b3-d234-42f4-aad8-873ea34812eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:43.918358 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2e3b3-d234-42f4-aad8-873ea34812eb None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:43.933991 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 257/518] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:43.933991 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2e3b3-d234-42f4-aad8-873ea34812eb None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:43.948634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ae5b1-340e-4463-a6ce-ac46a9e2e53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:43.949332 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ae5b1-340e-4463-a6ce-ac46a9e2e53e None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:43.949615 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ae5b1-340e-4463-a6ce-ac46a9e2e53e None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:43.949996 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ae5b1-340e-4463-a6ce-ac46a9e2e53e None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:43.950626 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ae5b1-340e-4463-a6ce-ac46a9e2e53e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:43.950932 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ae5b1-340e-4463-a6ce-ac46a9e2e53e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:43.952290 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ae5b1-340e-4463-a6ce-ac46a9e2e53e None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:43.963357 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 262/519] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:43.964143 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ae5b1-340e-4463-a6ce-ac46a9e2e53e None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:44.035921 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2e3b3-d234-42f4-aad8-873ea34812eb None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:44.060543 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ae5b1-340e-4463-a6ce-ac46a9e2e53e None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:44.068300 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db4297-770f-4170-83e9-a626297e6159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:44.068949 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db4297-770f-4170-83e9-a626297e6159 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:44.069236 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db4297-770f-4170-83e9-a626297e6159 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:44.069508 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db4297-770f-4170-83e9-a626297e6159 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:44.093718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e83f5e-c2e4-46de-a638-940aad2aa76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:44.097038 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e83f5e-c2e4-46de-a638-940aad2aa76d None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:44.097038 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e83f5e-c2e4-46de-a638-940aad2aa76d None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:44.097038 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e83f5e-c2e4-46de-a638-940aad2aa76d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:44.112831 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e83f5e-c2e4-46de-a638-940aad2aa76d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:44.114339 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e83f5e-c2e4-46de-a638-940aad2aa76d None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:44.132012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-b2e83f5e-c2e4-46de-a638-940aad2aa76d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:44.132012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:44.132012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:44.132012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:44.132012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:44.132012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:44.132012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:44.132012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:44.132012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:44.132012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:44.132012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:44.132012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:44.132012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:44.132012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:44.132012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:44.138408 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:44.138408 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:44.138408 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:44.138408 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:44.138408 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:44.138408 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:44.138408 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:44.138408 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:44.138408 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:44.138408 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:44.138408 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:44.138408 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:44.138408 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:44.138408 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:44.138408 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:44.138408 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:44.138408 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:44.139352 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:44.139352 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:44.139352 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:44.139352 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:44.139352 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 263/520] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:44.139352 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e83f5e-c2e4-46de-a638-940aad2aa76d None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:44.139678 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db4297-770f-4170-83e9-a626297e6159 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:44.139678 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db4297-770f-4170-83e9-a626297e6159 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:44.232239 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e83f5e-c2e4-46de-a638-940aad2aa76d None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:44.243447 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 258/521] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:20:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:20:44.243447 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db4297-770f-4170-83e9-a626297e6159 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:44.264702 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c109ff-102c-40b4-93d6-a08d63108e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:44.265481 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c109ff-102c-40b4-93d6-a08d63108e78 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:44.265758 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c109ff-102c-40b4-93d6-a08d63108e78 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:44.266057 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c109ff-102c-40b4-93d6-a08d63108e78 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:44.273128 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c109ff-102c-40b4-93d6-a08d63108e78 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:44.274596 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c109ff-102c-40b4-93d6-a08d63108e78 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:44.291750 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-86c109ff-102c-40b4-93d6-a08d63108e78 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 09:20:44.291750 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:44.291750 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:44.291750 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:44.291750 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:44.291750 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:44.291750 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:44.291750 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:44.291750 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:44.291750 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:44.291750 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:44.291750 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:44.291750 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:20:44.291750 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:20:44.291750 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:20:44.291750 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:20:44.292890 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:44.292890 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:44.292890 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:20:44.292890 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:20:44.292890 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:20:44.292890 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:20:44.292890 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:44.292890 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:44.292890 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:44.292890 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:44.292890 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:44.292890 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:44.292890 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:44.292890 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:44.292890 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:44.292890 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:44.292890 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:44.292890 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:44.293789 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:44.293789 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:44.293789 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:20:44.293789 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:20:44.293789 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:20:44.293789 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:20:44.293789 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:20:44.293789 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:20:44.293789 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 09:20:44.293789 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:44.293789 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 264/522] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 12 09:20:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:44.293789 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c109ff-102c-40b4-93d6-a08d63108e78 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:44.342910 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db4297-770f-4170-83e9-a626297e6159 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:44.374781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16ccd5-ca46-48aa-a489-a180ce1c4489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:44.375563 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16ccd5-ca46-48aa-a489-a180ce1c4489 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:44.375841 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16ccd5-ca46-48aa-a489-a180ce1c4489 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:44.376126 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16ccd5-ca46-48aa-a489-a180ce1c4489 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:44.383252 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16ccd5-ca46-48aa-a489-a180ce1c4489 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:44.384865 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16ccd5-ca46-48aa-a489-a180ce1c4489 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:44.393132 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c109ff-102c-40b4-93d6-a08d63108e78 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:44.398699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-3d16ccd5-ca46-48aa-a489-a180ce1c4489 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:20:44.398699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:44.398699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:44.398699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:44.398699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:44.398699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:44.398699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:44.398699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:44.398699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:44.398699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:44.398699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:44.398699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:44.398699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:20:44.398699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:20:44.398699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:20:44.399545 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:20:44.399545 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:44.399545 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:44.399545 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:44.399545 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:44.399545 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:44.399545 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:44.399545 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:44.399545 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:44.399545 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:44.399545 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:44.399545 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:44.399545 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:44.399545 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:44.399545 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:44.399545 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:44.399545 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:44.400428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:20:44.400428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:20:44.400428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:20:44.400428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:20:44.400428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:20:44.400428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:20:44.400428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:20:44.400428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:44.400428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 259/523] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:20:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:44.403220 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16ccd5-ca46-48aa-a489-a180ce1c4489 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:44.433378 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5868b26-3b46-4fb3-903e-afbb6acb3c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:44.434503 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5868b26-3b46-4fb3-903e-afbb6acb3c00 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:44.434797 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5868b26-3b46-4fb3-903e-afbb6acb3c00 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:44.435064 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5868b26-3b46-4fb3-903e-afbb6acb3c00 None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:44.435781 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5868b26-3b46-4fb3-903e-afbb6acb3c00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:44.436086 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5868b26-3b46-4fb3-903e-afbb6acb3c00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:44.437471 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5868b26-3b46-4fb3-903e-afbb6acb3c00 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:44.452123 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 265/524] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:44.452959 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5868b26-3b46-4fb3-903e-afbb6acb3c00 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:44.508210 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16ccd5-ca46-48aa-a489-a180ce1c4489 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:44.540201 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257d0c8-c63b-40d3-a739-f322e519edac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:44.540849 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257d0c8-c63b-40d3-a739-f322e519edac None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:44.541126 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257d0c8-c63b-40d3-a739-f322e519edac None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:44.541395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257d0c8-c63b-40d3-a739-f322e519edac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:44.552168 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257d0c8-c63b-40d3-a739-f322e519edac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:44.552749 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5868b26-3b46-4fb3-903e-afbb6acb3c00 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:44.553557 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257d0c8-c63b-40d3-a739-f322e519edac None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:44.570166 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-8257d0c8-c63b-40d3-a739-f322e519edac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:44.570166 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:44.570166 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:44.570166 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:44.570166 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:44.570166 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:44.570166 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:44.570166 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:44.570166 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:44.570166 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:44.570166 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:44.570166 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:44.570166 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:44.570166 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:44.570166 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:44.571041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:44.571041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:44.571041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:44.571041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:44.571041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:44.571041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:44.571041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:44.571041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:44.571041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:44.571041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:44.571041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:44.571041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:44.571041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:44.571041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:44.571041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:44.571041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:44.571041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:44.577286 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:44.577286 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:44.577286 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:44.577286 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:44.577286 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 260/525] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:44.577286 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257d0c8-c63b-40d3-a739-f322e519edac None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:44.586684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ab0e8-b0cd-406c-a66e-de0389d5bc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:44.587382 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ab0e8-b0cd-406c-a66e-de0389d5bc7f None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:44.587699 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ab0e8-b0cd-406c-a66e-de0389d5bc7f None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:44.587977 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ab0e8-b0cd-406c-a66e-de0389d5bc7f None admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:44.588808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ab0e8-b0cd-406c-a66e-de0389d5bc7f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:44.589116 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ab0e8-b0cd-406c-a66e-de0389d5bc7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:44.591201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ab0e8-b0cd-406c-a66e-de0389d5bc7f None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:44.627644 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 266/526] 10.222.0.60 () {56 vars in 1139 bytes} [Thu May 12 09:20:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:44.628949 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ab0e8-b0cd-406c-a66e-de0389d5bc7f None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:44.677251 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257d0c8-c63b-40d3-a739-f322e519edac None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:44.710028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc053b4a-bce0-40f6-a5cc-9ec2b0d40ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:44.710671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc053b4a-bce0-40f6-a5cc-9ec2b0d40ba1 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:44.710946 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc053b4a-bce0-40f6-a5cc-9ec2b0d40ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:44.711212 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc053b4a-bce0-40f6-a5cc-9ec2b0d40ba1 None admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:44.711979 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc053b4a-bce0-40f6-a5cc-9ec2b0d40ba1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:44.712284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc053b4a-bce0-40f6-a5cc-9ec2b0d40ba1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:44.713698 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc053b4a-bce0-40f6-a5cc-9ec2b0d40ba1 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:44.724157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ab0e8-b0cd-406c-a66e-de0389d5bc7f None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:44.730889 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 261/527] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:20:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:44.731878 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc053b4a-bce0-40f6-a5cc-9ec2b0d40ba1 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:44.762035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a2f81-2f7b-4ed2-b62a-8f02b2914ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:44.762825 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a2f81-2f7b-4ed2-b62a-8f02b2914ccd None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:44.763104 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a2f81-2f7b-4ed2-b62a-8f02b2914ccd None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:44.763372 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a2f81-2f7b-4ed2-b62a-8f02b2914ccd None admin] PATH_INFO: `/v3/projects/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:44.769719 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a2f81-2f7b-4ed2-b62a-8f02b2914ccd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:44.771190 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a2f81-2f7b-4ed2-b62a-8f02b2914ccd None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:44.785553 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-5f3a2f81-2f7b-4ed2-b62a-8f02b2914ccd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:20:44.785553 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:44.785553 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:44.785553 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:44.785553 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:44.785553 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:44.785553 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:44.785553 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:44.785553 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:44.785553 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:44.785553 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:44.785553 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:44.785553 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:20:44.785553 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:20:44.785553 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:20:44.786456 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:20:44.786456 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:44.786456 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:44.786456 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:44.786456 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:44.786456 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:44.786456 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:44.786456 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:44.786456 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:44.786456 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:44.786456 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:44.786456 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:44.786456 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:44.786456 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:44.786456 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:44.786456 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:44.786456 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:44.787334 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:20:44.787334 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:20:44.787334 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:20:44.787334 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:20:44.787334 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:20:44.787334 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:20:44.787334 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:20:44.787334 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:44.787334 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 267/528] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:20:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:44.787824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a2f81-2f7b-4ed2-b62a-8f02b2914ccd None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:44.833263 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc053b4a-bce0-40f6-a5cc-9ec2b0d40ba1 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:44.867427 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ca549-992b-4a99-96b6-43044355eab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:44.868082 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ca549-992b-4a99-96b6-43044355eab8 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:44.868358 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ca549-992b-4a99-96b6-43044355eab8 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:44.868627 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ca549-992b-4a99-96b6-43044355eab8 None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:44.869339 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ca549-992b-4a99-96b6-43044355eab8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:44.869642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ca549-992b-4a99-96b6-43044355eab8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:44.871087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ca549-992b-4a99-96b6-43044355eab8 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:44.881957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 262/529] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:44.882747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ca549-992b-4a99-96b6-43044355eab8 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:44.892485 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a2f81-2f7b-4ed2-b62a-8f02b2914ccd None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:44.929710 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53e078-1366-4d7e-836c-d740901e0ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:44.930384 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53e078-1366-4d7e-836c-d740901e0ef1 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:44.930689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53e078-1366-4d7e-836c-d740901e0ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:44.930959 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53e078-1366-4d7e-836c-d740901e0ef1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:44.979248 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ca549-992b-4a99-96b6-43044355eab8 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:44.995176 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53e078-1366-4d7e-836c-d740901e0ef1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:44.997457 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53e078-1366-4d7e-836c-d740901e0ef1 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:45.017460 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95813e-630e-4a50-bb68-09e744ae5132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:45.018471 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95813e-630e-4a50-bb68-09e744ae5132 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:45.018923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95813e-630e-4a50-bb68-09e744ae5132 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:45.019366 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95813e-630e-4a50-bb68-09e744ae5132 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:45.020350 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95813e-630e-4a50-bb68-09e744ae5132 None admin] RBAC: Adding query filter params (role.id=4798f242077c416e9292660af5469faf, scope.project.id=9cf4f2954dd44516b3e594ed440781cc, user.id=0981a8c6d9ac413b99aae95a6cdd3be5) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:45.020846 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95813e-630e-4a50-bb68-09e744ae5132 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:45.022821 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95813e-630e-4a50-bb68-09e744ae5132 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:45.028829 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 263/530] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:20:44 2022] GET /identity/v3/role_assignments?user.id=0981a8c6d9ac413b99aae95a6cdd3be5&scope.project.id=9cf4f2954dd44516b3e594ed440781cc&role.id=4798f242077c416e9292660af5469faf => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:45.029797 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95813e-630e-4a50-bb68-09e744ae5132 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:45.128337 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 268/531] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:20:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:20:45.129817 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53e078-1366-4d7e-836c-d740901e0ef1 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:45.162065 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95813e-630e-4a50-bb68-09e744ae5132 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:45.199339 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d3192-20b9-4fad-8364-c10e3aa697ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:45.200327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d3192-20b9-4fad-8364-c10e3aa697ff None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:45.200940 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d3192-20b9-4fad-8364-c10e3aa697ff None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:45.201390 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d3192-20b9-4fad-8364-c10e3aa697ff None admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:45.202415 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d3192-20b9-4fad-8364-c10e3aa697ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:45.202911 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d3192-20b9-4fad-8364-c10e3aa697ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:45.204550 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d3192-20b9-4fad-8364-c10e3aa697ff None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:45.218607 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 264/532] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:20:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:45.219805 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d3192-20b9-4fad-8364-c10e3aa697ff None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:45.245531 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53e078-1366-4d7e-836c-d740901e0ef1 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:45.280632 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30774a60-1efe-4f5c-b016-5ec2c75c90c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:45.281429 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30774a60-1efe-4f5c-b016-5ec2c75c90c9 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:45.281712 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30774a60-1efe-4f5c-b016-5ec2c75c90c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:45.281993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30774a60-1efe-4f5c-b016-5ec2c75c90c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:45.288572 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30774a60-1efe-4f5c-b016-5ec2c75c90c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:45.290044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30774a60-1efe-4f5c-b016-5ec2c75c90c9 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:45.304232 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-30774a60-1efe-4f5c-b016-5ec2c75c90c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:20:45.304232 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:45.304232 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:45.304232 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:45.304232 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:45.304232 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:45.304232 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:45.304232 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:45.304232 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:45.304232 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:45.304232 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:45.304232 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:45.304232 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:20:45.304232 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:20:45.304232 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:20:45.305324 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:20:45.305324 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:45.305324 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:45.305324 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:45.305324 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:45.305324 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:45.305324 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:45.305324 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:45.305324 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:45.305324 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:45.305324 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:45.305324 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:45.305324 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:45.305324 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:45.305324 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:45.305324 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:45.305324 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:45.306342 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:20:45.306342 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:20:45.306342 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:20:45.306342 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:20:45.306342 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:20:45.306342 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:20:45.306342 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:20:45.306342 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:45.306342 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 269/533] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:20:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:45.306818 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30774a60-1efe-4f5c-b016-5ec2c75c90c9 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:45.327297 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d3192-20b9-4fad-8364-c10e3aa697ff None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:45.362015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d86431-3731-4b4e-9a23-66c422af35ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:45.363023 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d86431-3731-4b4e-9a23-66c422af35ed None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:45.363450 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d86431-3731-4b4e-9a23-66c422af35ed None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:45.363971 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d86431-3731-4b4e-9a23-66c422af35ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:45.374295 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d86431-3731-4b4e-9a23-66c422af35ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:45.375928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d86431-3731-4b4e-9a23-66c422af35ed None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:45.394395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-37d86431-3731-4b4e-9a23-66c422af35ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:45.394395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:45.394395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:45.394395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:45.394395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:45.394395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:45.394395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:45.394395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:45.394395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:45.394395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:45.394395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:45.394395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:45.394395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:45.394395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:45.394395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:45.395501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:45.395501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:45.395501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:45.395501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:45.395501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:45.395501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:45.395501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:45.395501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:45.395501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:45.395501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:45.395501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:45.395501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:45.395501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:45.395501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:45.395501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:45.395501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:45.395501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:45.396473 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:45.396473 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:45.396473 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:45.396473 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:45.398304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 265/534] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:45.399234 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d86431-3731-4b4e-9a23-66c422af35ed None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:45.411659 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30774a60-1efe-4f5c-b016-5ec2c75c90c9 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:45.447763 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca9feb-fc40-4c74-a72d-8cc726377d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:45.448376 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca9feb-fc40-4c74-a72d-8cc726377d3f None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:45.448655 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca9feb-fc40-4c74-a72d-8cc726377d3f None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:45.449483 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca9feb-fc40-4c74-a72d-8cc726377d3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:45.450337 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca9feb-fc40-4c74-a72d-8cc726377d3f None admin] RBAC: Adding query filter params (role.id=4798f242077c416e9292660af5469faf, scope.project.id=9cf4f2954dd44516b3e594ed440781cc, user.id=2915babd40aa42e8bf7cc85c5a97daa6) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:45.450644 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca9feb-fc40-4c74-a72d-8cc726377d3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:45.452122 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca9feb-fc40-4c74-a72d-8cc726377d3f None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:45.465666 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 270/535] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:20:45 2022] GET /identity/v3/role_assignments?user.id=2915babd40aa42e8bf7cc85c5a97daa6&scope.project.id=9cf4f2954dd44516b3e594ed440781cc&role.id=4798f242077c416e9292660af5469faf => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:45.466666 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca9feb-fc40-4c74-a72d-8cc726377d3f None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:45.507928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d86431-3731-4b4e-9a23-66c422af35ed None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:45.544536 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c139eff-1513-4335-a5ac-ae1f2e6f98d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:45.545604 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c139eff-1513-4335-a5ac-ae1f2e6f98d3 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:45.546065 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c139eff-1513-4335-a5ac-ae1f2e6f98d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:45.546486 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c139eff-1513-4335-a5ac-ae1f2e6f98d3 None admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:45.547452 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c139eff-1513-4335-a5ac-ae1f2e6f98d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:45.547906 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c139eff-1513-4335-a5ac-ae1f2e6f98d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:45.549622 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c139eff-1513-4335-a5ac-ae1f2e6f98d3 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:45.563240 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 266/536] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:20:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:45.575511 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c139eff-1513-4335-a5ac-ae1f2e6f98d3 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:45.612109 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca9feb-fc40-4c74-a72d-8cc726377d3f None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:45.656364 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1daea2-6c29-4c36-ba63-7c2eb730eb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:45.657060 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1daea2-6c29-4c36-ba63-7c2eb730eb81 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:45.657338 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1daea2-6c29-4c36-ba63-7c2eb730eb81 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:45.657608 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1daea2-6c29-4c36-ba63-7c2eb730eb81 None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:45.658368 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1daea2-6c29-4c36-ba63-7c2eb730eb81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:45.658700 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1daea2-6c29-4c36-ba63-7c2eb730eb81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:45.661082 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1daea2-6c29-4c36-ba63-7c2eb730eb81 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:45.678114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 271/537] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:45.679493 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d76e5-fa40-4665-a017-5be8e60acd84 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:45.679778 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d76e5-fa40-4665-a017-5be8e60acd84 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:45.680058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d76e5-fa40-4665-a017-5be8e60acd84 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:45.681383 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 272/538] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:45.687540 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d76e5-fa40-4665-a017-5be8e60acd84 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:45.712409 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c139eff-1513-4335-a5ac-ae1f2e6f98d3 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:45.754058 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d122ce-41ad-4359-988f-bfc2ccf06b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:45.754717 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d122ce-41ad-4359-988f-bfc2ccf06b38 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:45.754994 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d122ce-41ad-4359-988f-bfc2ccf06b38 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:45.755950 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d122ce-41ad-4359-988f-bfc2ccf06b38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:45.756787 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d122ce-41ad-4359-988f-bfc2ccf06b38 None admin] RBAC: Adding query filter params (role.id=4798f242077c416e9292660af5469faf, scope.project.id=9cf4f2954dd44516b3e594ed440781cc, user.id=2e97d11fab3b4bb092f9623da4e40eb0) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:45.757351 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d122ce-41ad-4359-988f-bfc2ccf06b38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:45.758997 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d122ce-41ad-4359-988f-bfc2ccf06b38 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:45.766796 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 267/539] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:20:45 2022] GET /identity/v3/role_assignments?user.id=2e97d11fab3b4bb092f9623da4e40eb0&scope.project.id=9cf4f2954dd44516b3e594ed440781cc&role.id=4798f242077c416e9292660af5469faf => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:45.768011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc412e-d855-476e-b5e5-e7c7331805ee None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:45.768292 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc412e-d855-476e-b5e5-e7c7331805ee None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:45.768563 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc412e-d855-476e-b5e5-e7c7331805ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:45.789297 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-b6fc412e-d855-476e-b5e5-e7c7331805ee None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:45.791090 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-b6fc412e-d855-476e-b5e5-e7c7331805ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:45.834806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d76e5-fa40-4665-a017-5be8e60acd84 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:45.883473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b6726-09f3-4e47-9087-db304cbd9531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:45.884212 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b6726-09f3-4e47-9087-db304cbd9531 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:45.884537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b6726-09f3-4e47-9087-db304cbd9531 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:45.884804 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b6726-09f3-4e47-9087-db304cbd9531 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:45.892568 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b6726-09f3-4e47-9087-db304cbd9531 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:45.894142 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b6726-09f3-4e47-9087-db304cbd9531 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:45.907097 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 268/540] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:45.909771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-667b6726-09f3-4e47-9087-db304cbd9531 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:20:45.909771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:45.909771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:45.909771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:45.909771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:45.909771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:45.909771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:45.909771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:45.909771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:45.909771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:45.909771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:45.909771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:45.909771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:20:45.909771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:20:45.909771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:20:45.910640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:20:45.910640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:45.910640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:45.910640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:45.910640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:45.910640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:45.910640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:45.910640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:45.910640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:45.910640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:45.910640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:45.910640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:45.910640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:45.910640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:45.910640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:45.910640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:45.910640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:45.911502 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:20:45.911502 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:20:45.911502 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:20:45.911502 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:20:45.911502 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:20:45.911502 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:20:45.911502 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:20:45.911502 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:45.911502 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 273/541] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:20:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:45.927472 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc412e-d855-476e-b5e5-e7c7331805ee None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:45.936068 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b6726-09f3-4e47-9087-db304cbd9531 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:46.066499 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc412e-d855-476e-b5e5-e7c7331805ee None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:46.105647 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40e8fa-ac44-4d4c-9f51-aed3a67921d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:46.106420 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40e8fa-ac44-4d4c-9f51-aed3a67921d4 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:46.106704 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40e8fa-ac44-4d4c-9f51-aed3a67921d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:46.106980 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40e8fa-ac44-4d4c-9f51-aed3a67921d4 None admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:46.109917 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40e8fa-ac44-4d4c-9f51-aed3a67921d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:46.109917 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40e8fa-ac44-4d4c-9f51-aed3a67921d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:46.109917 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40e8fa-ac44-4d4c-9f51-aed3a67921d4 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:46.122139 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 269/542] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:20:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:46.130915 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40e8fa-ac44-4d4c-9f51-aed3a67921d4 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:46.148167 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b6726-09f3-4e47-9087-db304cbd9531 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:46.193428 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90dec82-ecf0-4724-ad3c-b35a7cf3ecb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:46.194270 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dec82-ecf0-4724-ad3c-b35a7cf3ecb7 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:46.194547 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dec82-ecf0-4724-ad3c-b35a7cf3ecb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:46.194817 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dec82-ecf0-4724-ad3c-b35a7cf3ecb7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:46.211945 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90dec82-ecf0-4724-ad3c-b35a7cf3ecb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:46.228754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-e90dec82-ecf0-4724-ad3c-b35a7cf3ecb7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 09:20:46.228754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:46.228754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:46.228754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:46.228754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:46.228754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:46.228754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:46.228754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:46.228754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:46.228754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:46.228754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:46.228754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:46.228754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:46.228754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:46.228754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:46.228754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:46.229726 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:46.229726 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:46.229726 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:46.229726 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:46.229726 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:46.229726 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:46.229726 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:46.229726 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:46.229726 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:46.229726 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:46.229726 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:46.229726 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:46.229726 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:46.229726 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:46.229726 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:46.229726 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:46.230636 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:46.230636 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:46.230636 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:46.230636 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:46.230636 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:46.230636 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:46.230636 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:46.230636 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:46.230636 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:46.230636 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:46.230636 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 09:20:46.230636 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:46.230636 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 274/543] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 12 09:20:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:20:46.246878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90dec82-ecf0-4724-ad3c-b35a7cf3ecb7 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:46.253630 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40e8fa-ac44-4d4c-9f51-aed3a67921d4 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:46.288340 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c115477-e7b1-41dd-b495-72e4c041899d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:46.289003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c115477-e7b1-41dd-b495-72e4c041899d None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:46.289280 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c115477-e7b1-41dd-b495-72e4c041899d None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:46.289553 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c115477-e7b1-41dd-b495-72e4c041899d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:46.290415 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c115477-e7b1-41dd-b495-72e4c041899d None admin] RBAC: Adding query filter params (role.id=4798f242077c416e9292660af5469faf, scope.project.id=9cf4f2954dd44516b3e594ed440781cc, user.id=bf7b793f84bd4a72a68d5ab65221e1a1) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:46.290724 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c115477-e7b1-41dd-b495-72e4c041899d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:46.292218 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c115477-e7b1-41dd-b495-72e4c041899d None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:46.306080 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 270/544] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:20:46 2022] GET /identity/v3/role_assignments?user.id=bf7b793f84bd4a72a68d5ab65221e1a1&scope.project.id=9cf4f2954dd44516b3e594ed440781cc&role.id=4798f242077c416e9292660af5469faf => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:46.443599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90dec82-ecf0-4724-ad3c-b35a7cf3ecb7 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:46.489631 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c628f0-7ca2-407d-95e3-7f08e4d7993e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:46.490726 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c628f0-7ca2-407d-95e3-7f08e4d7993e None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:46.491199 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c628f0-7ca2-407d-95e3-7f08e4d7993e None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:46.491661 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c628f0-7ca2-407d-95e3-7f08e4d7993e None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:46.492675 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c628f0-7ca2-407d-95e3-7f08e4d7993e None admin] RBAC: Adding query filter params (name=service) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:46.493216 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c628f0-7ca2-407d-95e3-7f08e4d7993e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:46.494826 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c628f0-7ca2-407d-95e3-7f08e4d7993e None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:46.509589 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 275/545] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 12 09:20:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:46.515409 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c115477-e7b1-41dd-b495-72e4c041899d None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:46.655786 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c115477-e7b1-41dd-b495-72e4c041899d None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:46.706669 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552d8be-0df1-4657-a18a-bd5729cec11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:46.707389 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552d8be-0df1-4657-a18a-bd5729cec11d None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:46.707669 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552d8be-0df1-4657-a18a-bd5729cec11d None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:46.707942 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552d8be-0df1-4657-a18a-bd5729cec11d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:46.719004 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552d8be-0df1-4657-a18a-bd5729cec11d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:46.720445 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552d8be-0df1-4657-a18a-bd5729cec11d None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:46.741928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-2552d8be-0df1-4657-a18a-bd5729cec11d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:46.741928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:46.741928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:46.741928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:46.741928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:46.741928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:46.741928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:46.741928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:46.741928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:46.741928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:46.741928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:46.741928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:46.741928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:46.741928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:46.741928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:46.742799 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:46.742799 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:46.742799 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:46.742799 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:46.742799 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:46.742799 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:46.742799 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:46.742799 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:46.742799 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:46.742799 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:46.742799 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:46.742799 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:46.742799 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:46.742799 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:46.742799 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:46.742799 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:46.742799 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:46.743674 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:46.743674 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:46.743674 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:46.743674 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:46.743674 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 271/546] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:46.748998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c628f0-7ca2-407d-95e3-7f08e4d7993e None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:46.879691 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c628f0-7ca2-407d-95e3-7f08e4d7993e None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:46.921454 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f474065-073c-4e40-a0fe-ba78d8f82819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:46.922156 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f474065-073c-4e40-a0fe-ba78d8f82819 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:46.922437 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f474065-073c-4e40-a0fe-ba78d8f82819 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:46.922707 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f474065-073c-4e40-a0fe-ba78d8f82819 None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:46.923428 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f474065-073c-4e40-a0fe-ba78d8f82819 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:46.923733 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f474065-073c-4e40-a0fe-ba78d8f82819 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:46.925098 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f474065-073c-4e40-a0fe-ba78d8f82819 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:46.943292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 276/547] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:46.949286 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552d8be-0df1-4657-a18a-bd5729cec11d None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:47.069583 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552d8be-0df1-4657-a18a-bd5729cec11d None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:47.104412 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a759b0e-9794-43f7-afec-f9f12cb40145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:47.104412 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a759b0e-9794-43f7-afec-f9f12cb40145 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:47.104753 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a759b0e-9794-43f7-afec-f9f12cb40145 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:47.104937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a759b0e-9794-43f7-afec-f9f12cb40145 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:47.112967 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a759b0e-9794-43f7-afec-f9f12cb40145 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:47.114488 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a759b0e-9794-43f7-afec-f9f12cb40145 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:47.128504 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-8a759b0e-9794-43f7-afec-f9f12cb40145 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 09:20:47.128504 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:47.128504 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:47.128504 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:47.128504 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:47.128504 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:47.128504 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:47.128504 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:47.128504 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:47.128504 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:47.128504 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:47.128504 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:47.128504 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:20:47.128504 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:20:47.128504 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:20:47.128504 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:20:47.129429 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:47.129429 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:47.129429 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:20:47.129429 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:20:47.129429 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:20:47.129429 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:20:47.129429 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:47.129429 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:47.129429 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:47.129429 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:47.129429 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:47.129429 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:47.129429 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:47.129429 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:47.129429 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:47.129429 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:47.129429 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:47.129429 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:47.130620 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:47.130620 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:47.130620 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:20:47.130620 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:20:47.130620 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:20:47.130620 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:20:47.130620 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:20:47.130620 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:20:47.130620 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 09:20:47.130620 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:47.133998 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 272/548] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:20:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:47.135855 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f474065-073c-4e40-a0fe-ba78d8f82819 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:47.236587 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f474065-073c-4e40-a0fe-ba78d8f82819 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:47.271802 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92db975-39d8-4a4f-8fe3-967bb3008f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:47.272559 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92db975-39d8-4a4f-8fe3-967bb3008f97 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:47.272738 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92db975-39d8-4a4f-8fe3-967bb3008f97 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:47.272996 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92db975-39d8-4a4f-8fe3-967bb3008f97 None admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:47.273823 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92db975-39d8-4a4f-8fe3-967bb3008f97 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:47.274158 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92db975-39d8-4a4f-8fe3-967bb3008f97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:47.275571 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92db975-39d8-4a4f-8fe3-967bb3008f97 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:47.298045 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 277/549] 10.222.0.60 () {56 vars in 1135 bytes} [Thu May 12 09:20:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:47.299661 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a759b0e-9794-43f7-afec-f9f12cb40145 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:47.406312 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a759b0e-9794-43f7-afec-f9f12cb40145 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:47.439558 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466871e9-5bc0-4981-9483-246f752078ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:47.440214 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466871e9-5bc0-4981-9483-246f752078ff None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:47.440495 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466871e9-5bc0-4981-9483-246f752078ff None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:47.440769 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466871e9-5bc0-4981-9483-246f752078ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:47.507712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466871e9-5bc0-4981-9483-246f752078ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:47.509197 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466871e9-5bc0-4981-9483-246f752078ff None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:47.552959 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfae901-5940-427b-a3c7-931481c3b7cc None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:47.553281 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfae901-5940-427b-a3c7-931481c3b7cc None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:47.553505 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfae901-5940-427b-a3c7-931481c3b7cc None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:47.559398 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 278/550] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:20:47.561102 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b3b86-1bb8-481a-9607-e0f5eeb0ab3a None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:47.561394 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b3b86-1bb8-481a-9607-e0f5eeb0ab3a None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:47.561677 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b3b86-1bb8-481a-9607-e0f5eeb0ab3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:47.582529 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-6b2b3b86-1bb8-481a-9607-e0f5eeb0ab3a None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:47.583735 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-6b2b3b86-1bb8-481a-9607-e0f5eeb0ab3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:47.658488 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 273/552] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:20:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:20:47.662048 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 279/552] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:20:47.664631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466871e9-5bc0-4981-9483-246f752078ff None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:47.687895 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b3b86-1bb8-481a-9607-e0f5eeb0ab3a None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:47.796516 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b3b86-1bb8-481a-9607-e0f5eeb0ab3a None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:47.834569 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067aef8-2e04-4b33-b16e-3b181ec47123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:47.835567 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067aef8-2e04-4b33-b16e-3b181ec47123 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:47.835846 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067aef8-2e04-4b33-b16e-3b181ec47123 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:47.836118 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067aef8-2e04-4b33-b16e-3b181ec47123 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:47.849130 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067aef8-2e04-4b33-b16e-3b181ec47123 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:47.858348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-3067aef8-2e04-4b33-b16e-3b181ec47123 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 09:20:47.858348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:47.858348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:47.858348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:47.858348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:47.858348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:47.858348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:47.858348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:47.858348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:47.858348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:47.858348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:47.858348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:47.858348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:47.858348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:47.858348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:47.858348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:47.859313 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:47.859313 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:47.859313 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:47.859313 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:47.859313 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:47.859313 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:47.859313 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:47.859313 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:47.859313 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:47.859313 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:47.859313 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:47.859313 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:47.859313 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:47.859313 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:47.859313 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:47.859313 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:47.860101 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:47.860101 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:47.860101 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:47.860101 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:47.860101 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:47.860101 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:47.860101 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:47.860101 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:47.860101 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:47.860101 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:47.860101 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 09:20:47.860101 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:47.864831 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 280/553] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 12 09:20:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:20:47.866224 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067aef8-2e04-4b33-b16e-3b181ec47123 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:47.892059 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466871e9-5bc0-4981-9483-246f752078ff None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:47.976696 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067aef8-2e04-4b33-b16e-3b181ec47123 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:47.983982 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd9302e-2526-4f98-bbf3-3fb338f32ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:47.984793 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9302e-2526-4f98-bbf3-3fb338f32ea7 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:47.985074 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9302e-2526-4f98-bbf3-3fb338f32ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:47.985346 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9302e-2526-4f98-bbf3-3fb338f32ea7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:48.007976 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd9302e-2526-4f98-bbf3-3fb338f32ea7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:48.009572 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd9302e-2526-4f98-bbf3-3fb338f32ea7 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:48.020550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ad3fc-08f9-4566-a83f-1ab20fea6dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:48.021229 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ad3fc-08f9-4566-a83f-1ab20fea6dbd None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:48.021510 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ad3fc-08f9-4566-a83f-1ab20fea6dbd None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:48.021783 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ad3fc-08f9-4566-a83f-1ab20fea6dbd None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:48.022561 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ad3fc-08f9-4566-a83f-1ab20fea6dbd None admin] RBAC: Adding query filter params (name=service) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:48.022864 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ad3fc-08f9-4566-a83f-1ab20fea6dbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:48.024222 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ad3fc-08f9-4566-a83f-1ab20fea6dbd None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:48.052025 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 281/554] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 12 09:20:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:48.053766 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-5bd9302e-2526-4f98-bbf3-3fb338f32ea7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:48.053766 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:48.053766 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:48.053766 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:48.053766 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:48.053766 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:48.053766 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:48.053766 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:48.053766 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:48.053766 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:48.053766 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:48.053766 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:48.053766 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:48.053766 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:48.053766 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:48.054632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:48.054632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:48.054632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:48.054632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:48.054632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:48.054632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:48.054632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:48.054632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:48.054632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:48.054632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:48.054632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:48.054632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:48.054632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:48.054632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:48.054632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:48.054632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:48.054632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:48.055465 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:48.055465 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:48.055465 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:48.055465 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:48.055465 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 274/555] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:48.061423 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ad3fc-08f9-4566-a83f-1ab20fea6dbd None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:48.069367 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd9302e-2526-4f98-bbf3-3fb338f32ea7 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:48.205949 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ad3fc-08f9-4566-a83f-1ab20fea6dbd None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:48.238214 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df36d0-d624-46fa-a8b3-b3c493c1b1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:48.238571 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df36d0-d624-46fa-a8b3-b3c493c1b1da None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:48.238892 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df36d0-d624-46fa-a8b3-b3c493c1b1da None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:48.239179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df36d0-d624-46fa-a8b3-b3c493c1b1da None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:48.239897 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df36d0-d624-46fa-a8b3-b3c493c1b1da None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:48.240251 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df36d0-d624-46fa-a8b3-b3c493c1b1da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:48.241666 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df36d0-d624-46fa-a8b3-b3c493c1b1da None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:48.258116 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 282/556] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:48.259545 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df36d0-d624-46fa-a8b3-b3c493c1b1da None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:48.261305 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd9302e-2526-4f98-bbf3-3fb338f32ea7 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:48.305003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f168ec4-0fa0-409f-b386-1d6cc65b2f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:48.306150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f168ec4-0fa0-409f-b386-1d6cc65b2f8e None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:48.306433 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f168ec4-0fa0-409f-b386-1d6cc65b2f8e None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:48.306709 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f168ec4-0fa0-409f-b386-1d6cc65b2f8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:48.321204 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f168ec4-0fa0-409f-b386-1d6cc65b2f8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:48.323525 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f168ec4-0fa0-409f-b386-1d6cc65b2f8e None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:48.348262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-5f168ec4-0fa0-409f-b386-1d6cc65b2f8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:48.348262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:48.348262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:48.348262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:48.348262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:48.348262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:48.348262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:48.348262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:48.348262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:48.348262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:48.348262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:48.348262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:48.348262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:48.348262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:48.348262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:48.349169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:48.349169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:48.349169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:48.349169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:48.349169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:48.349169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:48.349169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:48.349169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:48.349169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:48.349169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:48.349169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:48.349169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:48.349169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:48.349169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:48.349169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:48.349169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:48.349169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:48.350137 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:48.350137 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:48.350137 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:48.350137 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:48.354448 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 275/557] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:48.356628 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9db3e-769f-4c6d-8e48-2077c31f712e None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:48.356913 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9db3e-769f-4c6d-8e48-2077c31f712e None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:48.357189 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9db3e-769f-4c6d-8e48-2077c31f712e None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:48.359714 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 276/558] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:48.360415 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9db3e-769f-4c6d-8e48-2077c31f712e None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:48.374793 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df36d0-d624-46fa-a8b3-b3c493c1b1da None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:48.417998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156aaca7-a76b-4a76-b47d-1306323a4276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:48.419220 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156aaca7-a76b-4a76-b47d-1306323a4276 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:48.419776 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156aaca7-a76b-4a76-b47d-1306323a4276 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:48.420054 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156aaca7-a76b-4a76-b47d-1306323a4276 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:48.428980 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156aaca7-a76b-4a76-b47d-1306323a4276 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:48.430623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156aaca7-a76b-4a76-b47d-1306323a4276 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:48.449203 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-156aaca7-a76b-4a76-b47d-1306323a4276 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:20:48.449203 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:48.449203 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:48.449203 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:48.449203 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:48.449203 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:48.449203 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:48.449203 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:48.449203 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:48.449203 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:48.449203 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:48.449203 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:48.449203 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:20:48.449203 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:20:48.449203 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:20:48.450980 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:20:48.450980 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:48.450980 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:48.450980 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:48.450980 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:48.450980 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:48.450980 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:48.450980 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:48.450980 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:48.450980 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:48.450980 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:48.450980 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:48.450980 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:48.450980 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:48.450980 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:48.450980 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:48.450980 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:48.453006 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:20:48.453006 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:20:48.453006 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:20:48.453006 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:20:48.453006 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:20:48.453006 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:20:48.453006 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:20:48.453006 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:48.453006 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 283/559] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:20:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:48.453006 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09aae4-1cb5-4ce5-a680-7a02856697df None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:48.453006 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09aae4-1cb5-4ce5-a680-7a02856697df None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:48.454383 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09aae4-1cb5-4ce5-a680-7a02856697df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:48.473505 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9db3e-769f-4c6d-8e48-2077c31f712e None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:48.476743 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-df09aae4-1cb5-4ce5-a680-7a02856697df None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:48.478052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-df09aae4-1cb5-4ce5-a680-7a02856697df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:48.510088 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc11be-da84-4ade-a126-7eaf93cd88eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:48.510751 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc11be-da84-4ade-a126-7eaf93cd88eb None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:48.510944 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc11be-da84-4ade-a126-7eaf93cd88eb None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:48.511798 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc11be-da84-4ade-a126-7eaf93cd88eb None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:48.512516 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc11be-da84-4ade-a126-7eaf93cd88eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:48.512823 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc11be-da84-4ade-a126-7eaf93cd88eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:48.514259 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc11be-da84-4ade-a126-7eaf93cd88eb None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:48.525493 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 277/560] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:48.526197 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc11be-da84-4ade-a126-7eaf93cd88eb None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:48.554878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 284/561] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:48.556196 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a33b12-bcf4-4ecf-a5a8-84dfc04b0831 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:48.556480 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a33b12-bcf4-4ecf-a5a8-84dfc04b0831 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:48.556749 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a33b12-bcf4-4ecf-a5a8-84dfc04b0831 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:48.558218 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 285/562] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:48.563336 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a33b12-bcf4-4ecf-a5a8-84dfc04b0831 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:48.641482 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc11be-da84-4ade-a126-7eaf93cd88eb None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:48.660734 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a33b12-bcf4-4ecf-a5a8-84dfc04b0831 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:48.675941 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e69870-4ada-4755-97a4-68f8a69f6276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:48.676607 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e69870-4ada-4755-97a4-68f8a69f6276 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:48.676895 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e69870-4ada-4755-97a4-68f8a69f6276 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:48.677157 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e69870-4ada-4755-97a4-68f8a69f6276 None admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:48.677960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e69870-4ada-4755-97a4-68f8a69f6276 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:48.678270 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e69870-4ada-4755-97a4-68f8a69f6276 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:48.679717 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e69870-4ada-4755-97a4-68f8a69f6276 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:48.691464 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 278/563] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:20:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:48.692696 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b92ec-3abe-43fb-9507-7f8f673e7615 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:48.692979 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b92ec-3abe-43fb-9507-7f8f673e7615 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:48.693251 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b92ec-3abe-43fb-9507-7f8f673e7615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:48.698378 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e83a7-977e-4614-800e-3cb42404ca16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:48.699219 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e83a7-977e-4614-800e-3cb42404ca16 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:48.699499 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e83a7-977e-4614-800e-3cb42404ca16 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:48.699771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e83a7-977e-4614-800e-3cb42404ca16 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:48.706948 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e83a7-977e-4614-800e-3cb42404ca16 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:48.708379 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e83a7-977e-4614-800e-3cb42404ca16 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:48.711755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-099b92ec-3abe-43fb-9507-7f8f673e7615 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:48.713030 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-099b92ec-3abe-43fb-9507-7f8f673e7615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:48.723108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-963e83a7-977e-4614-800e-3cb42404ca16 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 09:20:48.723108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:48.723108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:48.723108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:48.723108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:48.723108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:48.723108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:48.723108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:48.723108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:48.723108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:48.723108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:48.723108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:48.723108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:20:48.723108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:20:48.723108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:20:48.723108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:20:48.724546 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:48.724546 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:48.724546 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:20:48.724546 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:20:48.724546 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:20:48.724546 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:20:48.724546 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:48.724546 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:48.724546 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:48.724546 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:48.724546 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:48.724546 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:48.724546 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:48.724546 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:48.724546 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:48.724546 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:48.724546 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:48.724546 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:48.726348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:48.726348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:48.726348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:20:48.726348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:20:48.726348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:20:48.726348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:20:48.726348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:20:48.726348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:20:48.726348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 09:20:48.726348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:48.726348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 286/564] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:20:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:48.726348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e83a7-977e-4614-800e-3cb42404ca16 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:48.782616 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 279/565] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:48.783386 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b92ec-3abe-43fb-9507-7f8f673e7615 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:48.833451 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e83a7-977e-4614-800e-3cb42404ca16 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:48.865750 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d870744-f343-4871-942a-cd2569318f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:48.866579 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d870744-f343-4871-942a-cd2569318f6f None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:48.866866 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d870744-f343-4871-942a-cd2569318f6f None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:48.867140 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d870744-f343-4871-942a-cd2569318f6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:48.877424 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d870744-f343-4871-942a-cd2569318f6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:48.878868 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b92ec-3abe-43fb-9507-7f8f673e7615 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:48.885824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-2d870744-f343-4871-942a-cd2569318f6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 09:20:48.885824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:48.885824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:48.885824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:48.885824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:48.885824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:48.885824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:48.885824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:48.885824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:48.885824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:48.885824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:48.885824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:48.885824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:48.885824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:48.885824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:48.885824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:48.887179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:48.887179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:48.887179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:48.887179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:48.887179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:48.887179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:48.887179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:48.887179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:48.887179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:48.887179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:48.887179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:48.887179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:48.887179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:48.887179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:48.887179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:48.887179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:48.888254 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:48.888254 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:48.888254 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:48.888254 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:48.888254 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:48.888254 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:48.888254 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:48.888254 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:48.888254 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:48.888254 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:48.888254 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 09:20:48.888254 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:48.888254 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 287/566] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 12 09:20:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:48.888254 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d870744-f343-4871-942a-cd2569318f6f None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:48.922119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d5d17-9476-41c2-8e8c-fba24d25cba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:48.923103 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d5d17-9476-41c2-8e8c-fba24d25cba5 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:48.923561 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d5d17-9476-41c2-8e8c-fba24d25cba5 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:48.924018 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d5d17-9476-41c2-8e8c-fba24d25cba5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:48.925046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d5d17-9476-41c2-8e8c-fba24d25cba5 None admin] RBAC: Adding query filter params (role.id=4798f242077c416e9292660af5469faf, scope.project.id=9cf4f2954dd44516b3e594ed440781cc, user.id=f7693a31911346f9bb2c01efcd8e16e6) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:48.925541 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d5d17-9476-41c2-8e8c-fba24d25cba5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:48.927206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d5d17-9476-41c2-8e8c-fba24d25cba5 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:48.932751 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 280/567] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:20:48 2022] GET /identity/v3/role_assignments?user.id=f7693a31911346f9bb2c01efcd8e16e6&scope.project.id=9cf4f2954dd44516b3e594ed440781cc&role.id=4798f242077c416e9292660af5469faf => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:48.933586 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d5d17-9476-41c2-8e8c-fba24d25cba5 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:49.012239 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d870744-f343-4871-942a-cd2569318f6f None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:49.055197 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39392143-dbb2-4492-b675-c0fca441fbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:49.056504 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39392143-dbb2-4492-b675-c0fca441fbe6 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:49.056985 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39392143-dbb2-4492-b675-c0fca441fbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:49.057614 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39392143-dbb2-4492-b675-c0fca441fbe6 None admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:49.059629 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39392143-dbb2-4492-b675-c0fca441fbe6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:49.060450 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39392143-dbb2-4492-b675-c0fca441fbe6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:49.062304 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39392143-dbb2-4492-b675-c0fca441fbe6 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:49.069914 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d5d17-9476-41c2-8e8c-fba24d25cba5 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:49.088852 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 288/568] 10.222.0.60 () {56 vars in 1137 bytes} [Thu May 12 09:20:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:49.091183 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39392143-dbb2-4492-b675-c0fca441fbe6 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:49.112202 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1edfc-12e4-45b4-a1b4-b2970f5c3049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:49.113030 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1edfc-12e4-45b4-a1b4-b2970f5c3049 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:49.113307 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1edfc-12e4-45b4-a1b4-b2970f5c3049 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:49.113584 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1edfc-12e4-45b4-a1b4-b2970f5c3049 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:49.124513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1edfc-12e4-45b4-a1b4-b2970f5c3049 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:49.132636 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-daa1edfc-12e4-45b4-a1b4-b2970f5c3049 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 09:20:49.132636 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:49.132636 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:49.132636 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:49.132636 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:49.132636 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:49.132636 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:49.132636 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:49.132636 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:49.132636 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:49.132636 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:49.132636 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:49.132636 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:49.132636 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:49.132636 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:49.132636 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:49.133658 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:49.133658 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:49.133658 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:49.133658 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:49.133658 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:49.133658 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:49.133658 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:49.133658 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:49.133658 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:49.133658 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:49.133658 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:49.133658 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:49.133658 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:49.133658 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:49.133658 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:49.133658 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:49.134844 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:49.134844 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:49.134844 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:49.134844 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:49.134844 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:49.134844 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:49.134844 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:49.134844 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:49.134844 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:49.134844 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:49.134844 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 09:20:49.134844 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:49.134844 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 281/569] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 12 09:20:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:49.135549 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681f8af-b386-4581-af90-b70838b67793 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:49.135549 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681f8af-b386-4581-af90-b70838b67793 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:49.137260 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681f8af-b386-4581-af90-b70838b67793 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:49.138725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 282/570] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:49.138725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681f8af-b386-4581-af90-b70838b67793 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:49.200397 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39392143-dbb2-4492-b675-c0fca441fbe6 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:49.233546 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2bce0e-a3ad-4bea-8ce8-3fd70c3fa4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:49.234235 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2bce0e-a3ad-4bea-8ce8-3fd70c3fa4e1 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:49.234512 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2bce0e-a3ad-4bea-8ce8-3fd70c3fa4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:49.234782 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2bce0e-a3ad-4bea-8ce8-3fd70c3fa4e1 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:49.235577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2bce0e-a3ad-4bea-8ce8-3fd70c3fa4e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:49.235879 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2bce0e-a3ad-4bea-8ce8-3fd70c3fa4e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:49.237282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2bce0e-a3ad-4bea-8ce8-3fd70c3fa4e1 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:49.243331 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681f8af-b386-4581-af90-b70838b67793 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:49.245198 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 289/571] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 12 09:20:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:49.246168 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2bce0e-a3ad-4bea-8ce8-3fd70c3fa4e1 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:49.281024 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055bdbd-293a-4d25-8668-672ad74bafff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:49.281818 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055bdbd-293a-4d25-8668-672ad74bafff None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:49.282127 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055bdbd-293a-4d25-8668-672ad74bafff None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:49.282395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055bdbd-293a-4d25-8668-672ad74bafff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:49.292661 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f055bdbd-293a-4d25-8668-672ad74bafff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:49.294132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f055bdbd-293a-4d25-8668-672ad74bafff None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:49.311158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-f055bdbd-293a-4d25-8668-672ad74bafff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:49.311158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:49.311158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:49.311158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:49.311158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:49.311158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:49.311158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:49.311158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:49.311158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:49.311158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:49.311158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:49.311158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:49.311158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:49.311158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:49.311158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:49.313008 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:49.313008 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:49.313008 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:49.313008 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:49.313008 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:49.313008 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:49.313008 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:49.313008 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:49.313008 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:49.313008 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:49.313008 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:49.313008 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:49.313008 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:49.313008 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:49.313008 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:49.313008 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:49.313008 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:49.314381 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:49.314381 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:49.314381 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:49.314381 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:49.314381 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 283/572] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:49.314381 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f775e-6d9a-48f1-ba0b-9276c790847b None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:49.314381 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f775e-6d9a-48f1-ba0b-9276c790847b None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:49.314805 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f775e-6d9a-48f1-ba0b-9276c790847b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:49.332235 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-d95f775e-6d9a-48f1-ba0b-9276c790847b None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:49.333403 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-d95f775e-6d9a-48f1-ba0b-9276c790847b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:49.349735 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2bce0e-a3ad-4bea-8ce8-3fd70c3fa4e1 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:49.383072 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20576269-631c-42b3-86cb-e4713c7989b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:49.383807 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20576269-631c-42b3-86cb-e4713c7989b6 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:49.384065 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20576269-631c-42b3-86cb-e4713c7989b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:49.384338 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20576269-631c-42b3-86cb-e4713c7989b6 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:49.385069 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20576269-631c-42b3-86cb-e4713c7989b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:49.385417 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20576269-631c-42b3-86cb-e4713c7989b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:49.387353 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20576269-631c-42b3-86cb-e4713c7989b6 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:49.405918 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 284/573] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:49.405918 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f775e-6d9a-48f1-ba0b-9276c790847b None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:49.406181 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 290/574] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 12 09:20:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:49.406181 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20576269-631c-42b3-86cb-e4713c7989b6 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:49.496579 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f775e-6d9a-48f1-ba0b-9276c790847b None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:49.509552 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20576269-631c-42b3-86cb-e4713c7989b6 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:49.532537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac1bd9-e182-4462-ba2f-08337c4c777c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:49.533650 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac1bd9-e182-4462-ba2f-08337c4c777c None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:49.534013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac1bd9-e182-4462-ba2f-08337c4c777c None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:49.534290 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac1bd9-e182-4462-ba2f-08337c4c777c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:49.542197 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a498e-ca72-40e8-a209-6bd1a28df784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:49.543431 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a498e-ca72-40e8-a209-6bd1a28df784 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:49.543714 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a498e-ca72-40e8-a209-6bd1a28df784 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:49.543989 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a498e-ca72-40e8-a209-6bd1a28df784 None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:49.544703 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a498e-ca72-40e8-a209-6bd1a28df784 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:49.544911 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac1bd9-e182-4462-ba2f-08337c4c777c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:49.544996 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a498e-ca72-40e8-a209-6bd1a28df784 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:49.546254 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac1bd9-e182-4462-ba2f-08337c4c777c None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:49.546369 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a498e-ca72-40e8-a209-6bd1a28df784 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:49.557819 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 291/575] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:49.558946 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a498e-ca72-40e8-a209-6bd1a28df784 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:49.563611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-12ac1bd9-e182-4462-ba2f-08337c4c777c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:49.563611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:49.563611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:49.563611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:49.563611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:49.563611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:49.563611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:49.563611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:49.563611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:49.563611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:49.563611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:49.563611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:49.563611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:49.563611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:49.563611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:49.564492 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:49.564492 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:49.564492 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:49.564492 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:49.564492 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:49.564492 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:49.564492 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:49.564492 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:49.564492 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:49.564492 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:49.564492 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:49.564492 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:49.564492 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:49.564492 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:49.564492 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:49.564492 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:49.564492 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:49.565426 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:49.565426 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:49.565426 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:49.565426 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:49.565426 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 285/576] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:49.565725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac1bd9-e182-4462-ba2f-08337c4c777c None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:49.658995 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a498e-ca72-40e8-a209-6bd1a28df784 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:49.662667 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac1bd9-e182-4462-ba2f-08337c4c777c None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:49.695112 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b22841-8ba1-4d34-8d3d-082df46333b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:49.695915 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b22841-8ba1-4d34-8d3d-082df46333b8 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:49.696199 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b22841-8ba1-4d34-8d3d-082df46333b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:49.696473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b22841-8ba1-4d34-8d3d-082df46333b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:49.698261 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95851791-a336-4eff-aeb5-afef08a95d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:49.699503 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95851791-a336-4eff-aeb5-afef08a95d7c None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:49.699781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95851791-a336-4eff-aeb5-afef08a95d7c None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:49.700052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95851791-a336-4eff-aeb5-afef08a95d7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:49.708321 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b22841-8ba1-4d34-8d3d-082df46333b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:49.709749 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b22841-8ba1-4d34-8d3d-082df46333b8 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:49.711800 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95851791-a336-4eff-aeb5-afef08a95d7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:49.719900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-95851791-a336-4eff-aeb5-afef08a95d7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 09:20:49.719900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:49.719900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:49.719900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:49.719900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:49.719900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:49.719900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:49.719900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:49.719900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:49.719900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:49.719900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:49.719900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:49.719900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:49.719900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:49.719900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:49.719900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:49.720926 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:49.720926 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:49.720926 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:49.720926 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:49.720926 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:49.720926 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:49.720926 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:49.720926 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:49.720926 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:49.720926 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:49.720926 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:49.720926 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:49.720926 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:49.720926 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:49.720926 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:49.720926 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:49.721779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:49.721779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:49.721779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:49.721779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:49.721779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:49.721779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:49.721779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:49.721779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:49.721779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:49.721779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:49.721779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 09:20:49.721779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:49.728662 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 286/577] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 12 09:20:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:49.728662 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95851791-a336-4eff-aeb5-afef08a95d7c None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:49.728893 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-c6b22841-8ba1-4d34-8d3d-082df46333b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:49.728893 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:49.728893 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:49.728893 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:49.728893 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:49.728893 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:49.728893 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:49.728893 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:49.728893 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:49.728893 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:49.728893 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:49.728893 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:49.728893 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:49.728893 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:49.728893 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:49.729720 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:49.729720 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:49.729720 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:49.729720 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:49.729720 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:49.729720 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:49.729720 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:49.729720 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:49.729720 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:49.729720 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:49.729720 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:49.729720 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:49.729720 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:49.729720 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:49.729720 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:49.729720 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:49.729720 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:49.731392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:49.731392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:49.731392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:49.731392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:49.731392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 292/578] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:49.731392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b22841-8ba1-4d34-8d3d-082df46333b8 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:49.826516 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b22841-8ba1-4d34-8d3d-082df46333b8 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:49.827520 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95851791-a336-4eff-aeb5-afef08a95d7c None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:49.858114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b08321-5289-4d0d-9540-56af109997d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:49.858775 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b08321-5289-4d0d-9540-56af109997d0 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:49.859052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b08321-5289-4d0d-9540-56af109997d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:49.859224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66c8ab-aeb6-409e-92ee-82cb8cdc3fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:49.859355 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b08321-5289-4d0d-9540-56af109997d0 None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:49.859981 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66c8ab-aeb6-409e-92ee-82cb8cdc3fe8 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:49.860082 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b08321-5289-4d0d-9540-56af109997d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:49.860268 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66c8ab-aeb6-409e-92ee-82cb8cdc3fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:49.860364 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b08321-5289-4d0d-9540-56af109997d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:49.860545 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66c8ab-aeb6-409e-92ee-82cb8cdc3fe8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:49.861664 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b08321-5289-4d0d-9540-56af109997d0 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:49.867024 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66c8ab-aeb6-409e-92ee-82cb8cdc3fe8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:49.868462 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66c8ab-aeb6-409e-92ee-82cb8cdc3fe8 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:49.877124 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 293/579] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:49.877124 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b08321-5289-4d0d-9540-56af109997d0 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:49.882895 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-6c66c8ab-aeb6-409e-92ee-82cb8cdc3fe8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:20:49.882895 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:49.882895 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:49.882895 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:49.882895 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:49.882895 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:49.882895 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:49.882895 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:49.882895 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:49.882895 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:49.882895 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:49.882895 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:49.882895 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:20:49.882895 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:20:49.882895 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:20:49.883774 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:20:49.883774 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:49.883774 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:49.883774 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:49.883774 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:49.883774 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:49.883774 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:49.883774 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:49.883774 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:49.883774 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:49.883774 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:49.883774 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:49.883774 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:49.883774 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:49.883774 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:49.883774 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:49.883774 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:49.884690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:20:49.884690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:20:49.884690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:20:49.884690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:20:49.884690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:20:49.884690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:20:49.884690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:20:49.884690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:49.884690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 287/580] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:20:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:49.885194 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66c8ab-aeb6-409e-92ee-82cb8cdc3fe8 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:49.978065 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b08321-5289-4d0d-9540-56af109997d0 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:49.985836 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66c8ab-aeb6-409e-92ee-82cb8cdc3fe8 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:50.012365 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda19a47-3bad-47da-9ed5-3fc0d6028760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:50.013037 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda19a47-3bad-47da-9ed5-3fc0d6028760 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:50.013318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda19a47-3bad-47da-9ed5-3fc0d6028760 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:50.013595 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda19a47-3bad-47da-9ed5-3fc0d6028760 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:50.014375 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda19a47-3bad-47da-9ed5-3fc0d6028760 None admin] RBAC: Adding query filter params (name=service) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:50.014775 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda19a47-3bad-47da-9ed5-3fc0d6028760 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:50.016159 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda19a47-3bad-47da-9ed5-3fc0d6028760 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:50.020645 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd540c-6459-466c-aeb2-5c08ff4b0ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:50.021300 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd540c-6459-466c-aeb2-5c08ff4b0ebf None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:50.021579 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd540c-6459-466c-aeb2-5c08ff4b0ebf None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:50.021848 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd540c-6459-466c-aeb2-5c08ff4b0ebf None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:50.022589 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd540c-6459-466c-aeb2-5c08ff4b0ebf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:50.022891 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd540c-6459-466c-aeb2-5c08ff4b0ebf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:50.024232 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd540c-6459-466c-aeb2-5c08ff4b0ebf None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:50.029027 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 294/581] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 12 09:20:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:50.029702 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda19a47-3bad-47da-9ed5-3fc0d6028760 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:50.036083 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 288/582] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:50.036083 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd540c-6459-466c-aeb2-5c08ff4b0ebf None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:50.132093 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda19a47-3bad-47da-9ed5-3fc0d6028760 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:50.147119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd540c-6459-466c-aeb2-5c08ff4b0ebf None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:50.165977 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3322d91-c261-4233-bc51-c184cf1e59aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:50.167399 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3322d91-c261-4233-bc51-c184cf1e59aa None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:50.167833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3322d91-c261-4233-bc51-c184cf1e59aa None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:50.168505 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3322d91-c261-4233-bc51-c184cf1e59aa None admin] PATH_INFO: `/v3/users/nova` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:50.178239 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3322d91-c261-4233-bc51-c184cf1e59aa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:50.179845 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3322d91-c261-4233-bc51-c184cf1e59aa None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:50.180120 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4136e9a-93be-499f-b5e9-47fc0f568460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:50.180772 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4136e9a-93be-499f-b5e9-47fc0f568460 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:50.181054 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4136e9a-93be-499f-b5e9-47fc0f568460 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:50.181325 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4136e9a-93be-499f-b5e9-47fc0f568460 None admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:50.182122 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4136e9a-93be-499f-b5e9-47fc0f568460 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:50.182469 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4136e9a-93be-499f-b5e9-47fc0f568460 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:50.184361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4136e9a-93be-499f-b5e9-47fc0f568460 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:50.196118 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 289/583] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:20:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:50.196895 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4136e9a-93be-499f-b5e9-47fc0f568460 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:50.197869 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-b3322d91-c261-4233-bc51-c184cf1e59aa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 09:20:50.197869 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:50.197869 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:50.197869 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:50.197869 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:50.197869 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:50.197869 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:50.197869 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:50.197869 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:50.197869 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:50.197869 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:50.197869 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:50.197869 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:20:50.197869 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:20:50.197869 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:20:50.197869 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:20:50.199381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:50.199381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:50.199381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:20:50.199381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:20:50.199381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:20:50.199381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:20:50.199381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:50.199381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:50.199381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:50.199381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:50.199381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:50.199381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:50.199381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:50.199381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:50.199381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:50.199381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:50.199381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:50.199381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:50.202727 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:50.202727 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:50.202727 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:20:50.202727 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:20:50.202727 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:20:50.202727 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:20:50.202727 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:20:50.202727 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:20:50.202727 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 09:20:50.202727 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:50.202727 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 295/584] 10.222.0.60 () {56 vars in 1093 bytes} [Thu May 12 09:20:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:50.202727 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3322d91-c261-4233-bc51-c184cf1e59aa None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:50.297000 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4136e9a-93be-499f-b5e9-47fc0f568460 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:50.310880 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3322d91-c261-4233-bc51-c184cf1e59aa None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:50.331194 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3363fb0-7394-4c21-b02d-b13403d96a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:50.332266 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3363fb0-7394-4c21-b02d-b13403d96a75 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:50.332266 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3363fb0-7394-4c21-b02d-b13403d96a75 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:50.332521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3363fb0-7394-4c21-b02d-b13403d96a75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:50.342113 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3363fb0-7394-4c21-b02d-b13403d96a75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:50.343539 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3363fb0-7394-4c21-b02d-b13403d96a75 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:50.345177 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc9f20-ef9f-4149-9bf4-0479f8239635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:50.346009 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc9f20-ef9f-4149-9bf4-0479f8239635 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:50.346289 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc9f20-ef9f-4149-9bf4-0479f8239635 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:50.346559 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc9f20-ef9f-4149-9bf4-0479f8239635 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:50.353717 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc9f20-ef9f-4149-9bf4-0479f8239635 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:50.355126 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc9f20-ef9f-4149-9bf4-0479f8239635 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:50.360155 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-c3363fb0-7394-4c21-b02d-b13403d96a75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:50.360155 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:50.360155 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:50.360155 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:50.360155 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:50.360155 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:50.360155 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:50.360155 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:50.360155 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:50.360155 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:50.360155 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:50.360155 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:50.360155 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:50.360155 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:50.360155 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:50.361060 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:50.361060 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:50.361060 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:50.361060 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:50.361060 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:50.361060 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:50.361060 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:50.361060 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:50.361060 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:50.361060 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:50.361060 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:50.361060 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:50.361060 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:50.361060 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:50.361060 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:50.361060 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:50.361060 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:50.366755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:50.366755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:50.366755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:50.366755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:50.366755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 290/585] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:50.366755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3363fb0-7394-4c21-b02d-b13403d96a75 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:50.368787 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-29bc9f20-ef9f-4149-9bf4-0479f8239635 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 09:20:50.368787 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:50.368787 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:50.368787 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:50.368787 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:50.368787 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:50.368787 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:50.368787 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:50.368787 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:50.368787 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:50.368787 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:50.368787 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:50.368787 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:20:50.368787 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:20:50.368787 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:20:50.368787 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:20:50.369721 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:50.369721 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:50.369721 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:20:50.369721 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:20:50.369721 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:20:50.369721 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:20:50.369721 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:50.369721 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:50.369721 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:50.369721 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:50.369721 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:50.369721 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:50.369721 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:50.369721 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:50.369721 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:50.369721 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:50.369721 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:50.369721 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:50.371236 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:50.371236 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:50.371236 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:20:50.371236 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:20:50.371236 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:20:50.371236 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:20:50.371236 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:20:50.371236 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:20:50.371236 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 09:20:50.371236 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:50.371236 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 296/586] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:20:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:50.371836 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc9f20-ef9f-4149-9bf4-0479f8239635 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:50.462139 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3363fb0-7394-4c21-b02d-b13403d96a75 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:50.468968 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc9f20-ef9f-4149-9bf4-0479f8239635 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:50.494266 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401eca4c-65e3-4765-a2dd-6fa0000489ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:50.495173 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401eca4c-65e3-4765-a2dd-6fa0000489ab None admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:50.495450 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401eca4c-65e3-4765-a2dd-6fa0000489ab None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:50.496232 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401eca4c-65e3-4765-a2dd-6fa0000489ab None admin] PATH_INFO: `/v3/projects/9cf4f2954dd44516b3e594ed440781cc/users/0981a8c6d9ac413b99aae95a6cdd3be5/roles/4798f242077c416e9292660af5469faf` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:50.501818 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d56ddd-9f12-4e9e-b3f4-7105188f7377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:50.502612 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d56ddd-9f12-4e9e-b3f4-7105188f7377 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:50.502895 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d56ddd-9f12-4e9e-b3f4-7105188f7377 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:50.503167 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d56ddd-9f12-4e9e-b3f4-7105188f7377 None admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:50.503994 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d56ddd-9f12-4e9e-b3f4-7105188f7377 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:50.504297 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d56ddd-9f12-4e9e-b3f4-7105188f7377 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:50.505986 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d56ddd-9f12-4e9e-b3f4-7105188f7377 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:50.510648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401eca4c-65e3-4765-a2dd-6fa0000489ab None admin] RBAC: Authorizing `identity:create_grant(project_id=9cf4f2954dd44516b3e594ed440781cc, user_id=0981a8c6d9ac413b99aae95a6cdd3be5, role_id=4798f242077c416e9292660af5469faf)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:50.512153 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401eca4c-65e3-4765-a2dd-6fa0000489ab None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:50.528243 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 297/587] 10.222.0.60 () {56 vars in 1133 bytes} [Thu May 12 09:20:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:50.528243 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d56ddd-9f12-4e9e-b3f4-7105188f7377 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:50.530966 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 291/588] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 12 09:20:50 2022] PUT /identity/v3/projects/9cf4f2954dd44516b3e594ed440781cc/users/0981a8c6d9ac413b99aae95a6cdd3be5/roles/4798f242077c416e9292660af5469faf => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:20:50.538038 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401eca4c-65e3-4765-a2dd-6fa0000489ab None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:50.633637 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d56ddd-9f12-4e9e-b3f4-7105188f7377 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:50.655107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401eca4c-65e3-4765-a2dd-6fa0000489ab None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:50.670335 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06e486-f7f4-4bea-b9df-4434f0079d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:50.671145 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06e486-f7f4-4bea-b9df-4434f0079d1a None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:50.671357 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06e486-f7f4-4bea-b9df-4434f0079d1a None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:50.671568 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06e486-f7f4-4bea-b9df-4434f0079d1a None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:50.672299 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06e486-f7f4-4bea-b9df-4434f0079d1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:50.672600 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06e486-f7f4-4bea-b9df-4434f0079d1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:50.674021 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06e486-f7f4-4bea-b9df-4434f0079d1a None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:50.686514 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 298/589] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:50.687438 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06e486-f7f4-4bea-b9df-4434f0079d1a None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:50.695284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbd122-1812-451b-b2c4-677ed502e14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:50.696531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbd122-1812-451b-b2c4-677ed502e14d None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:50.697057 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbd122-1812-451b-b2c4-677ed502e14d None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:50.697533 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbd122-1812-451b-b2c4-677ed502e14d None admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:50.699308 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adbd122-1812-451b-b2c4-677ed502e14d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:50.699847 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adbd122-1812-451b-b2c4-677ed502e14d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:50.701562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adbd122-1812-451b-b2c4-677ed502e14d None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:50.722410 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 292/590] 10.222.0.60 () {56 vars in 1137 bytes} [Thu May 12 09:20:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:50.723597 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbd122-1812-451b-b2c4-677ed502e14d None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:50.792961 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06e486-f7f4-4bea-b9df-4434f0079d1a None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:50.834924 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a98d53-03ec-4612-8402-f021a7274ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:50.836551 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a98d53-03ec-4612-8402-f021a7274ad0 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:50.836976 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a98d53-03ec-4612-8402-f021a7274ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:50.837539 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a98d53-03ec-4612-8402-f021a7274ad0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:50.840912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbd122-1812-451b-b2c4-677ed502e14d None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:50.850710 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a98d53-03ec-4612-8402-f021a7274ad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:50.852914 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a98d53-03ec-4612-8402-f021a7274ad0 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:50.873770 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560e662-e4dc-471c-8825-3f20c6a816f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:50.874611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560e662-e4dc-471c-8825-3f20c6a816f7 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:50.874892 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560e662-e4dc-471c-8825-3f20c6a816f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:50.875165 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560e662-e4dc-471c-8825-3f20c6a816f7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:50.875445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-c6a98d53-03ec-4612-8402-f021a7274ad0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:50.875445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:50.875445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:50.875445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:50.875445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:50.875445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:50.875445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:50.875445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:50.875445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:50.875445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:50.875445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:50.875445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:50.875445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:50.875445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:50.875445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:50.876465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:50.876465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:50.876465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:50.876465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:50.876465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:50.876465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:50.876465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:50.876465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:50.876465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:50.876465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:50.876465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:50.876465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:50.876465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:50.876465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:50.876465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:50.876465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:50.876465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:50.877573 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:50.877573 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:50.877573 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:50.877573 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:50.879938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 299/591] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:50.881196 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a98d53-03ec-4612-8402-f021a7274ad0 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:50.885058 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4560e662-e4dc-471c-8825-3f20c6a816f7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:50.887176 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4560e662-e4dc-471c-8825-3f20c6a816f7 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:50.902361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-4560e662-e4dc-471c-8825-3f20c6a816f7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 09:20:50.902361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:50.902361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:50.902361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:50.902361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:50.902361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:50.902361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:50.902361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:50.902361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:50.902361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:50.902361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:50.902361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:50.902361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:20:50.902361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:20:50.902361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:20:50.902361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:20:50.903521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:50.903521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:50.903521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:20:50.903521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:20:50.903521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:20:50.903521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:20:50.903521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:50.903521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:50.903521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:50.903521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:50.903521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:50.903521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:50.903521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:50.903521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:50.903521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:50.903521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:50.903521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:50.903521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:50.904702 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:50.904702 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:50.904702 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:20:50.904702 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:20:50.904702 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:20:50.904702 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:20:50.904702 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:20:50.904702 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:20:50.904702 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 09:20:50.904702 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:50.906520 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 293/592] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 12 09:20:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:50.911985 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560e662-e4dc-471c-8825-3f20c6a816f7 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:51.013503 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a98d53-03ec-4612-8402-f021a7274ad0 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:51.016184 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560e662-e4dc-471c-8825-3f20c6a816f7 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:51.051210 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f965c74-23d3-408d-bc03-456421f7e882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:51.052188 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f965c74-23d3-408d-bc03-456421f7e882 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:51.052568 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f965c74-23d3-408d-bc03-456421f7e882 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:51.052941 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f965c74-23d3-408d-bc03-456421f7e882 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:51.054316 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b457623-e784-489c-80ce-df23e5482c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:51.055298 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b457623-e784-489c-80ce-df23e5482c7a None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:51.056056 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b457623-e784-489c-80ce-df23e5482c7a None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:51.056475 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b457623-e784-489c-80ce-df23e5482c7a None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:51.057334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b457623-e784-489c-80ce-df23e5482c7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:51.057780 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b457623-e784-489c-80ce-df23e5482c7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:51.059967 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b457623-e784-489c-80ce-df23e5482c7a None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:51.065392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f965c74-23d3-408d-bc03-456421f7e882 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:51.066987 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f965c74-23d3-408d-bc03-456421f7e882 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:51.075727 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 294/593] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:51.079356 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b457623-e784-489c-80ce-df23e5482c7a None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:51.088621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-8f965c74-23d3-408d-bc03-456421f7e882 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:51.088621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:51.088621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:51.088621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:51.088621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:51.088621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:51.088621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:51.088621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:51.088621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:51.088621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:51.088621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:51.088621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:51.088621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:51.088621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:51.088621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:51.090351 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:51.090351 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:51.090351 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:51.090351 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:51.090351 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:51.090351 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:51.090351 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:51.090351 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:51.090351 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:51.090351 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:51.090351 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:51.090351 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:51.090351 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:51.090351 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:51.090351 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:51.090351 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:51.090351 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:51.091435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:51.091435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:51.091435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:51.091435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:51.093831 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 300/594] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:51.101148 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f965c74-23d3-408d-bc03-456421f7e882 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:51.198896 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b457623-e784-489c-80ce-df23e5482c7a None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:51.199085 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f965c74-23d3-408d-bc03-456421f7e882 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:51.232285 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b1086-11d3-48ea-807a-d75a6b96ab63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:51.232957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b1086-11d3-48ea-807a-d75a6b96ab63 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:51.233241 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b1086-11d3-48ea-807a-d75a6b96ab63 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:51.233519 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b1086-11d3-48ea-807a-d75a6b96ab63 None admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:51.234368 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b1086-11d3-48ea-807a-d75a6b96ab63 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:51.234676 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b1086-11d3-48ea-807a-d75a6b96ab63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:51.235111 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fce259-20d3-4d91-8ac3-efcac8b0a3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:51.236065 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fce259-20d3-4d91-8ac3-efcac8b0a3f6 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:51.236196 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b1086-11d3-48ea-807a-d75a6b96ab63 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:51.236597 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fce259-20d3-4d91-8ac3-efcac8b0a3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:51.237009 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fce259-20d3-4d91-8ac3-efcac8b0a3f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:51.243627 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fce259-20d3-4d91-8ac3-efcac8b0a3f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:51.245198 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fce259-20d3-4d91-8ac3-efcac8b0a3f6 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:51.252594 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 295/595] 10.222.0.60 () {56 vars in 1139 bytes} [Thu May 12 09:20:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:51.253574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b1086-11d3-48ea-807a-d75a6b96ab63 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:51.259287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-04fce259-20d3-4d91-8ac3-efcac8b0a3f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:20:51.259287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:51.259287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:51.259287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:51.259287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:51.259287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:51.259287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:51.259287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:51.259287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:51.259287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:51.259287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:51.259287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:51.259287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:20:51.259287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:20:51.259287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:20:51.260173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:20:51.260173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:51.260173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:51.260173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:51.260173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:51.260173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:51.260173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:51.260173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:51.260173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:51.260173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:51.260173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:51.260173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:51.260173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:51.260173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:51.260173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:51.260173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:51.260173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:51.261066 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:20:51.261066 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:20:51.261066 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:20:51.261066 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:20:51.261066 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:20:51.261066 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:20:51.261066 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:20:51.261066 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:51.261066 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 301/596] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:20:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:51.262056 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8f44b-9f72-4234-91a1-c5a01cd5a481 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:51.262056 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8f44b-9f72-4234-91a1-c5a01cd5a481 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:51.262228 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8f44b-9f72-4234-91a1-c5a01cd5a481 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:51.266009 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 302/597] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:51.266009 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8f44b-9f72-4234-91a1-c5a01cd5a481 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:51.362440 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b1086-11d3-48ea-807a-d75a6b96ab63 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:51.369579 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8f44b-9f72-4234-91a1-c5a01cd5a481 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:51.395238 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433b588-4798-4f3e-a167-366906c521c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:51.395891 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433b588-4798-4f3e-a167-366906c521c7 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:51.396176 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433b588-4798-4f3e-a167-366906c521c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:51.396447 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433b588-4798-4f3e-a167-366906c521c7 None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:51.397156 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433b588-4798-4f3e-a167-366906c521c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:51.397461 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433b588-4798-4f3e-a167-366906c521c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:51.398844 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433b588-4798-4f3e-a167-366906c521c7 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:51.403196 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab63eb-c96f-4f36-a577-662d17236c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:51.403991 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab63eb-c96f-4f36-a577-662d17236c22 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:51.404270 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab63eb-c96f-4f36-a577-662d17236c22 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:51.404545 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab63eb-c96f-4f36-a577-662d17236c22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:51.414223 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 296/598] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:51.414223 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433b588-4798-4f3e-a167-366906c521c7 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:51.419206 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab63eb-c96f-4f36-a577-662d17236c22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:51.420719 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab63eb-c96f-4f36-a577-662d17236c22 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:51.438521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-46ab63eb-c96f-4f36-a577-662d17236c22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:51.438521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:51.438521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:51.438521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:51.438521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:51.438521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:51.438521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:51.438521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:51.438521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:51.438521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:51.438521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:51.438521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:51.438521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:51.438521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:51.438521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:51.439424 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:51.439424 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:51.439424 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:51.439424 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:51.439424 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:51.439424 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:51.439424 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:51.439424 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:51.439424 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:51.439424 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:51.439424 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:51.439424 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:51.439424 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:51.439424 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:51.439424 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:51.439424 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:51.439424 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:51.440327 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:51.440327 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:51.440327 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:51.440327 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:51.440327 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 303/599] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:51.441027 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b031d77-5230-46f2-828c-131d2df031b5 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:51.441312 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b031d77-5230-46f2-828c-131d2df031b5 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:51.441586 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b031d77-5230-46f2-828c-131d2df031b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:51.459068 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-6b031d77-5230-46f2-828c-131d2df031b5 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:51.460160 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-6b031d77-5230-46f2-828c-131d2df031b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:51.511921 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433b588-4798-4f3e-a167-366906c521c7 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:51.528575 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 304/600] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:51.530064 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b031d77-5230-46f2-828c-131d2df031b5 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:51.544142 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab28c2c-cfd0-4424-9d8d-76f672a6f0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:51.544804 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab28c2c-cfd0-4424-9d8d-76f672a6f0b0 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:51.545087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab28c2c-cfd0-4424-9d8d-76f672a6f0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:51.545364 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab28c2c-cfd0-4424-9d8d-76f672a6f0b0 None admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:51.546232 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab28c2c-cfd0-4424-9d8d-76f672a6f0b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:51.546541 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab28c2c-cfd0-4424-9d8d-76f672a6f0b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:51.548046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab28c2c-cfd0-4424-9d8d-76f672a6f0b0 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:51.560681 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 297/601] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:20:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:51.561465 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab28c2c-cfd0-4424-9d8d-76f672a6f0b0 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:51.644073 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b031d77-5230-46f2-828c-131d2df031b5 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:51.659783 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab28c2c-cfd0-4424-9d8d-76f672a6f0b0 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:51.683761 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7469d84-ecb8-426f-80e5-37aa24a1a4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:51.684759 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7469d84-ecb8-426f-80e5-37aa24a1a4be None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:51.685344 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7469d84-ecb8-426f-80e5-37aa24a1a4be None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:51.685793 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7469d84-ecb8-426f-80e5-37aa24a1a4be None admin] PATH_INFO: `/v3/projects/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:51.692428 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7469d84-ecb8-426f-80e5-37aa24a1a4be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:51.693877 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7469d84-ecb8-426f-80e5-37aa24a1a4be None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:51.694116 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71085274-9515-43d9-91b7-530a1fb64bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:51.694686 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71085274-9515-43d9-91b7-530a1fb64bc8 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:51.694970 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71085274-9515-43d9-91b7-530a1fb64bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:51.695244 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71085274-9515-43d9-91b7-530a1fb64bc8 None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:51.695959 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71085274-9515-43d9-91b7-530a1fb64bc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:51.696269 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71085274-9515-43d9-91b7-530a1fb64bc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:51.697628 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71085274-9515-43d9-91b7-530a1fb64bc8 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:51.713670 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 298/602] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:51.713833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-f7469d84-ecb8-426f-80e5-37aa24a1a4be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:20:51.713833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:51.713833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:51.713833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:51.713833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:51.713833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:51.713833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:51.713833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:51.713833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:51.713833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:51.713833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:51.713833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:51.713833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:20:51.713833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:20:51.713833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:20:51.714806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:20:51.714806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:51.714806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:51.714806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:51.714806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:51.714806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:51.714806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:51.714806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:51.714806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:51.714806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:51.714806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:51.714806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:51.714806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:51.714806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:51.714806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:51.714806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:51.714806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:51.715751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:20:51.715751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:20:51.715751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:20:51.715751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:20:51.715751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:20:51.715751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:20:51.715751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:20:51.715751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:51.716210 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71085274-9515-43d9-91b7-530a1fb64bc8 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:51.716289 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 305/603] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:20:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:51.716289 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7469d84-ecb8-426f-80e5-37aa24a1a4be None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:51.813053 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71085274-9515-43d9-91b7-530a1fb64bc8 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:51.816159 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7469d84-ecb8-426f-80e5-37aa24a1a4be None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:51.845823 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5281e-30f9-4646-986d-431d211fe0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:51.846642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5281e-30f9-4646-986d-431d211fe0d0 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:51.846923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5281e-30f9-4646-986d-431d211fe0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:51.847196 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5281e-30f9-4646-986d-431d211fe0d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:51.851289 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc500c-306c-4da7-82a3-5ae97838037d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:51.852165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc500c-306c-4da7-82a3-5ae97838037d None admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:51.852439 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc500c-306c-4da7-82a3-5ae97838037d None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:51.852706 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc500c-306c-4da7-82a3-5ae97838037d None admin] PATH_INFO: `/v3/projects/9cf4f2954dd44516b3e594ed440781cc/users/2915babd40aa42e8bf7cc85c5a97daa6/roles/4798f242077c416e9292660af5469faf` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:51.857227 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b5281e-30f9-4646-986d-431d211fe0d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:51.865003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-d4b5281e-30f9-4646-986d-431d211fe0d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 09:20:51.865003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:51.865003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:51.865003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:51.865003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:51.865003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:51.865003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:51.865003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:51.865003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:51.865003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:51.865003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:51.865003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:51.865003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:51.865003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:51.865003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:51.865003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:51.866029 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:51.866029 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:51.866029 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:51.866029 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:51.866029 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:51.866029 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:51.866029 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:51.866029 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:51.866029 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:51.866029 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:51.866029 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:51.866029 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:51.866029 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:51.866029 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:51.866029 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:51.866029 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:51.866892 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:51.866892 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:51.866892 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:51.866892 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:51.866892 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:51.866892 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:51.866892 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:51.866892 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:51.866892 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:51.866892 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:51.866892 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 09:20:51.866892 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:51.866892 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 299/604] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 12 09:20:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:51.867624 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5281e-30f9-4646-986d-431d211fe0d0 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:51.869525 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc500c-306c-4da7-82a3-5ae97838037d None admin] RBAC: Authorizing `identity:create_grant(project_id=9cf4f2954dd44516b3e594ed440781cc, user_id=2915babd40aa42e8bf7cc85c5a97daa6, role_id=4798f242077c416e9292660af5469faf)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:51.871545 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc500c-306c-4da7-82a3-5ae97838037d None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:51.892368 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 306/605] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 12 09:20:51 2022] PUT /identity/v3/projects/9cf4f2954dd44516b3e594ed440781cc/users/2915babd40aa42e8bf7cc85c5a97daa6/roles/4798f242077c416e9292660af5469faf => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:20:51.893188 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc500c-306c-4da7-82a3-5ae97838037d None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:52.004868 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc500c-306c-4da7-82a3-5ae97838037d None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:52.016328 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5281e-30f9-4646-986d-431d211fe0d0 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:52.044479 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cb88c-fe78-492c-a11f-6b41c959da0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:52.045156 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cb88c-fe78-492c-a11f-6b41c959da0e None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:52.045436 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cb88c-fe78-492c-a11f-6b41c959da0e None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:52.045706 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cb88c-fe78-492c-a11f-6b41c959da0e None admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:52.047750 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815cb88c-fe78-492c-a11f-6b41c959da0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:52.047955 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815cb88c-fe78-492c-a11f-6b41c959da0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:52.049461 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815cb88c-fe78-492c-a11f-6b41c959da0e None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:52.060086 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e187eb-2ec5-4b94-abab-ffea2bcdf7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:52.062027 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e187eb-2ec5-4b94-abab-ffea2bcdf7d9 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:52.062622 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e187eb-2ec5-4b94-abab-ffea2bcdf7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:52.063102 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e187eb-2ec5-4b94-abab-ffea2bcdf7d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:52.071442 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e187eb-2ec5-4b94-abab-ffea2bcdf7d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:52.073343 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e187eb-2ec5-4b94-abab-ffea2bcdf7d9 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:52.073827 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 307/606] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:20:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:52.074804 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cb88c-fe78-492c-a11f-6b41c959da0e None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:52.093522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-36e187eb-2ec5-4b94-abab-ffea2bcdf7d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:20:52.093522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:52.093522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:52.093522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:52.093522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:52.093522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:52.093522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:52.093522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:52.093522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:52.093522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:52.093522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:52.093522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:52.093522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:20:52.093522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:20:52.093522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:20:52.094594 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:20:52.094594 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:52.094594 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:52.094594 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:52.094594 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:52.094594 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:52.094594 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:52.094594 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:52.094594 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:52.094594 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:52.094594 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:52.094594 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:52.094594 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:52.094594 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:52.094594 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:52.094594 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:52.094594 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:52.095595 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:20:52.095595 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:20:52.095595 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:20:52.095595 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:20:52.095595 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:20:52.095595 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:20:52.095595 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:20:52.095595 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:52.106481 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 300/607] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:20:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:52.107542 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e187eb-2ec5-4b94-abab-ffea2bcdf7d9 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:52.188624 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cb88c-fe78-492c-a11f-6b41c959da0e None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:52.213074 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e187eb-2ec5-4b94-abab-ffea2bcdf7d9 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:52.231707 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41523cb3-da52-4e31-9698-d2804bb9a2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:52.232390 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41523cb3-da52-4e31-9698-d2804bb9a2e9 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:52.232670 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41523cb3-da52-4e31-9698-d2804bb9a2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:52.232943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41523cb3-da52-4e31-9698-d2804bb9a2e9 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:52.233693 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41523cb3-da52-4e31-9698-d2804bb9a2e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:52.234026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41523cb3-da52-4e31-9698-d2804bb9a2e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:52.235846 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41523cb3-da52-4e31-9698-d2804bb9a2e9 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:52.246720 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 308/608] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 12 09:20:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:52.247554 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41523cb3-da52-4e31-9698-d2804bb9a2e9 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:52.250301 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132604cf-76c4-4dbb-a560-e08e34ce4138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:52.251707 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132604cf-76c4-4dbb-a560-e08e34ce4138 None admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:52.252239 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132604cf-76c4-4dbb-a560-e08e34ce4138 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:52.252717 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132604cf-76c4-4dbb-a560-e08e34ce4138 None admin] PATH_INFO: `/v3/projects/9cf4f2954dd44516b3e594ed440781cc/users/2e97d11fab3b4bb092f9623da4e40eb0/roles/4798f242077c416e9292660af5469faf` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:52.269123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132604cf-76c4-4dbb-a560-e08e34ce4138 None admin] RBAC: Authorizing `identity:create_grant(project_id=9cf4f2954dd44516b3e594ed440781cc, user_id=2e97d11fab3b4bb092f9623da4e40eb0, role_id=4798f242077c416e9292660af5469faf)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:52.270940 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132604cf-76c4-4dbb-a560-e08e34ce4138 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:52.296284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 301/609] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 12 09:20:52 2022] PUT /identity/v3/projects/9cf4f2954dd44516b3e594ed440781cc/users/2e97d11fab3b4bb092f9623da4e40eb0/roles/4798f242077c416e9292660af5469faf => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:20:52.301999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132604cf-76c4-4dbb-a560-e08e34ce4138 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:52.361412 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41523cb3-da52-4e31-9698-d2804bb9a2e9 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:52.397811 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7bc22b-7800-4180-bc76-ec28783d7928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:52.398959 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bc22b-7800-4180-bc76-ec28783d7928 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:52.399461 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bc22b-7800-4180-bc76-ec28783d7928 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:52.399933 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bc22b-7800-4180-bc76-ec28783d7928 None admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:52.400928 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7bc22b-7800-4180-bc76-ec28783d7928 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:52.401457 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7bc22b-7800-4180-bc76-ec28783d7928 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:52.410342 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7bc22b-7800-4180-bc76-ec28783d7928 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:52.432289 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 309/610] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:20:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:52.438610 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7bc22b-7800-4180-bc76-ec28783d7928 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:52.456608 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132604cf-76c4-4dbb-a560-e08e34ce4138 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:52.489000 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c724240-676a-47ec-a785-2f990ee3a5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:52.489823 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c724240-676a-47ec-a785-2f990ee3a5f4 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:52.490136 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c724240-676a-47ec-a785-2f990ee3a5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:52.490411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c724240-676a-47ec-a785-2f990ee3a5f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:52.502405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c724240-676a-47ec-a785-2f990ee3a5f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:52.503872 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c724240-676a-47ec-a785-2f990ee3a5f4 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:52.523017 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-5c724240-676a-47ec-a785-2f990ee3a5f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:52.523017 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:52.523017 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:52.523017 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:52.523017 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:52.523017 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:52.523017 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:52.523017 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:52.523017 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:52.523017 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:52.523017 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:52.523017 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:52.523017 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:52.523017 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:52.523017 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:52.524158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:52.524158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:52.524158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:52.524158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:52.524158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:52.524158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:52.524158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:52.524158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:52.524158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:52.524158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:52.524158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:52.524158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:52.524158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:52.524158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:52.524158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:52.524158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:52.524158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:52.525402 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:52.525402 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:52.525402 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:52.525402 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:52.525402 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 302/611] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:52.530988 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c724240-676a-47ec-a785-2f990ee3a5f4 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:52.632882 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7bc22b-7800-4180-bc76-ec28783d7928 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:52.669749 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68a16a-2a64-40ac-80d3-c56480f06bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:52.670849 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68a16a-2a64-40ac-80d3-c56480f06bab None admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:52.671222 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68a16a-2a64-40ac-80d3-c56480f06bab None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:52.671595 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68a16a-2a64-40ac-80d3-c56480f06bab None admin] PATH_INFO: `/v3/projects/9cf4f2954dd44516b3e594ed440781cc/users/bf7b793f84bd4a72a68d5ab65221e1a1/roles/4798f242077c416e9292660af5469faf` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:52.684101 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c724240-676a-47ec-a785-2f990ee3a5f4 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:52.687637 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68a16a-2a64-40ac-80d3-c56480f06bab None admin] RBAC: Authorizing `identity:create_grant(project_id=9cf4f2954dd44516b3e594ed440781cc, user_id=bf7b793f84bd4a72a68d5ab65221e1a1, role_id=4798f242077c416e9292660af5469faf)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:52.689093 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68a16a-2a64-40ac-80d3-c56480f06bab None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:52.705842 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 310/612] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 12 09:20:52 2022] PUT /identity/v3/projects/9cf4f2954dd44516b3e594ed440781cc/users/bf7b793f84bd4a72a68d5ab65221e1a1/roles/4798f242077c416e9292660af5469faf => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:20:52.725310 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505039c0-7219-4b61-b801-ae436ebe0009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:52.726456 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505039c0-7219-4b61-b801-ae436ebe0009 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:52.726999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505039c0-7219-4b61-b801-ae436ebe0009 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:52.727519 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505039c0-7219-4b61-b801-ae436ebe0009 None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:52.728612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505039c0-7219-4b61-b801-ae436ebe0009 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:52.729164 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505039c0-7219-4b61-b801-ae436ebe0009 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:52.730967 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505039c0-7219-4b61-b801-ae436ebe0009 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:52.751747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 303/613] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:52.757624 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68a16a-2a64-40ac-80d3-c56480f06bab None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:52.888974 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68a16a-2a64-40ac-80d3-c56480f06bab None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:52.911454 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc5959-dedd-4dec-91c2-f69ba9c47ddd None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:52.912107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc5959-dedd-4dec-91c2-f69ba9c47ddd None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:52.912606 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc5959-dedd-4dec-91c2-f69ba9c47ddd None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:52.918451 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 304/614] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:52.931746 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4c25d-9d4a-4882-8156-aabf93236076 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:52.932087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4c25d-9d4a-4882-8156-aabf93236076 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:52.932378 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4c25d-9d4a-4882-8156-aabf93236076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:52.939213 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157b0d0-18ed-4c51-8f73-d7a230c71209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:52.940037 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157b0d0-18ed-4c51-8f73-d7a230c71209 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:52.940330 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157b0d0-18ed-4c51-8f73-d7a230c71209 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:52.940590 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157b0d0-18ed-4c51-8f73-d7a230c71209 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:52.960099 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157b0d0-18ed-4c51-8f73-d7a230c71209 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:52.962850 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157b0d0-18ed-4c51-8f73-d7a230c71209 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:52.974788 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-d6e4c25d-9d4a-4882-8156-aabf93236076 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:52.975992 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-d6e4c25d-9d4a-4882-8156-aabf93236076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:52.987212 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-8157b0d0-18ed-4c51-8f73-d7a230c71209 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 09:20:52.987212 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:52.987212 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:52.987212 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:52.987212 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:52.987212 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:52.987212 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:52.987212 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:52.987212 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:52.987212 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:52.987212 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:52.987212 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:52.987212 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:20:52.987212 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:20:52.987212 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:20:52.987212 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:20:52.988435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:52.988435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:52.988435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:20:52.988435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:20:52.988435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:20:52.988435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:20:52.988435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:52.988435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:52.988435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:52.988435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:52.988435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:52.988435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:52.988435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:52.988435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:52.988435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:52.988435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:52.988435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:52.988435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:52.989644 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:52.989644 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:52.989644 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:20:52.989644 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:20:52.989644 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:20:52.989644 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:20:52.989644 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:20:52.989644 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:20:52.989644 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 09:20:52.989644 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:52.989644 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 311/615] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:20:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:52.993868 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157b0d0-18ed-4c51-8f73-d7a230c71209 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:53.063387 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 305/616] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:53.086968 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4c25d-9d4a-4882-8156-aabf93236076 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:53.098546 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157b0d0-18ed-4c51-8f73-d7a230c71209 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:53.134930 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ebd65-1183-40aa-85f7-a1744cbee13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:53.135778 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ebd65-1183-40aa-85f7-a1744cbee13d None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:53.136201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ebd65-1183-40aa-85f7-a1744cbee13d None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:53.136574 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ebd65-1183-40aa-85f7-a1744cbee13d None admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:53.137518 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ebd65-1183-40aa-85f7-a1744cbee13d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:53.137950 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ebd65-1183-40aa-85f7-a1744cbee13d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:53.139547 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ebd65-1183-40aa-85f7-a1744cbee13d None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:53.157934 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 312/617] 10.222.0.60 () {56 vars in 1135 bytes} [Thu May 12 09:20:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:53.162925 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ebd65-1183-40aa-85f7-a1744cbee13d None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:53.198005 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4c25d-9d4a-4882-8156-aabf93236076 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:53.249592 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a5299-2327-4828-9077-7cc6ab619800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:53.250576 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a5299-2327-4828-9077-7cc6ab619800 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:53.252342 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a5299-2327-4828-9077-7cc6ab619800 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:53.254935 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a5299-2327-4828-9077-7cc6ab619800 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:53.276140 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a5299-2327-4828-9077-7cc6ab619800 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:53.285021 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-d45a5299-2327-4828-9077-7cc6ab619800 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 09:20:53.285021 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:53.285021 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:53.285021 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:53.285021 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:53.285021 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:53.285021 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:53.285021 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:53.285021 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:53.285021 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:53.285021 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:53.285021 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:53.285021 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:53.285021 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:53.285021 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:53.285021 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:53.286304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:53.286304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:53.286304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:53.286304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:53.286304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:53.286304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:53.286304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:53.286304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:53.286304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:53.286304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:53.286304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:53.286304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:53.286304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:53.286304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:53.286304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:53.286304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:53.287377 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:53.287377 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:53.287377 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:53.287377 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:53.287377 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:53.287377 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:53.287377 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:53.287377 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:53.287377 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:53.287377 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:53.287377 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 09:20:53.287377 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:53.301549 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 306/618] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 12 09:20:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:53.313081 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ebd65-1183-40aa-85f7-a1744cbee13d None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:53.323712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a5299-2327-4828-9077-7cc6ab619800 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:53.381139 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74190254-c686-4327-86d2-07b41baa44db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:53.382252 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74190254-c686-4327-86d2-07b41baa44db None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:53.382546 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74190254-c686-4327-86d2-07b41baa44db None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:53.382825 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74190254-c686-4327-86d2-07b41baa44db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:53.395798 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74190254-c686-4327-86d2-07b41baa44db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:53.397321 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74190254-c686-4327-86d2-07b41baa44db None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:53.415698 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-74190254-c686-4327-86d2-07b41baa44db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:53.415698 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:53.415698 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:53.415698 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:53.415698 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:53.415698 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:53.415698 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:53.415698 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:53.415698 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:53.415698 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:53.415698 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:53.415698 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:53.415698 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:53.415698 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:53.415698 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:53.418387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:53.418387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:53.418387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:53.418387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:53.418387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:53.418387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:53.418387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:53.418387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:53.418387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:53.418387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:53.418387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:53.418387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:53.418387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:53.418387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:53.418387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:53.418387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:53.418387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:53.420411 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:53.420411 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:53.420411 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:53.420411 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:53.420411 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 313/619] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:53.423541 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74190254-c686-4327-86d2-07b41baa44db None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:53.496814 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a5299-2327-4828-9077-7cc6ab619800 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:53.532201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74190254-c686-4327-86d2-07b41baa44db None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:53.550410 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb81dad-24da-4b52-9b82-663f7d18b9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:53.551143 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb81dad-24da-4b52-9b82-663f7d18b9e8 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:53.551425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb81dad-24da-4b52-9b82-663f7d18b9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:53.551752 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb81dad-24da-4b52-9b82-663f7d18b9e8 None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:53.552502 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb81dad-24da-4b52-9b82-663f7d18b9e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:53.552808 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb81dad-24da-4b52-9b82-663f7d18b9e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:53.554216 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb81dad-24da-4b52-9b82-663f7d18b9e8 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:53.566455 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f9277-0fbd-45ef-b46a-b84c6a801f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:53.567130 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f9277-0fbd-45ef-b46a-b84c6a801f23 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:53.567410 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f9277-0fbd-45ef-b46a-b84c6a801f23 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:53.567685 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f9277-0fbd-45ef-b46a-b84c6a801f23 None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:53.568401 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f9277-0fbd-45ef-b46a-b84c6a801f23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:53.568705 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f9277-0fbd-45ef-b46a-b84c6a801f23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:53.569631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 307/620] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 12 09:20:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:53.570081 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f9277-0fbd-45ef-b46a-b84c6a801f23 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:53.577084 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb81dad-24da-4b52-9b82-663f7d18b9e8 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:53.587532 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 314/621] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:53.593079 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f9277-0fbd-45ef-b46a-b84c6a801f23 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:53.721863 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f9277-0fbd-45ef-b46a-b84c6a801f23 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:53.756336 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89481c-fa70-4abc-8a40-633f2fddea1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:53.757142 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89481c-fa70-4abc-8a40-633f2fddea1c None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:53.757425 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89481c-fa70-4abc-8a40-633f2fddea1c None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:53.757695 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89481c-fa70-4abc-8a40-633f2fddea1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:53.764667 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89481c-fa70-4abc-8a40-633f2fddea1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:53.766146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89481c-fa70-4abc-8a40-633f2fddea1c None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:53.780259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-4b89481c-fa70-4abc-8a40-633f2fddea1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:20:53.780259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:53.780259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:53.780259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:53.780259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:53.780259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:53.780259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:53.780259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:53.780259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:53.780259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:53.780259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:53.780259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:53.780259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:20:53.780259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:20:53.780259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:20:53.781195 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:20:53.781195 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:53.781195 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:53.781195 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:53.781195 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:53.781195 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:53.781195 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:53.781195 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:53.781195 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:53.781195 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:53.781195 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:53.781195 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:53.781195 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:53.781195 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:53.781195 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:53.781195 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:53.781195 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:53.782146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:20:53.782146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:20:53.782146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:20:53.782146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:20:53.782146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:20:53.782146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:20:53.782146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:20:53.782146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:53.782146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 315/622] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:20:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:53.786821 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89481c-fa70-4abc-8a40-633f2fddea1c None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:53.801769 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb81dad-24da-4b52-9b82-663f7d18b9e8 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:53.895556 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df1474-4904-43b7-a1d2-da1236d6ed0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:53.896369 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df1474-4904-43b7-a1d2-da1236d6ed0d None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:53.896653 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df1474-4904-43b7-a1d2-da1236d6ed0d None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:53.896929 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df1474-4904-43b7-a1d2-da1236d6ed0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:53.897098 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89481c-fa70-4abc-8a40-633f2fddea1c None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:53.923401 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df1474-4904-43b7-a1d2-da1236d6ed0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:53.925233 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df1474-4904-43b7-a1d2-da1236d6ed0d None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:53.939264 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb6ef7-919f-4e90-b386-b7d88c535c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:53.939995 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb6ef7-919f-4e90-b386-b7d88c535c01 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:53.940279 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb6ef7-919f-4e90-b386-b7d88c535c01 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:53.940545 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb6ef7-919f-4e90-b386-b7d88c535c01 None admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:53.941335 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb6ef7-919f-4e90-b386-b7d88c535c01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:53.941643 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb6ef7-919f-4e90-b386-b7d88c535c01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:53.943697 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb6ef7-919f-4e90-b386-b7d88c535c01 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:53.956991 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 316/623] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:20:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:53.962079 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-d4df1474-4904-43b7-a1d2-da1236d6ed0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:53.962079 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:53.962079 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:53.962079 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:53.962079 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:53.962079 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:53.962079 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:53.962079 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:53.962079 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:53.962079 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:53.962079 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:53.962079 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:53.962079 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:53.962079 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:53.962079 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:53.962970 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:53.962970 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:53.962970 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:53.962970 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:53.962970 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:53.962970 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:53.962970 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:53.962970 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:53.962970 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:53.962970 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:53.962970 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:53.962970 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:53.962970 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:53.962970 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:53.962970 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:53.962970 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:53.962970 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:53.963892 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:53.963892 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:53.963892 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:53.963892 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:53.964644 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb6ef7-919f-4e90-b386-b7d88c535c01 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:53.964743 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 308/624] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:20:53.973731 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df1474-4904-43b7-a1d2-da1236d6ed0d None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:54.105608 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df1474-4904-43b7-a1d2-da1236d6ed0d None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:54.138862 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07516473-6466-4bad-b61a-a6df03272af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:54.139521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07516473-6466-4bad-b61a-a6df03272af6 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:54.139799 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07516473-6466-4bad-b61a-a6df03272af6 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:54.140069 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07516473-6466-4bad-b61a-a6df03272af6 None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:54.140781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07516473-6466-4bad-b61a-a6df03272af6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:54.141085 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07516473-6466-4bad-b61a-a6df03272af6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:54.142478 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07516473-6466-4bad-b61a-a6df03272af6 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:54.155195 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 309/625] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:20:54.160442 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07516473-6466-4bad-b61a-a6df03272af6 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:54.191869 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb6ef7-919f-4e90-b386-b7d88c535c01 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:54.259713 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07516473-6466-4bad-b61a-a6df03272af6 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:54.279968 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d65cd-7091-4d90-a834-ee7a25ca0555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:54.280873 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d65cd-7091-4d90-a834-ee7a25ca0555 None admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:54.281154 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d65cd-7091-4d90-a834-ee7a25ca0555 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:54.281429 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d65cd-7091-4d90-a834-ee7a25ca0555 None admin] PATH_INFO: `/v3/projects/9cf4f2954dd44516b3e594ed440781cc/users/f7693a31911346f9bb2c01efcd8e16e6/roles/4798f242077c416e9292660af5469faf` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:54.294132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8be42-e9de-48d7-95f0-8a052c754401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:54.294978 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8be42-e9de-48d7-95f0-8a052c754401 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:54.295259 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8be42-e9de-48d7-95f0-8a052c754401 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:54.295528 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8be42-e9de-48d7-95f0-8a052c754401 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:54.302922 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8be42-e9de-48d7-95f0-8a052c754401 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:54.304371 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8be42-e9de-48d7-95f0-8a052c754401 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:54.308076 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d65cd-7091-4d90-a834-ee7a25ca0555 None admin] RBAC: Authorizing `identity:create_grant(project_id=9cf4f2954dd44516b3e594ed440781cc, user_id=f7693a31911346f9bb2c01efcd8e16e6, role_id=4798f242077c416e9292660af5469faf)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:54.309606 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d65cd-7091-4d90-a834-ee7a25ca0555 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:54.319726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-a7e8be42-e9de-48d7-95f0-8a052c754401 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 09:20:54.319726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:54.319726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:54.319726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:54.319726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:54.319726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:54.319726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:54.319726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:54.319726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:54.319726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:54.319726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:54.319726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:54.319726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:20:54.319726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:20:54.319726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:20:54.319726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:20:54.320725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:54.320725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:54.320725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:20:54.320725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:20:54.320725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:20:54.320725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:20:54.320725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:54.320725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:54.320725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:54.320725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:54.320725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:54.320725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:54.320725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:54.320725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:54.320725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:54.320725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:54.320725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:54.320725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:54.321685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:54.321685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:54.321685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:20:54.321685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:20:54.321685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:20:54.321685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:20:54.321685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:20:54.321685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:20:54.321685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 09:20:54.321685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:54.321685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 310/626] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:20:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:20:54.327375 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8be42-e9de-48d7-95f0-8a052c754401 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:54.342166 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 317/627] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 12 09:20:53 2022] PUT /identity/v3/projects/9cf4f2954dd44516b3e594ed440781cc/users/f7693a31911346f9bb2c01efcd8e16e6/roles/4798f242077c416e9292660af5469faf => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:20:54.437350 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8be42-e9de-48d7-95f0-8a052c754401 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:54.474746 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d8358-ab45-447b-9c62-155dcd09226e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:54.475427 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d8358-ab45-447b-9c62-155dcd09226e None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:54.475708 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d8358-ab45-447b-9c62-155dcd09226e None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:54.475973 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d8358-ab45-447b-9c62-155dcd09226e None admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:54.476817 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d8358-ab45-447b-9c62-155dcd09226e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:54.477182 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d8358-ab45-447b-9c62-155dcd09226e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:54.478730 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d8358-ab45-447b-9c62-155dcd09226e None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:54.499710 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 311/628] 10.222.0.60 () {56 vars in 1137 bytes} [Thu May 12 09:20:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:54.505886 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d65cd-7091-4d90-a834-ee7a25ca0555 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:54.602607 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb2fa9-4689-456e-a998-4ded449ef899 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:54.602798 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb2fa9-4689-456e-a998-4ded449ef899 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:54.603119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb2fa9-4689-456e-a998-4ded449ef899 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:54.604569 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 312/629] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:54.615238 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a9fe1-2577-4e06-b3b1-231ba4351d77 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:54.615568 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a9fe1-2577-4e06-b3b1-231ba4351d77 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:54.615790 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a9fe1-2577-4e06-b3b1-231ba4351d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:54.641576 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-3a2a9fe1-2577-4e06-b3b1-231ba4351d77 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:54.642865 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-3a2a9fe1-2577-4e06-b3b1-231ba4351d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:54.662607 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d65cd-7091-4d90-a834-ee7a25ca0555 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:54.697036 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3039e90-c5b6-4b90-b6f1-84d346883513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:54.697990 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3039e90-c5b6-4b90-b6f1-84d346883513 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:54.698419 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3039e90-c5b6-4b90-b6f1-84d346883513 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:54.699465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3039e90-c5b6-4b90-b6f1-84d346883513 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:54.721988 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 313/630] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:54.743027 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a9fe1-2577-4e06-b3b1-231ba4351d77 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:54.812407 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3039e90-c5b6-4b90-b6f1-84d346883513 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:54.813950 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3039e90-c5b6-4b90-b6f1-84d346883513 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:54.912109 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a9fe1-2577-4e06-b3b1-231ba4351d77 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:54.950195 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65105648-c117-4b80-911d-d3140f8b3544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:54.951067 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65105648-c117-4b80-911d-d3140f8b3544 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:54.951363 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65105648-c117-4b80-911d-d3140f8b3544 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:54.951664 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65105648-c117-4b80-911d-d3140f8b3544 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:54.963728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65105648-c117-4b80-911d-d3140f8b3544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:54.973137 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-65105648-c117-4b80-911d-d3140f8b3544 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 09:20:54.973137 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:54.973137 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:54.973137 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:54.973137 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:54.973137 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:54.973137 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:54.973137 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:54.973137 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:54.973137 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:54.973137 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:54.973137 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:54.973137 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:54.973137 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:54.973137 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:54.973137 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:54.974123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:54.974123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:54.974123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:54.974123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:54.974123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:54.974123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:54.974123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:54.974123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:54.974123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:54.974123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:54.974123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:54.974123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:54.974123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:54.974123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:54.974123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:54.974123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:54.975251 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:54.975251 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:54.975251 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:54.975251 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:54.975251 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:54.975251 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:54.975251 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:54.975251 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:54.975251 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:54.975251 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:54.975251 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 09:20:54.975251 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:54.975251 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 314/631] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 12 09:20:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:20:54.982474 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65105648-c117-4b80-911d-d3140f8b3544 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:55.017696 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 318/632] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:20:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:20:55.022768 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3039e90-c5b6-4b90-b6f1-84d346883513 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:55.133323 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65105648-c117-4b80-911d-d3140f8b3544 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:55.168917 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f3761-955f-48c7-bb8f-08ea16c0ce97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:55.169509 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f3761-955f-48c7-bb8f-08ea16c0ce97 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:55.169794 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f3761-955f-48c7-bb8f-08ea16c0ce97 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:55.170123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f3761-955f-48c7-bb8f-08ea16c0ce97 None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:55.170875 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f3761-955f-48c7-bb8f-08ea16c0ce97 None admin] RBAC: Adding query filter params (name=service) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:55.171187 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f3761-955f-48c7-bb8f-08ea16c0ce97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:55.172579 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f3761-955f-48c7-bb8f-08ea16c0ce97 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:55.181052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 315/633] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 12 09:20:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:55.187728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f3761-955f-48c7-bb8f-08ea16c0ce97 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:55.205598 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3039e90-c5b6-4b90-b6f1-84d346883513 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:55.273641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7c1fd-3815-436c-9bc7-148fd6985afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:55.274484 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7c1fd-3815-436c-9bc7-148fd6985afe None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:55.275112 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7c1fd-3815-436c-9bc7-148fd6985afe None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:55.275382 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7c1fd-3815-436c-9bc7-148fd6985afe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:55.288661 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7c1fd-3815-436c-9bc7-148fd6985afe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:55.290916 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7c1fd-3815-436c-9bc7-148fd6985afe None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:55.298210 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f3761-955f-48c7-bb8f-08ea16c0ce97 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:55.313165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-c5b7c1fd-3815-436c-9bc7-148fd6985afe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:55.313165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:55.313165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:55.313165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:55.313165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:55.313165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:55.313165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:55.313165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:55.313165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:55.313165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:55.313165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:55.313165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:55.313165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:55.313165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:55.313165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:55.314221 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:55.314221 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:55.314221 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:55.314221 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:55.314221 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:55.314221 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:55.314221 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:55.314221 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:55.314221 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:55.314221 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:55.314221 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:55.314221 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:55.314221 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:55.314221 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:55.314221 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:55.314221 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:55.314221 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:55.315140 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:55.315140 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:55.315140 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:55.315140 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:55.318050 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 319/634] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:20:55.319439 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cac76d-43dd-412a-9584-82d0c93ecd4b None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:55.319729 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cac76d-43dd-412a-9584-82d0c93ecd4b None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:55.320001 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cac76d-43dd-412a-9584-82d0c93ecd4b None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:55.321423 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 320/635] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:55.325714 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cac76d-43dd-412a-9584-82d0c93ecd4b None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:55.342501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da6c33-feab-4d34-8a75-7ac0823c58c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:55.343275 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da6c33-feab-4d34-8a75-7ac0823c58c6 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:55.343563 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da6c33-feab-4d34-8a75-7ac0823c58c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:55.343835 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da6c33-feab-4d34-8a75-7ac0823c58c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:55.354404 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da6c33-feab-4d34-8a75-7ac0823c58c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:55.356079 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da6c33-feab-4d34-8a75-7ac0823c58c6 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:55.373866 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-63da6c33-feab-4d34-8a75-7ac0823c58c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:55.373866 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:55.373866 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:55.373866 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:55.373866 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:55.373866 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:55.373866 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:55.373866 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:55.373866 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:55.373866 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:55.373866 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:55.373866 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:55.373866 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:55.373866 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:55.373866 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:55.374851 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:55.374851 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:55.374851 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:55.374851 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:55.374851 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:55.374851 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:55.374851 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:55.374851 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:55.374851 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:55.374851 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:55.374851 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:55.374851 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:55.374851 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:55.374851 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:55.374851 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:55.374851 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:55.374851 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:55.375740 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:55.375740 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:55.375740 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:55.375740 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:55.375740 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 316/636] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:55.376823 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03446fa6-2a2a-44fc-8429-a9884e4e5f08 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:55.377112 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03446fa6-2a2a-44fc-8429-a9884e4e5f08 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:55.377387 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03446fa6-2a2a-44fc-8429-a9884e4e5f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:55.396614 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-03446fa6-2a2a-44fc-8429-a9884e4e5f08 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:55.397846 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-03446fa6-2a2a-44fc-8429-a9884e4e5f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:55.452646 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cac76d-43dd-412a-9584-82d0c93ecd4b None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:55.473922 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 317/637] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:55.473922 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03446fa6-2a2a-44fc-8429-a9884e4e5f08 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:55.506247 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49924e31-e11b-4673-915d-f6b73897ad80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:55.507304 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49924e31-e11b-4673-915d-f6b73897ad80 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:55.507831 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49924e31-e11b-4673-915d-f6b73897ad80 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:55.508334 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49924e31-e11b-4673-915d-f6b73897ad80 None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:55.509239 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49924e31-e11b-4673-915d-f6b73897ad80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:55.509749 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49924e31-e11b-4673-915d-f6b73897ad80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:55.511627 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49924e31-e11b-4673-915d-f6b73897ad80 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:55.534293 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 321/638] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:55.535523 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49924e31-e11b-4673-915d-f6b73897ad80 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:55.568705 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03446fa6-2a2a-44fc-8429-a9884e4e5f08 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:55.609924 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eee451-7629-4d3a-83f1-85f782ffaf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:55.610757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eee451-7629-4d3a-83f1-85f782ffaf46 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:55.611059 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eee451-7629-4d3a-83f1-85f782ffaf46 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:55.611334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eee451-7629-4d3a-83f1-85f782ffaf46 None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:55.612052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eee451-7629-4d3a-83f1-85f782ffaf46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:55.612355 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eee451-7629-4d3a-83f1-85f782ffaf46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:55.613732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eee451-7629-4d3a-83f1-85f782ffaf46 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:55.625158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 318/639] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:55.626045 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eee451-7629-4d3a-83f1-85f782ffaf46 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:55.639707 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49924e31-e11b-4673-915d-f6b73897ad80 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:55.677136 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b8f3e-4476-42a7-b2f3-b70973635f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:55.677956 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b8f3e-4476-42a7-b2f3-b70973635f62 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:55.678231 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b8f3e-4476-42a7-b2f3-b70973635f62 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:55.678500 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b8f3e-4476-42a7-b2f3-b70973635f62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:55.688786 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b8f3e-4476-42a7-b2f3-b70973635f62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:55.696555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-578b8f3e-4476-42a7-b2f3-b70973635f62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 09:20:55.696555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:55.696555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:55.696555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:55.696555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:55.696555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:55.696555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:55.696555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:55.696555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:55.696555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:55.696555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:55.696555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:55.696555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:55.696555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:55.696555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:55.696555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:55.697500 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:55.697500 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:55.697500 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:55.697500 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:55.697500 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:55.697500 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:55.697500 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:55.697500 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:55.697500 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:55.697500 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:55.697500 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:55.697500 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:55.697500 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:55.697500 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:55.697500 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:55.697500 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:55.698398 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:55.698398 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:55.698398 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:55.698398 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:55.698398 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:55.698398 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:55.698398 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:55.698398 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:55.698398 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:55.698398 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:55.698398 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 09:20:55.698398 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:55.698398 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 322/640] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 12 09:20:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:55.700239 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a140a20-a9b5-4ab1-afc5-074f4044e860 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:55.700239 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a140a20-a9b5-4ab1-afc5-074f4044e860 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:55.700239 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a140a20-a9b5-4ab1-afc5-074f4044e860 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:55.701563 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 323/641] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:55.706137 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a140a20-a9b5-4ab1-afc5-074f4044e860 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:55.726723 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eee451-7629-4d3a-83f1-85f782ffaf46 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:55.760842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86985ae8-f387-4a0a-9e79-2ed1e6d22675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:55.762240 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86985ae8-f387-4a0a-9e79-2ed1e6d22675 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:55.762521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86985ae8-f387-4a0a-9e79-2ed1e6d22675 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:55.762791 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86985ae8-f387-4a0a-9e79-2ed1e6d22675 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:55.769820 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86985ae8-f387-4a0a-9e79-2ed1e6d22675 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:55.771315 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86985ae8-f387-4a0a-9e79-2ed1e6d22675 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:55.785158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-86985ae8-f387-4a0a-9e79-2ed1e6d22675 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:20:55.785158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:55.785158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:55.785158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:55.785158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:55.785158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:55.785158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:55.785158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:55.785158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:55.785158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:55.785158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:55.785158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:55.785158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:20:55.785158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:20:55.785158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:20:55.786340 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:20:55.786340 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:55.786340 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:55.786340 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:55.786340 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:55.786340 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:55.786340 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:55.786340 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:55.786340 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:55.786340 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:55.786340 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:55.786340 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:55.786340 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:55.786340 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:55.786340 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:55.786340 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:55.786340 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:55.787262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:20:55.787262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:20:55.787262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:20:55.787262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:20:55.787262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:20:55.787262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:20:55.787262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:20:55.787262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:55.787262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 319/642] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:20:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:55.787846 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86985ae8-f387-4a0a-9e79-2ed1e6d22675 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:55.813605 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a140a20-a9b5-4ab1-afc5-074f4044e860 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:55.848607 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639f4bd-2238-4091-b2d8-84af70e65516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:55.849514 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639f4bd-2238-4091-b2d8-84af70e65516 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:55.849796 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639f4bd-2238-4091-b2d8-84af70e65516 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:55.850105 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639f4bd-2238-4091-b2d8-84af70e65516 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:55.857090 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639f4bd-2238-4091-b2d8-84af70e65516 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:55.858581 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639f4bd-2238-4091-b2d8-84af70e65516 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:55.872938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-2639f4bd-2238-4091-b2d8-84af70e65516 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 09:20:55.872938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:55.872938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:55.872938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:55.872938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:55.872938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:55.872938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:55.872938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:55.872938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:55.872938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:55.872938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:55.872938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:55.872938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:20:55.872938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:20:55.872938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:20:55.872938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:20:55.873963 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:55.873963 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:55.873963 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:20:55.873963 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:20:55.873963 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:20:55.873963 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:20:55.873963 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:55.873963 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:55.873963 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:55.873963 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:55.873963 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:55.873963 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:55.873963 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:55.873963 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:55.873963 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:55.873963 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:55.873963 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:55.873963 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:55.875018 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:55.875018 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:55.875018 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:20:55.875018 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:20:55.875018 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:20:55.875018 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:20:55.875018 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:20:55.875018 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:20:55.875018 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 09:20:55.875018 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:55.878215 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 324/643] 10.222.0.60 () {56 vars in 1093 bytes} [Thu May 12 09:20:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:55.879658 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec553b-ac30-4358-a6b0-4af1c02eda7c None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:55.880524 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec553b-ac30-4358-a6b0-4af1c02eda7c None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:55.880805 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec553b-ac30-4358-a6b0-4af1c02eda7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:55.894777 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86985ae8-f387-4a0a-9e79-2ed1e6d22675 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:55.900011 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-08ec553b-ac30-4358-a6b0-4af1c02eda7c None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:55.901200 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-08ec553b-ac30-4358-a6b0-4af1c02eda7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:55.928023 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80085af2-cceb-4e78-9a00-44551ff9ab37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:55.928685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80085af2-cceb-4e78-9a00-44551ff9ab37 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:55.928968 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80085af2-cceb-4e78-9a00-44551ff9ab37 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:55.929244 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80085af2-cceb-4e78-9a00-44551ff9ab37 None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:55.930021 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80085af2-cceb-4e78-9a00-44551ff9ab37 None admin] RBAC: Adding query filter params (name=service) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:55.930326 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80085af2-cceb-4e78-9a00-44551ff9ab37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:55.931696 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80085af2-cceb-4e78-9a00-44551ff9ab37 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:55.940034 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 320/644] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 12 09:20:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:55.940808 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80085af2-cceb-4e78-9a00-44551ff9ab37 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:55.970735 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 325/645] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:55.971492 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec553b-ac30-4358-a6b0-4af1c02eda7c None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:56.065059 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80085af2-cceb-4e78-9a00-44551ff9ab37 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:56.065362 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec553b-ac30-4358-a6b0-4af1c02eda7c None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:56.103881 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4d0ea-e4ac-4fdf-b056-5aeabb89c18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:56.104386 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae07ef-2cd2-4cde-89ab-b9a36ed28a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:56.104582 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4d0ea-e4ac-4fdf-b056-5aeabb89c18f None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:56.104871 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4d0ea-e4ac-4fdf-b056-5aeabb89c18f None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:56.105070 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae07ef-2cd2-4cde-89ab-b9a36ed28a2b None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:56.105172 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4d0ea-e4ac-4fdf-b056-5aeabb89c18f None admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:56.105343 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae07ef-2cd2-4cde-89ab-b9a36ed28a2b None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:56.105622 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae07ef-2cd2-4cde-89ab-b9a36ed28a2b None admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:56.105996 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4d0ea-e4ac-4fdf-b056-5aeabb89c18f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:56.106326 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4d0ea-e4ac-4fdf-b056-5aeabb89c18f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:56.106425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae07ef-2cd2-4cde-89ab-b9a36ed28a2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:56.106710 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae07ef-2cd2-4cde-89ab-b9a36ed28a2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:56.107743 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4d0ea-e4ac-4fdf-b056-5aeabb89c18f None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:56.108144 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae07ef-2cd2-4cde-89ab-b9a36ed28a2b None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:56.119809 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 321/646] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:20:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:56.120612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae07ef-2cd2-4cde-89ab-b9a36ed28a2b None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:56.125516 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 326/647] 10.222.0.60 () {56 vars in 1133 bytes} [Thu May 12 09:20:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:56.126620 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4d0ea-e4ac-4fdf-b056-5aeabb89c18f None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:56.219585 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae07ef-2cd2-4cde-89ab-b9a36ed28a2b None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:56.221883 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4d0ea-e4ac-4fdf-b056-5aeabb89c18f None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:56.252407 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129dbf92-74fd-4eee-a23f-fa24a90d9373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:56.253202 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dbf92-74fd-4eee-a23f-fa24a90d9373 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:56.253487 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dbf92-74fd-4eee-a23f-fa24a90d9373 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:56.253759 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dbf92-74fd-4eee-a23f-fa24a90d9373 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:56.254952 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18923510-b7f2-4119-9c5c-978843212c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:56.256000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18923510-b7f2-4119-9c5c-978843212c07 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:56.256279 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18923510-b7f2-4119-9c5c-978843212c07 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:56.256553 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18923510-b7f2-4119-9c5c-978843212c07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:56.264282 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129dbf92-74fd-4eee-a23f-fa24a90d9373 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:56.265731 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129dbf92-74fd-4eee-a23f-fa24a90d9373 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:56.266731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18923510-b7f2-4119-9c5c-978843212c07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:56.274479 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-18923510-b7f2-4119-9c5c-978843212c07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 09:20:56.274479 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:56.274479 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:56.274479 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:56.274479 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:56.274479 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:56.274479 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:56.274479 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:56.274479 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:56.274479 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:56.274479 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:56.274479 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:56.274479 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:56.274479 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:56.274479 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:56.274479 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:56.275391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:56.275391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:56.275391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:56.275391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:56.275391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:56.275391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:56.275391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:56.275391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:56.275391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:56.275391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:56.275391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:56.275391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:56.275391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:56.275391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:56.275391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:56.275391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:56.276255 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:56.276255 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:56.276255 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:56.276255 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:56.276255 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:56.276255 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:56.276255 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:56.276255 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:56.276255 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:56.276255 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:56.276255 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 09:20:56.276255 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:56.276255 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 327/648] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 12 09:20:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:56.277467 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18923510-b7f2-4119-9c5c-978843212c07 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:56.287954 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-129dbf92-74fd-4eee-a23f-fa24a90d9373 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:56.287954 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:56.287954 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:56.287954 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:56.287954 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:56.287954 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:56.287954 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:56.287954 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:56.287954 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:56.287954 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:56.287954 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:56.287954 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:56.287954 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:56.287954 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:56.287954 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:56.288894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:56.288894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:56.288894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:56.288894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:56.288894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:56.288894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:56.288894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:56.288894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:56.288894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:56.288894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:56.288894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:56.288894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:56.288894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:56.288894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:56.288894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:56.288894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:56.288894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:56.289891 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:56.289891 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:56.289891 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:56.289891 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:56.289891 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 322/649] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:56.290200 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129dbf92-74fd-4eee-a23f-fa24a90d9373 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:56.377786 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18923510-b7f2-4119-9c5c-978843212c07 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:56.385650 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129dbf92-74fd-4eee-a23f-fa24a90d9373 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:56.410283 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d11dbe-6080-4b93-b007-7ffc393b5717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:56.410946 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d11dbe-6080-4b93-b007-7ffc393b5717 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:56.411230 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d11dbe-6080-4b93-b007-7ffc393b5717 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:56.411508 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d11dbe-6080-4b93-b007-7ffc393b5717 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:56.412334 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d11dbe-6080-4b93-b007-7ffc393b5717 None admin] RBAC: Adding query filter params (role.id=4798f242077c416e9292660af5469faf, scope.project.id=9cf4f2954dd44516b3e594ed440781cc, user.id=0981a8c6d9ac413b99aae95a6cdd3be5) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:56.412644 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d11dbe-6080-4b93-b007-7ffc393b5717 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:56.414096 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d11dbe-6080-4b93-b007-7ffc393b5717 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:56.419594 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff82d85-ebb4-4b8a-8f22-22c48bf4cc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:56.420237 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff82d85-ebb4-4b8a-8f22-22c48bf4cc03 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:56.420522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff82d85-ebb4-4b8a-8f22-22c48bf4cc03 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:56.420866 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 328/650] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:20:56 2022] GET /identity/v3/role_assignments?user.id=0981a8c6d9ac413b99aae95a6cdd3be5&scope.project.id=9cf4f2954dd44516b3e594ed440781cc&role.id=4798f242077c416e9292660af5469faf => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:56.421726 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d11dbe-6080-4b93-b007-7ffc393b5717 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:56.422917 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff82d85-ebb4-4b8a-8f22-22c48bf4cc03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:56.498204 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff82d85-ebb4-4b8a-8f22-22c48bf4cc03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:56.499722 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff82d85-ebb4-4b8a-8f22-22c48bf4cc03 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:56.529857 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d11dbe-6080-4b93-b007-7ffc393b5717 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:56.565402 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54d7f2-2aa8-44ad-9405-942518e98b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:56.566124 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54d7f2-2aa8-44ad-9405-942518e98b36 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:56.566413 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54d7f2-2aa8-44ad-9405-942518e98b36 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:56.566690 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54d7f2-2aa8-44ad-9405-942518e98b36 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:56.567451 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54d7f2-2aa8-44ad-9405-942518e98b36 None admin] RBAC: Adding query filter params (name=service) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:56.567760 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54d7f2-2aa8-44ad-9405-942518e98b36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:56.569163 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54d7f2-2aa8-44ad-9405-942518e98b36 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:56.578938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 329/651] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 12 09:20:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:56.579886 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54d7f2-2aa8-44ad-9405-942518e98b36 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:56.612043 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 323/652] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:20:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:20:56.612893 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff82d85-ebb4-4b8a-8f22-22c48bf4cc03 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:56.703654 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54d7f2-2aa8-44ad-9405-942518e98b36 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:56.733018 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff82d85-ebb4-4b8a-8f22-22c48bf4cc03 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:56.747426 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfb567-0e90-467b-85af-af51c1cadc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:56.748417 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfb567-0e90-467b-85af-af51c1cadc9d None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:56.748851 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfb567-0e90-467b-85af-af51c1cadc9d None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:56.749121 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfb567-0e90-467b-85af-af51c1cadc9d None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:56.749843 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbfb567-0e90-467b-85af-af51c1cadc9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:56.750193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbfb567-0e90-467b-85af-af51c1cadc9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:56.751541 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbfb567-0e90-467b-85af-af51c1cadc9d None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:56.768909 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 330/653] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:56.769756 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfb567-0e90-467b-85af-af51c1cadc9d None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:56.776281 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516c102-663d-4e0f-9cdf-0e4e41f5d9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:56.777125 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516c102-663d-4e0f-9cdf-0e4e41f5d9bf None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:56.777406 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516c102-663d-4e0f-9cdf-0e4e41f5d9bf None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:56.777680 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516c102-663d-4e0f-9cdf-0e4e41f5d9bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:56.787987 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516c102-663d-4e0f-9cdf-0e4e41f5d9bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:56.789434 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516c102-663d-4e0f-9cdf-0e4e41f5d9bf None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:56.807201 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-3516c102-663d-4e0f-9cdf-0e4e41f5d9bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:56.807201 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:56.807201 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:56.807201 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:56.807201 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:56.807201 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:56.807201 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:56.807201 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:56.807201 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:56.807201 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:56.807201 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:56.807201 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:56.807201 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:56.807201 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:56.807201 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:56.808726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:56.808726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:56.808726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:56.808726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:56.808726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:56.808726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:56.808726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:56.808726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:56.808726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:56.808726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:56.808726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:56.808726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:56.808726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:56.808726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:56.808726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:56.808726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:56.808726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:56.809636 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:56.809636 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:56.809636 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:56.809636 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:56.809636 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 324/654] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:56.810404 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516c102-663d-4e0f-9cdf-0e4e41f5d9bf None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:56.877341 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfb567-0e90-467b-85af-af51c1cadc9d None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:56.910873 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4b70c-c222-4201-82b5-75a2e5671ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:56.911684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4b70c-c222-4201-82b5-75a2e5671ac3 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:56.911952 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4b70c-c222-4201-82b5-75a2e5671ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:56.912231 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4b70c-c222-4201-82b5-75a2e5671ac3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:56.914952 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516c102-663d-4e0f-9cdf-0e4e41f5d9bf None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:56.922649 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4b70c-c222-4201-82b5-75a2e5671ac3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:56.924084 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4b70c-c222-4201-82b5-75a2e5671ac3 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:56.941432 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-eaa4b70c-c222-4201-82b5-75a2e5671ac3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:56.941432 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:56.941432 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:56.941432 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:56.941432 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:56.941432 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:56.941432 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:56.941432 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:56.941432 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:56.941432 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:56.941432 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:56.941432 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:56.941432 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:56.941432 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:56.941432 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:56.942418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:56.942418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:56.942418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:56.942418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:56.942418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:56.942418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:56.942418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:56.942418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:56.942418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:56.942418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:56.942418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:56.942418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:56.942418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:56.942418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:56.942418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:56.942418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:56.942418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:56.943336 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:56.943336 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:56.943336 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:56.943336 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:56.943336 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 331/655] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:56.944054 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4b70c-c222-4201-82b5-75a2e5671ac3 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:56.953797 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b6aa3-3696-4b4d-a40e-2215a06fe555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:56.954635 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b6aa3-3696-4b4d-a40e-2215a06fe555 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:56.954920 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b6aa3-3696-4b4d-a40e-2215a06fe555 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:56.955192 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b6aa3-3696-4b4d-a40e-2215a06fe555 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:56.962708 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b6aa3-3696-4b4d-a40e-2215a06fe555 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:56.964698 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b6aa3-3696-4b4d-a40e-2215a06fe555 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:56.979531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-a10b6aa3-3696-4b4d-a40e-2215a06fe555 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 09:20:56.979531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:56.979531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:56.979531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:56.979531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:56.979531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:56.979531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:56.979531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:56.979531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:56.979531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:56.979531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:56.979531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:56.979531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:20:56.979531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:20:56.979531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:20:56.979531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:20:56.981046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:56.981046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:56.981046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:20:56.981046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:20:56.981046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:20:56.981046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:20:56.981046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:56.981046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:56.981046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:56.981046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:56.981046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:56.981046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:56.981046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:56.981046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:56.981046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:56.981046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:56.981046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:56.981046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:56.982062 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:56.982062 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:56.982062 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:20:56.982062 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:20:56.982062 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:20:56.982062 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:20:56.982062 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:20:56.982062 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:20:56.982062 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 09:20:56.982062 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:56.982062 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 325/656] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:20:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:56.987194 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c6b26-7124-45a0-9b13-326c5a623c13 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:56.987479 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c6b26-7124-45a0-9b13-326c5a623c13 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:56.987753 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c6b26-7124-45a0-9b13-326c5a623c13 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:56.989209 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 326/657] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:56.989698 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c6b26-7124-45a0-9b13-326c5a623c13 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:57.053161 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4b70c-c222-4201-82b5-75a2e5671ac3 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:57.084938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6364b-ccf0-432f-bdd6-ad61a694475f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:57.085598 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6364b-ccf0-432f-bdd6-ad61a694475f None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:57.085880 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6364b-ccf0-432f-bdd6-ad61a694475f None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:57.086181 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6364b-ccf0-432f-bdd6-ad61a694475f None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:57.086891 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6364b-ccf0-432f-bdd6-ad61a694475f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:57.087092 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c6b26-7124-45a0-9b13-326c5a623c13 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:57.087223 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6364b-ccf0-432f-bdd6-ad61a694475f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:57.088552 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6364b-ccf0-432f-bdd6-ad61a694475f None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:57.104798 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 332/658] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:57.106179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6364b-ccf0-432f-bdd6-ad61a694475f None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:57.133554 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc75aa5-bf97-4492-8833-76df18ca5298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:57.134742 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc75aa5-bf97-4492-8833-76df18ca5298 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:57.135458 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc75aa5-bf97-4492-8833-76df18ca5298 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:57.135742 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc75aa5-bf97-4492-8833-76df18ca5298 None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:57.136632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc75aa5-bf97-4492-8833-76df18ca5298 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:57.136937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc75aa5-bf97-4492-8833-76df18ca5298 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:57.138350 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc75aa5-bf97-4492-8833-76df18ca5298 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:57.149476 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 327/659] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:57.150624 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2845a-4b47-406f-962b-487ecb7e47cb None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:57.150912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2845a-4b47-406f-962b-487ecb7e47cb None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:57.151184 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2845a-4b47-406f-962b-487ecb7e47cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:57.175209 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-86e2845a-4b47-406f-962b-487ecb7e47cb None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:57.176665 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-86e2845a-4b47-406f-962b-487ecb7e47cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:57.217977 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6364b-ccf0-432f-bdd6-ad61a694475f None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:57.241802 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 328/660] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:57.243012 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2845a-4b47-406f-962b-487ecb7e47cb None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:57.252549 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff154c6-aa5c-496a-b624-879680ea6e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:57.253314 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff154c6-aa5c-496a-b624-879680ea6e19 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:57.253671 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff154c6-aa5c-496a-b624-879680ea6e19 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:57.254042 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff154c6-aa5c-496a-b624-879680ea6e19 None admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:57.255014 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff154c6-aa5c-496a-b624-879680ea6e19 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:57.255644 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff154c6-aa5c-496a-b624-879680ea6e19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:57.257174 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff154c6-aa5c-496a-b624-879680ea6e19 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:57.274713 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 333/661] 10.222.0.60 () {56 vars in 1137 bytes} [Thu May 12 09:20:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:57.275730 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff154c6-aa5c-496a-b624-879680ea6e19 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:57.341373 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2845a-4b47-406f-962b-487ecb7e47cb None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:57.371930 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff154c6-aa5c-496a-b624-879680ea6e19 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:57.374044 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c7078-16e3-4e45-a87c-31876a240638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:57.374846 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c7078-16e3-4e45-a87c-31876a240638 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:57.375119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c7078-16e3-4e45-a87c-31876a240638 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:57.375386 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c7078-16e3-4e45-a87c-31876a240638 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:57.382852 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c7078-16e3-4e45-a87c-31876a240638 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:57.384301 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c7078-16e3-4e45-a87c-31876a240638 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:57.399015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-922c7078-16e3-4e45-a87c-31876a240638 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 09:20:57.399015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:57.399015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:57.399015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:57.399015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:57.399015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:57.399015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:57.399015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:57.399015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:57.399015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:57.399015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:57.399015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:57.399015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:20:57.399015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:20:57.399015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:20:57.399015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:20:57.400009 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:57.400009 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:57.400009 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:20:57.400009 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:20:57.400009 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:20:57.400009 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:20:57.400009 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:57.400009 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:57.400009 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:57.400009 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:57.400009 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:57.400009 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:57.400009 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:57.400009 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:57.400009 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:57.400009 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:57.400009 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:57.400009 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:57.400956 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:57.400956 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:57.400956 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:20:57.400956 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:20:57.400956 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:20:57.400956 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:20:57.400956 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:20:57.400956 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:20:57.400956 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 09:20:57.400956 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:57.405308 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 329/662] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 12 09:20:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:57.406150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761d4c7-9c82-4b19-a576-c33761d92869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:57.406288 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c7078-16e3-4e45-a87c-31876a240638 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:57.406971 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761d4c7-9c82-4b19-a576-c33761d92869 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:57.407245 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761d4c7-9c82-4b19-a576-c33761d92869 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:57.407523 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761d4c7-9c82-4b19-a576-c33761d92869 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:57.414403 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761d4c7-9c82-4b19-a576-c33761d92869 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:57.415601 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761d4c7-9c82-4b19-a576-c33761d92869 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:57.429059 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-5761d4c7-9c82-4b19-a576-c33761d92869 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:20:57.429059 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:57.429059 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:57.429059 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:57.429059 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:57.429059 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:57.429059 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:57.429059 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:57.429059 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:57.429059 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:57.429059 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:57.429059 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:57.429059 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:20:57.429059 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:20:57.429059 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:20:57.430052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:20:57.430052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:57.430052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:57.430052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:57.430052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:57.430052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:57.430052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:57.430052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:57.430052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:57.430052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:57.430052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:57.430052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:57.430052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:57.430052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:57.430052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:57.430052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:57.430052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:57.431774 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:20:57.431774 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:20:57.431774 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:20:57.431774 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:20:57.431774 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:20:57.431774 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:20:57.431774 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:20:57.431774 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:57.431774 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 334/663] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:20:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:57.431774 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761d4c7-9c82-4b19-a576-c33761d92869 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:57.507656 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c7078-16e3-4e45-a87c-31876a240638 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:57.523968 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761d4c7-9c82-4b19-a576-c33761d92869 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:57.540472 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948042fe-752c-48cf-8135-fbefc32efdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:57.541354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948042fe-752c-48cf-8135-fbefc32efdbe None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:57.541709 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948042fe-752c-48cf-8135-fbefc32efdbe None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:57.542093 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948042fe-752c-48cf-8135-fbefc32efdbe None admin] PATH_INFO: `/v3/roles/service` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:57.552078 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948042fe-752c-48cf-8135-fbefc32efdbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:20:57.555507 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e63ca-d5c9-40d7-84e8-b9643cf8a51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:57.556143 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e63ca-d5c9-40d7-84e8-b9643cf8a51d None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:57.556420 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e63ca-d5c9-40d7-84e8-b9643cf8a51d None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:57.556689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e63ca-d5c9-40d7-84e8-b9643cf8a51d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:57.559875 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-948042fe-752c-48cf-8135-fbefc32efdbe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 09:20:57.559875 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:57.559875 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:57.559875 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:57.559875 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:57.559875 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:57.559875 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:57.559875 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:57.559875 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:57.559875 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:57.559875 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:57.559875 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:57.559875 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:20:57.559875 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:20:57.559875 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:20:57.559875 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:20:57.560957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:20:57.560957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:20:57.560957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:20:57.560957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:20:57.560957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:57.560957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:57.560957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:57.560957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:57.560957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:57.560957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:57.560957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:57.560957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:57.560957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:57.560957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:57.560957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:57.560957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:57.566824 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:57.566824 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:57.566824 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:57.566824 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:57.566824 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:20:57.566824 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:20:57.566824 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:20:57.566824 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:20:57.566824 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:20:57.566824 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:20:57.566824 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 09:20:57.566824 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:57.566824 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 330/664] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 12 09:20:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:57.566824 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948042fe-752c-48cf-8135-fbefc32efdbe None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:57.628872 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e63ca-d5c9-40d7-84e8-b9643cf8a51d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:57.630625 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e63ca-d5c9-40d7-84e8-b9643cf8a51d None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:57.660141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948042fe-752c-48cf-8135-fbefc32efdbe None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:57.693567 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa0f8e-28f4-4be7-9d3e-76ac6a60d78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:57.694378 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa0f8e-28f4-4be7-9d3e-76ac6a60d78a None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:57.694663 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa0f8e-28f4-4be7-9d3e-76ac6a60d78a None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:57.694937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa0f8e-28f4-4be7-9d3e-76ac6a60d78a None admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:57.695780 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa0f8e-28f4-4be7-9d3e-76ac6a60d78a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:57.696094 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa0f8e-28f4-4be7-9d3e-76ac6a60d78a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:57.697534 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa0f8e-28f4-4be7-9d3e-76ac6a60d78a None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:57.722417 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 331/665] 10.222.0.60 () {56 vars in 1139 bytes} [Thu May 12 09:20:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:57.722417 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa0f8e-28f4-4be7-9d3e-76ac6a60d78a None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:57.727040 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 335/666] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:20:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:20:57.731790 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e63ca-d5c9-40d7-84e8-b9643cf8a51d None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:57.821082 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa0f8e-28f4-4be7-9d3e-76ac6a60d78a None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:57.827871 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e63ca-d5c9-40d7-84e8-b9643cf8a51d None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:57.853566 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25fef33-0b02-4d96-b436-63e50e10014a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:57.854252 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fef33-0b02-4d96-b436-63e50e10014a None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:57.854530 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fef33-0b02-4d96-b436-63e50e10014a None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:57.854833 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fef33-0b02-4d96-b436-63e50e10014a None admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:57.855608 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25fef33-0b02-4d96-b436-63e50e10014a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:57.855918 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25fef33-0b02-4d96-b436-63e50e10014a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:57.857342 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25fef33-0b02-4d96-b436-63e50e10014a None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:57.860318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acca73-945f-45f2-b519-21d6ea18ea53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:57.861086 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acca73-945f-45f2-b519-21d6ea18ea53 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:57.861459 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acca73-945f-45f2-b519-21d6ea18ea53 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:57.861824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acca73-945f-45f2-b519-21d6ea18ea53 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:57.862695 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71acca73-945f-45f2-b519-21d6ea18ea53 None admin] RBAC: Adding query filter params (name=service) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:57.863099 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71acca73-945f-45f2-b519-21d6ea18ea53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:57.864535 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71acca73-945f-45f2-b519-21d6ea18ea53 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:57.873754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 332/667] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:20:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:57.873754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25fef33-0b02-4d96-b436-63e50e10014a None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:57.877491 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 336/668] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 12 09:20:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:57.882685 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acca73-945f-45f2-b519-21d6ea18ea53 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:57.971275 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25fef33-0b02-4d96-b436-63e50e10014a None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:57.979349 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acca73-945f-45f2-b519-21d6ea18ea53 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:58.003201 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399365b-975b-436e-b022-b8b785d342c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:58.003759 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399365b-975b-436e-b022-b8b785d342c6 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:58.004047 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399365b-975b-436e-b022-b8b785d342c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:58.004327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399365b-975b-436e-b022-b8b785d342c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:58.012147 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecdda73-3b72-42e2-bb21-6f5db25b3660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:58.013185 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdda73-3b72-42e2-bb21-6f5db25b3660 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:58.013579 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdda73-3b72-42e2-bb21-6f5db25b3660 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:58.013854 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdda73-3b72-42e2-bb21-6f5db25b3660 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:58.024169 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecdda73-3b72-42e2-bb21-6f5db25b3660 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:58.025633 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecdda73-3b72-42e2-bb21-6f5db25b3660 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:58.041943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-0ecdda73-3b72-42e2-bb21-6f5db25b3660 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:58.041943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:58.041943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:58.041943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:58.041943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:58.041943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:58.041943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:58.041943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:58.041943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:58.041943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:58.041943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:58.041943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:58.041943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:58.041943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:58.041943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:58.043460 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:58.043460 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:58.043460 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:58.043460 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:58.043460 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:58.043460 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:58.043460 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:58.043460 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:58.043460 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:58.043460 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:58.043460 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:58.043460 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:58.043460 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:58.043460 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:58.043460 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:58.043460 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:58.043460 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:58.044372 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:58.044372 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:58.044372 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:58.044372 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:58.044372 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 337/669] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:58.044372 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecdda73-3b72-42e2-bb21-6f5db25b3660 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:58.074633 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399365b-975b-436e-b022-b8b785d342c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:58.076074 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399365b-975b-436e-b022-b8b785d342c6 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:58.145829 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecdda73-3b72-42e2-bb21-6f5db25b3660 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:58.174978 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 333/670] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:20:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:20:58.177731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c829e7-8f25-46a2-9803-e1dfb97445be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:58.178413 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c829e7-8f25-46a2-9803-e1dfb97445be None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:58.178690 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c829e7-8f25-46a2-9803-e1dfb97445be None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:58.178961 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c829e7-8f25-46a2-9803-e1dfb97445be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:58.179771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c829e7-8f25-46a2-9803-e1dfb97445be None admin] RBAC: Adding query filter params (role.id=4798f242077c416e9292660af5469faf, scope.project.id=9cf4f2954dd44516b3e594ed440781cc, user.id=2915babd40aa42e8bf7cc85c5a97daa6) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:58.180060 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399365b-975b-436e-b022-b8b785d342c6 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:58.180171 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c829e7-8f25-46a2-9803-e1dfb97445be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:58.181469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c829e7-8f25-46a2-9803-e1dfb97445be None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:58.198265 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 338/671] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:20:58 2022] GET /identity/v3/role_assignments?user.id=2915babd40aa42e8bf7cc85c5a97daa6&scope.project.id=9cf4f2954dd44516b3e594ed440781cc&role.id=4798f242077c416e9292660af5469faf => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:58.198265 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c829e7-8f25-46a2-9803-e1dfb97445be None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:58.285757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399365b-975b-436e-b022-b8b785d342c6 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:58.310136 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c829e7-8f25-46a2-9803-e1dfb97445be None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:58.322746 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8691c66-1052-4fb2-8ae4-d7f4d84d687b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:58.323616 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8691c66-1052-4fb2-8ae4-d7f4d84d687b None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:58.323874 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8691c66-1052-4fb2-8ae4-d7f4d84d687b None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:58.324144 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8691c66-1052-4fb2-8ae4-d7f4d84d687b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:58.339492 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8691c66-1052-4fb2-8ae4-d7f4d84d687b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:58.341319 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8691c66-1052-4fb2-8ae4-d7f4d84d687b None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:58.348066 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fb500-95b2-4411-b238-d6665d7109d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:58.348790 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fb500-95b2-4411-b238-d6665d7109d3 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:58.349072 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fb500-95b2-4411-b238-d6665d7109d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:58.349339 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fb500-95b2-4411-b238-d6665d7109d3 None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:58.350090 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90fb500-95b2-4411-b238-d6665d7109d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:58.350912 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90fb500-95b2-4411-b238-d6665d7109d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:58.351903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90fb500-95b2-4411-b238-d6665d7109d3 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:58.362923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-d8691c66-1052-4fb2-8ae4-d7f4d84d687b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:58.362923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:58.362923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:58.362923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:58.362923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:58.362923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:58.362923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:58.362923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:58.362923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:58.362923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:58.362923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:58.362923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:58.362923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:58.362923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:58.362923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:58.363898 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:58.363898 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:58.363898 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:58.363898 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:58.363898 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:58.363898 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:58.363898 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:58.363898 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:58.363898 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:58.363898 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:58.363898 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:58.363898 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:58.363898 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:58.363898 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:58.363898 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:58.363898 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:58.363898 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:58.364817 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:58.364817 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:58.364817 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:58.364817 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:58.371153 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 339/672] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:58.371153 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fb500-95b2-4411-b238-d6665d7109d3 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:58.371399 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 334/673] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:58.372197 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8691c66-1052-4fb2-8ae4-d7f4d84d687b None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:58.491910 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fb500-95b2-4411-b238-d6665d7109d3 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:58.492111 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8691c66-1052-4fb2-8ae4-d7f4d84d687b None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:58.532710 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70697f42-9b54-4104-af8e-ce3ae757ff5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:58.533255 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937d643-450b-42dd-953e-5320cf0c0e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:58.533514 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70697f42-9b54-4104-af8e-ce3ae757ff5d None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:58.533791 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70697f42-9b54-4104-af8e-ce3ae757ff5d None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:58.534090 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70697f42-9b54-4104-af8e-ce3ae757ff5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:58.535098 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937d643-450b-42dd-953e-5320cf0c0e30 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:58.535587 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937d643-450b-42dd-953e-5320cf0c0e30 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:58.536226 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937d643-450b-42dd-953e-5320cf0c0e30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:58.541411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70697f42-9b54-4104-af8e-ce3ae757ff5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:58.542967 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70697f42-9b54-4104-af8e-ce3ae757ff5d None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:58.548491 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937d643-450b-42dd-953e-5320cf0c0e30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:58.550563 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937d643-450b-42dd-953e-5320cf0c0e30 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:58.559109 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-70697f42-9b54-4104-af8e-ce3ae757ff5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:20:58.559109 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:58.559109 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:58.559109 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:58.559109 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:58.559109 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:58.559109 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:58.559109 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:58.559109 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:58.559109 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:58.559109 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:58.559109 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:58.559109 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:20:58.559109 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:20:58.559109 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:20:58.560013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:20:58.560013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:58.560013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:58.560013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:58.560013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:58.560013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:58.560013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:58.560013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:58.560013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:58.560013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:58.560013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:58.560013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:58.560013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:58.560013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:58.560013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:58.560013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:58.560013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:58.560919 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:20:58.560919 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:20:58.560919 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:20:58.560919 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:20:58.560919 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:20:58.560919 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:20:58.560919 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:20:58.560919 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:58.560919 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 335/674] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:20:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:58.561427 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70697f42-9b54-4104-af8e-ce3ae757ff5d None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:58.574647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-2937d643-450b-42dd-953e-5320cf0c0e30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:58.574647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:58.574647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:58.574647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:58.574647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:58.574647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:58.574647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:58.574647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:58.574647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:58.574647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:58.574647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:58.574647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:58.574647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:58.574647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:58.574647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:58.575577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:58.575577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:58.575577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:58.575577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:58.575577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:58.575577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:58.575577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:58.575577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:58.575577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:58.575577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:58.575577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:58.575577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:58.575577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:58.575577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:58.575577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:58.575577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:58.575577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:58.576507 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:58.576507 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:58.576507 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:58.576507 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:58.579114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 340/675] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:58.584056 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937d643-450b-42dd-953e-5320cf0c0e30 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:58.688308 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70697f42-9b54-4104-af8e-ce3ae757ff5d None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:58.717693 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937d643-450b-42dd-953e-5320cf0c0e30 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:58.724041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a028d6-319a-4874-a374-64b82bd376d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:58.724807 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a028d6-319a-4874-a374-64b82bd376d0 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:58.725182 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a028d6-319a-4874-a374-64b82bd376d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:58.725554 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a028d6-319a-4874-a374-64b82bd376d0 None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:58.726416 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a028d6-319a-4874-a374-64b82bd376d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:58.726818 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a028d6-319a-4874-a374-64b82bd376d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:58.728303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a028d6-319a-4874-a374-64b82bd376d0 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:58.744556 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 336/676] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:58.744556 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a028d6-319a-4874-a374-64b82bd376d0 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:58.764946 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379af318-f859-45cf-805b-9c1ab079172a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:58.766344 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379af318-f859-45cf-805b-9c1ab079172a None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:58.767044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379af318-f859-45cf-805b-9c1ab079172a None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:58.767490 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379af318-f859-45cf-805b-9c1ab079172a None admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:58.768711 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379af318-f859-45cf-805b-9c1ab079172a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:58.769562 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379af318-f859-45cf-805b-9c1ab079172a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:58.772087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379af318-f859-45cf-805b-9c1ab079172a None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:58.787177 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 341/677] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:20:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:58.788269 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379af318-f859-45cf-805b-9c1ab079172a None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:58.849662 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a028d6-319a-4874-a374-64b82bd376d0 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:58.882568 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd206d-cb9c-42d5-98a2-2795dd2a3f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:58.883228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd206d-cb9c-42d5-98a2-2795dd2a3f50 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:58.883511 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd206d-cb9c-42d5-98a2-2795dd2a3f50 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:58.883782 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd206d-cb9c-42d5-98a2-2795dd2a3f50 None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:58.884496 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd206d-cb9c-42d5-98a2-2795dd2a3f50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:58.884800 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd206d-cb9c-42d5-98a2-2795dd2a3f50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:58.886715 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd206d-cb9c-42d5-98a2-2795dd2a3f50 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:58.896905 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379af318-f859-45cf-805b-9c1ab079172a None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:58.902381 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 337/678] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:58.902381 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd206d-cb9c-42d5-98a2-2795dd2a3f50 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:58.936401 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb3d3da-270c-4841-bdf9-13d966d174e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:58.937196 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3d3da-270c-4841-bdf9-13d966d174e9 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:58.937477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3d3da-270c-4841-bdf9-13d966d174e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:58.937751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3d3da-270c-4841-bdf9-13d966d174e9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:58.945542 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb3d3da-270c-4841-bdf9-13d966d174e9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:58.947047 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb3d3da-270c-4841-bdf9-13d966d174e9 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:58.965800 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-aeb3d3da-270c-4841-bdf9-13d966d174e9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 09:20:58.965800 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:58.965800 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:58.965800 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:58.965800 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:58.965800 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:58.965800 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:58.965800 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:58.965800 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:58.965800 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:58.965800 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:58.965800 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:58.965800 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:20:58.965800 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:20:58.965800 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:20:58.965800 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:20:58.966998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:58.966998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:58.966998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:20:58.966998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:20:58.966998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:20:58.966998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:20:58.966998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:58.966998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:58.966998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:58.966998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:58.966998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:58.966998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:58.966998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:58.966998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:58.966998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:58.966998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:58.966998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:58.966998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:58.972659 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:58.972659 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:58.972659 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:20:58.972659 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:20:58.972659 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:20:58.972659 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:20:58.972659 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:20:58.972659 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:20:58.972659 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 09:20:58.972659 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:58.972659 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 342/679] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:20:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:58.972659 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594a901-ae80-430b-846a-f74929ea881a None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:58.972659 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594a901-ae80-430b-846a-f74929ea881a None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:58.973424 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594a901-ae80-430b-846a-f74929ea881a None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:58.973947 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 343/680] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:20:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:20:58.974696 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594a901-ae80-430b-846a-f74929ea881a None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:59.004249 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd206d-cb9c-42d5-98a2-2795dd2a3f50 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:59.044160 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db364d-55f7-40da-9789-53353e624f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:59.045141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db364d-55f7-40da-9789-53353e624f2a None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:59.045430 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db364d-55f7-40da-9789-53353e624f2a None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:59.045709 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db364d-55f7-40da-9789-53353e624f2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:59.046574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db364d-55f7-40da-9789-53353e624f2a None admin] RBAC: Adding query filter params (role.id=4798f242077c416e9292660af5469faf, scope.project.id=9cf4f2954dd44516b3e594ed440781cc, user.id=2e97d11fab3b4bb092f9623da4e40eb0) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:59.046891 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db364d-55f7-40da-9789-53353e624f2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:59.048331 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db364d-55f7-40da-9789-53353e624f2a None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:59.054390 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 338/681] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:20:58 2022] GET /identity/v3/role_assignments?user.id=2e97d11fab3b4bb092f9623da4e40eb0&scope.project.id=9cf4f2954dd44516b3e594ed440781cc&role.id=4798f242077c416e9292660af5469faf => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:59.055207 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db364d-55f7-40da-9789-53353e624f2a None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:59.091669 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594a901-ae80-430b-846a-f74929ea881a None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:59.138233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623af93-0a81-4637-9499-11c67cf0de5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:59.139366 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623af93-0a81-4637-9499-11c67cf0de5a None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:59.139820 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623af93-0a81-4637-9499-11c67cf0de5a None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:59.140286 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623af93-0a81-4637-9499-11c67cf0de5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:59.148372 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e623af93-0a81-4637-9499-11c67cf0de5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:59.150239 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e623af93-0a81-4637-9499-11c67cf0de5a None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:59.166312 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-e623af93-0a81-4637-9499-11c67cf0de5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:20:59.166312 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:59.166312 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:59.166312 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:59.166312 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:59.166312 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:59.166312 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:59.166312 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:59.166312 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:59.166312 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:59.166312 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:59.166312 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:59.166312 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:20:59.166312 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:20:59.166312 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:20:59.167578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:20:59.167578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:59.167578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:59.167578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:59.167578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:59.167578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:59.167578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:59.167578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:59.167578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:20:59.167578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:59.167578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:59.167578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:59.167578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:59.167578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:59.167578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:59.167578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:59.167578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:59.168596 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:20:59.168596 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:20:59.168596 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:20:59.168596 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:20:59.168596 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:20:59.168596 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:20:59.168596 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:20:59.168596 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:20:59.170910 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 344/682] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:20:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:59.172393 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa5b2e-8588-4a12-ad6f-7c8bfea8f44a None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:59.172834 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa5b2e-8588-4a12-ad6f-7c8bfea8f44a None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:59.173255 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa5b2e-8588-4a12-ad6f-7c8bfea8f44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:59.189812 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db364d-55f7-40da-9789-53353e624f2a None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:59.194628 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-dffa5b2e-8588-4a12-ad6f-7c8bfea8f44a None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:20:59.196128 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-dffa5b2e-8588-4a12-ad6f-7c8bfea8f44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:20:59.226607 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e07ec-1a23-4397-823f-6c0f37fb1fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:59.227291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e07ec-1a23-4397-823f-6c0f37fb1fcd None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:59.227573 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e07ec-1a23-4397-823f-6c0f37fb1fcd None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:59.227840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e07ec-1a23-4397-823f-6c0f37fb1fcd None admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:59.228685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e07ec-1a23-4397-823f-6c0f37fb1fcd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:59.228992 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e07ec-1a23-4397-823f-6c0f37fb1fcd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:59.230519 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e07ec-1a23-4397-823f-6c0f37fb1fcd None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:59.253926 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 339/683] 10.222.0.60 () {56 vars in 1135 bytes} [Thu May 12 09:20:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:59.254882 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e07ec-1a23-4397-823f-6c0f37fb1fcd None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:59.273441 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 345/684] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:20:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:20:59.273441 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa5b2e-8588-4a12-ad6f-7c8bfea8f44a None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:59.366265 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e07ec-1a23-4397-823f-6c0f37fb1fcd None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:59.389924 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa5b2e-8588-4a12-ad6f-7c8bfea8f44a None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:59.401488 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd131b03-d4ff-452a-8d14-5c0be073fdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:59.402342 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd131b03-d4ff-452a-8d14-5c0be073fdb8 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:59.402725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd131b03-d4ff-452a-8d14-5c0be073fdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:59.403109 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd131b03-d4ff-452a-8d14-5c0be073fdb8 None admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:59.403994 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd131b03-d4ff-452a-8d14-5c0be073fdb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:59.404403 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd131b03-d4ff-452a-8d14-5c0be073fdb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:59.405931 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd131b03-d4ff-452a-8d14-5c0be073fdb8 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:59.418099 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 340/685] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:20:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:59.419131 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd131b03-d4ff-452a-8d14-5c0be073fdb8 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:59.425528 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d384b-6fb8-4c0c-b2a0-0f152f1ee4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:59.426491 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d384b-6fb8-4c0c-b2a0-0f152f1ee4bb None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:59.426936 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d384b-6fb8-4c0c-b2a0-0f152f1ee4bb None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:59.427407 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d384b-6fb8-4c0c-b2a0-0f152f1ee4bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:59.531312 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd131b03-d4ff-452a-8d14-5c0be073fdb8 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:59.568163 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536334a-eba5-480f-accb-c652b48cb99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:59.569137 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536334a-eba5-480f-accb-c652b48cb99b None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:59.569530 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536334a-eba5-480f-accb-c652b48cb99b None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:59.569926 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536334a-eba5-480f-accb-c652b48cb99b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:59.580920 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536334a-eba5-480f-accb-c652b48cb99b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:59.593922 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536334a-eba5-480f-accb-c652b48cb99b None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:59.606703 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-4536334a-eba5-480f-accb-c652b48cb99b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:59.606703 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:20:59.606703 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:20:59.606703 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:20:59.606703 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:20:59.606703 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:20:59.606703 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:20:59.606703 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:20:59.606703 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:20:59.606703 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:20:59.606703 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:20:59.606703 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:20:59.606703 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:20:59.606703 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:20:59.606703 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:20:59.607600 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:20:59.607600 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:20:59.607600 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:20:59.607600 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:20:59.607600 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:20:59.607600 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:20:59.607600 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:20:59.607600 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:20:59.607600 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:20:59.607600 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:20:59.607600 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:20:59.607600 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:20:59.607600 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:20:59.607600 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:20:59.607600 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:20:59.607600 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:20:59.607600 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:20:59.608520 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:20:59.608520 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:20:59.608520 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:20:59.608520 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:20:59.609987 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 341/686] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:20:59.610808 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536334a-eba5-480f-accb-c652b48cb99b None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:59.629429 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d384b-6fb8-4c0c-b2a0-0f152f1ee4bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:59.631197 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d384b-6fb8-4c0c-b2a0-0f152f1ee4bb None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:59.722950 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536334a-eba5-480f-accb-c652b48cb99b None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:59.740638 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 346/687] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:20:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:20:59.741629 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d384b-6fb8-4c0c-b2a0-0f152f1ee4bb None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:59.770745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16753153-edae-4cf0-9a4b-968b8cce6be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:59.771518 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16753153-edae-4cf0-9a4b-968b8cce6be8 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:59.771950 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16753153-edae-4cf0-9a4b-968b8cce6be8 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:59.772228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16753153-edae-4cf0-9a4b-968b8cce6be8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:59.773624 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16753153-edae-4cf0-9a4b-968b8cce6be8 None admin] RBAC: Adding query filter params (role.id=4798f242077c416e9292660af5469faf, scope.project.id=9cf4f2954dd44516b3e594ed440781cc, user.id=bf7b793f84bd4a72a68d5ab65221e1a1) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:59.773956 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16753153-edae-4cf0-9a4b-968b8cce6be8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:59.775570 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16753153-edae-4cf0-9a4b-968b8cce6be8 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:59.786126 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 342/688] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:20:59 2022] GET /identity/v3/role_assignments?user.id=bf7b793f84bd4a72a68d5ab65221e1a1&scope.project.id=9cf4f2954dd44516b3e594ed440781cc&role.id=4798f242077c416e9292660af5469faf => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:59.786908 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16753153-edae-4cf0-9a4b-968b8cce6be8 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:20:59.888510 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d384b-6fb8-4c0c-b2a0-0f152f1ee4bb None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:20:59.931944 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e1676-a057-4626-9b5e-60d5ea3924d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:20:59.933265 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e1676-a057-4626-9b5e-60d5ea3924d6 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:20:59.933448 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e1676-a057-4626-9b5e-60d5ea3924d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:20:59.937151 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e1676-a057-4626-9b5e-60d5ea3924d6 None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:20:59.941707 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e1676-a057-4626-9b5e-60d5ea3924d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:20:59.945923 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e1676-a057-4626-9b5e-60d5ea3924d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:20:59.945923 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e1676-a057-4626-9b5e-60d5ea3924d6 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:20:59.968139 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 347/689] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:20:59.973468 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e1676-a057-4626-9b5e-60d5ea3924d6 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:00.001578 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16753153-edae-4cf0-9a4b-968b8cce6be8 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:00.050875 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bfce7d-230c-4d35-850a-c8d194be1991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:00.051634 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bfce7d-230c-4d35-850a-c8d194be1991 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:00.051917 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bfce7d-230c-4d35-850a-c8d194be1991 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:00.052192 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bfce7d-230c-4d35-850a-c8d194be1991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:00.063100 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bfce7d-230c-4d35-850a-c8d194be1991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:00.064559 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bfce7d-230c-4d35-850a-c8d194be1991 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:00.084068 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-39bfce7d-230c-4d35-850a-c8d194be1991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:00.084068 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:00.084068 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:00.084068 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:00.084068 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:00.084068 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:00.084068 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:00.084068 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:00.084068 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:00.084068 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:00.084068 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:00.084068 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:00.084068 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:21:00.084068 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:21:00.084068 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:21:00.086042 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:21:00.086042 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:00.086042 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:00.086042 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:00.086042 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:00.086042 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:00.086042 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:00.086042 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:00.086042 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:00.086042 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:00.086042 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:00.086042 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:00.086042 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:00.086042 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:00.086042 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:00.086042 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:00.086042 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:00.087234 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:21:00.087234 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:21:00.087234 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:00.087234 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:00.087234 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 343/690] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:20:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:00.092441 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bfce7d-230c-4d35-850a-c8d194be1991 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:00.126544 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e1676-a057-4626-9b5e-60d5ea3924d6 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:00.164245 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84adbcdf-4b11-43b7-ac6c-bd23865d7c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:00.165090 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adbcdf-4b11-43b7-ac6c-bd23865d7c54 None admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:00.165472 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adbcdf-4b11-43b7-ac6c-bd23865d7c54 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:00.165846 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adbcdf-4b11-43b7-ac6c-bd23865d7c54 None admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:00.166700 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84adbcdf-4b11-43b7-ac6c-bd23865d7c54 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:00.169044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84adbcdf-4b11-43b7-ac6c-bd23865d7c54 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:00.195663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 348/691] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 12 09:20:59 2022] POST /identity/v3/users => generated 254 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:21:00.224425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bfce7d-230c-4d35-850a-c8d194be1991 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:00.262550 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9ea07-561d-48c3-8aba-3791340f1bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:00.263485 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9ea07-561d-48c3-8aba-3791340f1bf1 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:00.263910 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9ea07-561d-48c3-8aba-3791340f1bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:00.264324 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9ea07-561d-48c3-8aba-3791340f1bf1 None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:00.265287 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9ea07-561d-48c3-8aba-3791340f1bf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:00.265797 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9ea07-561d-48c3-8aba-3791340f1bf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:00.267483 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9ea07-561d-48c3-8aba-3791340f1bf1 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:00.281876 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 344/692] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:00.287575 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84adbcdf-4b11-43b7-ac6c-bd23865d7c54 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:00.393048 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84adbcdf-4b11-43b7-ac6c-bd23865d7c54 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:00.427077 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d851f3-6002-4049-85dd-1321dea86f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:00.427878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d851f3-6002-4049-85dd-1321dea86f91 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:00.428153 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d851f3-6002-4049-85dd-1321dea86f91 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:00.428421 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d851f3-6002-4049-85dd-1321dea86f91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:00.435573 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d851f3-6002-4049-85dd-1321dea86f91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:00.437015 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d851f3-6002-4049-85dd-1321dea86f91 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:00.452903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-89d851f3-6002-4049-85dd-1321dea86f91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:00.452903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:00.452903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:00.452903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:00.452903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:00.452903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:00.452903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:00.452903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:00.452903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:00.452903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:00.452903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:00.452903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:00.452903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:21:00.452903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:21:00.452903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:21:00.454084 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:21:00.454084 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:00.454084 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:00.454084 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:00.454084 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:00.454084 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:00.454084 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:00.454084 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:00.454084 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:00.454084 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:00.454084 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:00.454084 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:00.454084 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:00.454084 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:00.454084 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:00.454084 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:00.454084 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:00.455121 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:21:00.455121 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:21:00.455121 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:21:00.455121 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:21:00.455121 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:21:00.455121 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:21:00.455121 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:00.455121 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:00.455121 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 349/693] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:21:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:00.461026 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9ea07-561d-48c3-8aba-3791340f1bf1 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:00.564240 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9ea07-561d-48c3-8aba-3791340f1bf1 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:00.598063 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e87df6-f704-4c9e-b447-7639346fc0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:00.598719 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e87df6-f704-4c9e-b447-7639346fc0cf None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:00.599004 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e87df6-f704-4c9e-b447-7639346fc0cf None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:00.599274 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e87df6-f704-4c9e-b447-7639346fc0cf None admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:00.600052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e87df6-f704-4c9e-b447-7639346fc0cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:00.600350 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e87df6-f704-4c9e-b447-7639346fc0cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:00.601763 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e87df6-f704-4c9e-b447-7639346fc0cf None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:00.615265 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 345/694] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:21:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:00.621160 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d851f3-6002-4049-85dd-1321dea86f91 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:00.663680 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc077c63-6fdf-452a-aafd-c7840e76703a None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:00.663881 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc077c63-6fdf-452a-aafd-c7840e76703a None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:00.664155 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc077c63-6fdf-452a-aafd-c7840e76703a None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:00.665670 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 346/695] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:21:00.671950 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41ea9b-3fd4-4ab2-9162-e22a35f60c2a None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:00.672227 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41ea9b-3fd4-4ab2-9162-e22a35f60c2a None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:00.672496 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41ea9b-3fd4-4ab2-9162-e22a35f60c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:00.689502 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-ce41ea9b-3fd4-4ab2-9162-e22a35f60c2a None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:00.690698 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-ce41ea9b-3fd4-4ab2-9162-e22a35f60c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:00.733089 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d851f3-6002-4049-85dd-1321dea86f91 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:00.759230 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 347/696] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:21:00.776335 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ab1f9-acfe-47f2-886d-7ae3d72c9cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:00.777033 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ab1f9-acfe-47f2-886d-7ae3d72c9cb1 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:00.777367 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ab1f9-acfe-47f2-886d-7ae3d72c9cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:00.777640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ab1f9-acfe-47f2-886d-7ae3d72c9cb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:00.778502 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ab1f9-acfe-47f2-886d-7ae3d72c9cb1 None admin] RBAC: Adding query filter params (role.id=4798f242077c416e9292660af5469faf, scope.project.id=9cf4f2954dd44516b3e594ed440781cc, user.id=f7693a31911346f9bb2c01efcd8e16e6) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:00.778809 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ab1f9-acfe-47f2-886d-7ae3d72c9cb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:00.780293 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ab1f9-acfe-47f2-886d-7ae3d72c9cb1 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:00.786686 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 350/697] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:21:00 2022] GET /identity/v3/role_assignments?user.id=f7693a31911346f9bb2c01efcd8e16e6&scope.project.id=9cf4f2954dd44516b3e594ed440781cc&role.id=4798f242077c416e9292660af5469faf => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:00.791395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41ea9b-3fd4-4ab2-9162-e22a35f60c2a None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:00.903181 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41ea9b-3fd4-4ab2-9162-e22a35f60c2a None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:00.943525 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f78a469-284f-43b8-bb15-6748907ab46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:00.944264 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78a469-284f-43b8-bb15-6748907ab46a None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:00.944538 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78a469-284f-43b8-bb15-6748907ab46a None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:00.944809 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78a469-284f-43b8-bb15-6748907ab46a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:00.956003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f78a469-284f-43b8-bb15-6748907ab46a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:21:00.964484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-6f78a469-284f-43b8-bb15-6748907ab46a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:21:00.964484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:00.964484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:00.964484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:00.964484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:00.964484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:00.964484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:00.964484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:00.964484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:00.964484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:00.964484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:00.964484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:00.964484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:21:00.964484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:21:00.964484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:21:00.964484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:21:00.965513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:21:00.965513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:21:00.965513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:21:00.965513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:21:00.965513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:00.965513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:00.965513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:00.965513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:00.965513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:00.965513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:00.965513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:00.965513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:00.965513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:00.965513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:00.965513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:00.965513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:00.966411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:00.966411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:00.966411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:00.966411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:00.966411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:21:00.966411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:21:00.966411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:21:00.966411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:21:00.966411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:21:00.966411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:21:00.966411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:21:00.966411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:00.966411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 348/698] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:21:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:00.974490 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ab1f9-acfe-47f2-886d-7ae3d72c9cb1 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:01.101928 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ab1f9-acfe-47f2-886d-7ae3d72c9cb1 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:01.139263 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3bc6f-6ef5-4f53-be42-7d5377f63d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:01.139941 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3bc6f-6ef5-4f53-be42-7d5377f63d2d None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:01.140221 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3bc6f-6ef5-4f53-be42-7d5377f63d2d None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:01.140492 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3bc6f-6ef5-4f53-be42-7d5377f63d2d None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:01.141233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3bc6f-6ef5-4f53-be42-7d5377f63d2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:01.141534 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3bc6f-6ef5-4f53-be42-7d5377f63d2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:01.143001 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3bc6f-6ef5-4f53-be42-7d5377f63d2d None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:01.151923 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 351/699] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:21:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:01.157617 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f78a469-284f-43b8-bb15-6748907ab46a None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:01.267342 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f78a469-284f-43b8-bb15-6748907ab46a None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:01.299929 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db0151-c2fb-413a-931b-0d3017292881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:01.300949 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db0151-c2fb-413a-931b-0d3017292881 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:01.301373 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db0151-c2fb-413a-931b-0d3017292881 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:01.301790 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db0151-c2fb-413a-931b-0d3017292881 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:01.312764 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29db0151-c2fb-413a-931b-0d3017292881 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:01.314459 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29db0151-c2fb-413a-931b-0d3017292881 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:01.331810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-29db0151-c2fb-413a-931b-0d3017292881 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:01.331810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:01.331810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:01.331810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:01.331810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:01.331810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:01.331810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:01.331810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:01.331810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:01.331810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:01.331810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:01.331810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:01.331810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:21:01.331810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:21:01.331810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:21:01.332912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:21:01.332912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:01.332912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:01.332912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:01.332912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:01.332912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:01.332912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:01.332912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:01.332912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:01.332912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:01.332912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:01.332912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:01.332912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:01.332912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:01.332912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:01.332912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:01.332912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:01.334078 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:21:01.334078 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:21:01.334078 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:01.334078 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:01.335411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 349/700] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:01.341175 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3bc6f-6ef5-4f53-be42-7d5377f63d2d None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:01.455278 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3bc6f-6ef5-4f53-be42-7d5377f63d2d None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:01.505719 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639c378-975d-4745-85dd-f8ad41b011cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:01.506824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639c378-975d-4745-85dd-f8ad41b011cc None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:01.507310 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639c378-975d-4745-85dd-f8ad41b011cc None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:01.507781 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639c378-975d-4745-85dd-f8ad41b011cc None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:01.508704 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639c378-975d-4745-85dd-f8ad41b011cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:01.509210 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639c378-975d-4745-85dd-f8ad41b011cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:01.510839 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639c378-975d-4745-85dd-f8ad41b011cc None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:01.532503 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 352/701] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:01.538278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db0151-c2fb-413a-931b-0d3017292881 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:01.617643 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9635264-4f9f-473d-a716-c441abf699d5 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:01.618043 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9635264-4f9f-473d-a716-c441abf699d5 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:01.618279 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9635264-4f9f-473d-a716-c441abf699d5 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:01.619830 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 353/702] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:21:01.625262 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54342ba-63b3-4c8d-998f-6ca9aa247a6a None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:01.625553 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54342ba-63b3-4c8d-998f-6ca9aa247a6a None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:01.625831 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54342ba-63b3-4c8d-998f-6ca9aa247a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:01.642430 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-b54342ba-63b3-4c8d-998f-6ca9aa247a6a None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:01.643612 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-b54342ba-63b3-4c8d-998f-6ca9aa247a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:01.663216 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db0151-c2fb-413a-931b-0d3017292881 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:01.701345 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910f8df-6616-4375-a71c-833680cbf854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:01.702183 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910f8df-6616-4375-a71c-833680cbf854 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:01.702463 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910f8df-6616-4375-a71c-833680cbf854 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:01.702734 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910f8df-6616-4375-a71c-833680cbf854 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:01.715529 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910f8df-6616-4375-a71c-833680cbf854 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:01.716981 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910f8df-6616-4375-a71c-833680cbf854 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:01.740096 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-c910f8df-6616-4375-a71c-833680cbf854 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 09:21:01.740096 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:01.740096 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:01.740096 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:01.740096 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:01.740096 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:01.740096 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:01.740096 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:01.740096 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:01.740096 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:01.740096 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:01.740096 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:01.740096 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:21:01.740096 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:21:01.740096 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:21:01.740096 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:21:01.741114 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:01.741114 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:01.741114 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:21:01.741114 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:01.741114 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:21:01.741114 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:01.741114 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:01.741114 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:01.741114 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:01.741114 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:01.741114 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:01.741114 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:01.741114 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:01.741114 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:01.741114 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:01.741114 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:01.741114 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:01.741114 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:01.742101 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:01.742101 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:01.742101 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:21:01.742101 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:21:01.742101 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:21:01.742101 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:21:01.742101 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:21:01.742101 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:21:01.742101 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 09:21:01.742101 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:01.744156 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 350/703] 10.222.0.60 () {56 vars in 1093 bytes} [Thu May 12 09:21:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:01.751332 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910f8df-6616-4375-a71c-833680cbf854 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:01.776861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 354/704] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:21:01.816779 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54342ba-63b3-4c8d-998f-6ca9aa247a6a None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:01.910704 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910f8df-6616-4375-a71c-833680cbf854 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:01.976191 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd8b5a-e039-4405-8413-c9d5a6cbca9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:01.976862 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd8b5a-e039-4405-8413-c9d5a6cbca9a None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:01.977145 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd8b5a-e039-4405-8413-c9d5a6cbca9a None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:01.977418 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd8b5a-e039-4405-8413-c9d5a6cbca9a None admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:01.978274 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd8b5a-e039-4405-8413-c9d5a6cbca9a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:01.978581 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd8b5a-e039-4405-8413-c9d5a6cbca9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:01.980548 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd8b5a-e039-4405-8413-c9d5a6cbca9a None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:01.994623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54342ba-63b3-4c8d-998f-6ca9aa247a6a None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:02.014866 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 351/705] 10.222.0.60 () {56 vars in 1133 bytes} [Thu May 12 09:21:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:02.020584 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd8b5a-e039-4405-8413-c9d5a6cbca9a None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:02.049365 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aec7ba-7c3a-4e50-941b-75fa320ee49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:02.050594 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aec7ba-7c3a-4e50-941b-75fa320ee49e None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:02.051139 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aec7ba-7c3a-4e50-941b-75fa320ee49e None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:02.051962 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aec7ba-7c3a-4e50-941b-75fa320ee49e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:02.053387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aec7ba-7c3a-4e50-941b-75fa320ee49e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:02.055347 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aec7ba-7c3a-4e50-941b-75fa320ee49e None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:02.070618 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-c3aec7ba-7c3a-4e50-941b-75fa320ee49e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 09:21:02.070618 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:02.070618 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 09:21:02.070618 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 09:21:02.070618 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 09:21:02.070618 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 09:21:02.070618 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 09:21:02.070618 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:02.070618 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 09:21:02.070618 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:02.070618 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 09:21:02.070618 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:02.070618 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:02.070618 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:02.070618 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:02.070618 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:02.071615 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:02.071615 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:02.071615 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:02.071615 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:02.071615 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:02.071615 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:02.071615 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:02.071615 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 09:21:02.071615 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 09:21:02.071615 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 09:21:02.071615 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 09:21:02.071615 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:02.071615 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:02.071615 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:02.071615 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:02.071615 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:02.072507 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:02.072507 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:02.072507 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:02.072507 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:02.072507 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:02.072507 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:02.072507 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:02.072507 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:02.072507 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:02.072507 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:02.072507 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:02.072507 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 09:21:02.072507 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:02.072507 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 09:21:02.072507 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:02.076579 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 355/706] 10.222.0.60 () {56 vars in 1129 bytes} [Thu May 12 09:21:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:02.081951 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aec7ba-7c3a-4e50-941b-75fa320ee49e None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:02.197939 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd8b5a-e039-4405-8413-c9d5a6cbca9a None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:02.235097 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d3bed-0045-4c43-8352-396b1362d46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:02.235745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d3bed-0045-4c43-8352-396b1362d46f None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:02.236023 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d3bed-0045-4c43-8352-396b1362d46f None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:02.236302 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d3bed-0045-4c43-8352-396b1362d46f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:02.254799 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aec7ba-7c3a-4e50-941b-75fa320ee49e None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:02.312947 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5bec5-25a0-46f8-8dca-ebdc55fface3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:02.313769 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5bec5-25a0-46f8-8dca-ebdc55fface3 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:02.314088 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5bec5-25a0-46f8-8dca-ebdc55fface3 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:02.314410 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5bec5-25a0-46f8-8dca-ebdc55fface3 None admin] PATH_INFO: `/v3/services` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:02.315540 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5bec5-25a0-46f8-8dca-ebdc55fface3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:02.315849 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5bec5-25a0-46f8-8dca-ebdc55fface3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:02.317210 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5bec5-25a0-46f8-8dca-ebdc55fface3 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:02.322804 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 356/707] 10.222.0.60 () {56 vars in 1124 bytes} [Thu May 12 09:21:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:02.331192 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5bec5-25a0-46f8-8dca-ebdc55fface3 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:02.359824 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d3bed-0045-4c43-8352-396b1362d46f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:02.361307 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d3bed-0045-4c43-8352-396b1362d46f None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:02.485020 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5bec5-25a0-46f8-8dca-ebdc55fface3 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:02.529631 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f63f6-adea-4386-ab48-6388430139df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:02.530354 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f63f6-adea-4386-ab48-6388430139df None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:02.530641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f63f6-adea-4386-ab48-6388430139df None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:02.530919 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f63f6-adea-4386-ab48-6388430139df None admin] PATH_INFO: `/v3/services` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:02.531631 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f63f6-adea-4386-ab48-6388430139df None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:02.531939 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f63f6-adea-4386-ab48-6388430139df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:02.533311 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f63f6-adea-4386-ab48-6388430139df None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:02.539435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 357/708] 10.222.0.60 () {56 vars in 1124 bytes} [Thu May 12 09:21:02 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:02.550432 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 352/709] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:21:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 09:21:02.556357 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f63f6-adea-4386-ab48-6388430139df None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:02.682737 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f63f6-adea-4386-ab48-6388430139df None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:02.716871 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54ab39-8e3d-45d1-98d1-62f01fc95d2f None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:02.717195 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54ab39-8e3d-45d1-98d1-62f01fc95d2f None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:02.717430 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54ab39-8e3d-45d1-98d1-62f01fc95d2f None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:02.718851 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 353/710] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:21:02.726778 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735b478-2d7f-4109-aab9-1d81cf587d35 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:02.727414 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735b478-2d7f-4109-aab9-1d81cf587d35 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:02.727751 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735b478-2d7f-4109-aab9-1d81cf587d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:02.742740 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac559d3-6ce4-4036-ac34-84844edc7687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:02.743889 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac559d3-6ce4-4036-ac34-84844edc7687 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:02.744358 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac559d3-6ce4-4036-ac34-84844edc7687 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:02.744843 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac559d3-6ce4-4036-ac34-84844edc7687 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:02.746706 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-4735b478-2d7f-4109-aab9-1d81cf587d35 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:02.747971 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-4735b478-2d7f-4109-aab9-1d81cf587d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:02.762411 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac559d3-6ce4-4036-ac34-84844edc7687 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:02.764186 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac559d3-6ce4-4036-ac34-84844edc7687 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:02.801353 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-5ac559d3-6ce4-4036-ac34-84844edc7687 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:02.801353 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:02.801353 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:02.801353 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:02.801353 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:02.801353 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:02.801353 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:02.801353 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:02.801353 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:02.801353 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:02.801353 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:02.801353 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:02.801353 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:21:02.801353 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:21:02.801353 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:21:02.802386 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:21:02.802386 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:02.802386 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:02.802386 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:02.802386 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:02.802386 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:02.802386 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:02.802386 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:02.802386 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:02.802386 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:02.802386 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:02.802386 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:02.802386 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:02.802386 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:02.802386 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:02.802386 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:02.802386 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:02.803376 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:21:02.803376 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:21:02.803376 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:02.803376 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:02.814084 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 358/711] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:02.815066 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac559d3-6ce4-4036-ac34-84844edc7687 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:02.850630 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 354/712] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:21:02.884314 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735b478-2d7f-4109-aab9-1d81cf587d35 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:02.996779 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac559d3-6ce4-4036-ac34-84844edc7687 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:03.004537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735b478-2d7f-4109-aab9-1d81cf587d35 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:03.031477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2a5cb-d032-44bc-9993-8e51ee5d03cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:03.032152 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2a5cb-d032-44bc-9993-8e51ee5d03cd None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:03.032434 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2a5cb-d032-44bc-9993-8e51ee5d03cd None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:03.032714 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2a5cb-d032-44bc-9993-8e51ee5d03cd None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:03.033524 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2a5cb-d032-44bc-9993-8e51ee5d03cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:03.033808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2a5cb-d032-44bc-9993-8e51ee5d03cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:03.035220 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2a5cb-d032-44bc-9993-8e51ee5d03cd None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:03.040940 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33daa613-ee5d-4fe4-b7bc-1f453b934677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:03.042128 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33daa613-ee5d-4fe4-b7bc-1f453b934677 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:03.042649 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33daa613-ee5d-4fe4-b7bc-1f453b934677 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:03.043149 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33daa613-ee5d-4fe4-b7bc-1f453b934677 None admin] PATH_INFO: `/v3/services/network` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:03.044012 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33daa613-ee5d-4fe4-b7bc-1f453b934677 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:03.045601 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33daa613-ee5d-4fe4-b7bc-1f453b934677 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:03.047028 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 359/713] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:03.054858 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2a5cb-d032-44bc-9993-8e51ee5d03cd None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:03.061758 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-33daa613-ee5d-4fe4-b7bc-1f453b934677 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 09:21:03.061758 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:03.061758 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 09:21:03.061758 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 09:21:03.061758 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 09:21:03.061758 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 09:21:03.061758 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 09:21:03.061758 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:03.061758 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 09:21:03.061758 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:03.061758 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 09:21:03.061758 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:03.061758 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:03.061758 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:03.061758 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:03.061758 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:03.061758 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:03.063012 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:03.063012 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:03.063012 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:03.063012 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:03.063012 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:03.063012 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:03.063012 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 09:21:03.063012 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 09:21:03.063012 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 09:21:03.063012 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 09:21:03.063012 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:03.063012 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:03.063012 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:03.063012 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:03.063012 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:03.063012 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:03.064069 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:03.064069 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:03.064069 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:03.064069 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:03.064069 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:03.064069 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:03.064069 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:03.064069 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:03.064069 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:03.064069 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:03.064069 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 09:21:03.064069 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:03.064069 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 09:21:03.064069 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:03.066329 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 355/714] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:21:02 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:03.074564 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33daa613-ee5d-4fe4-b7bc-1f453b934677 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:03.189059 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2a5cb-d032-44bc-9993-8e51ee5d03cd None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:03.224050 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1629d4-2666-459a-a314-abab155c4033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:03.224874 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1629d4-2666-459a-a314-abab155c4033 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:03.225157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1629d4-2666-459a-a314-abab155c4033 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:03.225432 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1629d4-2666-459a-a314-abab155c4033 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:03.234034 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1629d4-2666-459a-a314-abab155c4033 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:03.235592 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1629d4-2666-459a-a314-abab155c4033 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:03.251295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-db1629d4-2666-459a-a314-abab155c4033 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:03.251295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:03.251295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:03.251295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:03.251295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:03.251295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:03.251295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:03.251295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:03.251295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:03.251295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:03.251295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:03.251295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:03.251295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:21:03.251295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:21:03.251295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:21:03.252233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:21:03.252233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:03.252233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:03.252233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:03.252233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:03.252233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:03.252233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:03.252233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:03.252233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:03.252233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:03.252233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:03.252233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:03.252233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:03.252233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:03.252233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:03.252233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:03.252233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:03.253143 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:21:03.253143 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:21:03.253143 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:21:03.253143 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:21:03.253143 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:21:03.253143 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:21:03.253143 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:03.253143 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:03.253143 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 360/715] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:21:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:03.259127 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1629d4-2666-459a-a314-abab155c4033 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:03.320706 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33daa613-ee5d-4fe4-b7bc-1f453b934677 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:03.364473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1629d4-2666-459a-a314-abab155c4033 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:03.398082 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb43e3a-ca47-4540-9b29-a3b8a439ab32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:03.398850 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb43e3a-ca47-4540-9b29-a3b8a439ab32 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:03.399131 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb43e3a-ca47-4540-9b29-a3b8a439ab32 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:03.399404 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb43e3a-ca47-4540-9b29-a3b8a439ab32 None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:03.400206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb43e3a-ca47-4540-9b29-a3b8a439ab32 None admin] RBAC: Adding query filter params (name=network) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:03.400321 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88156d9-1cc0-4583-a596-e04267ff83cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:03.400539 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb43e3a-ca47-4540-9b29-a3b8a439ab32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:03.400912 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88156d9-1cc0-4583-a596-e04267ff83cd None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:03.401199 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88156d9-1cc0-4583-a596-e04267ff83cd None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:03.401537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88156d9-1cc0-4583-a596-e04267ff83cd None admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:03.401969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb43e3a-ca47-4540-9b29-a3b8a439ab32 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:03.402420 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88156d9-1cc0-4583-a596-e04267ff83cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:03.402730 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88156d9-1cc0-4583-a596-e04267ff83cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:03.404181 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88156d9-1cc0-4583-a596-e04267ff83cd None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:03.416129 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 356/716] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 12 09:21:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:03.422357 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 361/717] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:21:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:03.423292 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb43e3a-ca47-4540-9b29-a3b8a439ab32 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:03.426997 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88156d9-1cc0-4583-a596-e04267ff83cd None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:03.530063 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb43e3a-ca47-4540-9b29-a3b8a439ab32 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:03.534483 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88156d9-1cc0-4583-a596-e04267ff83cd None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:03.566306 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194938f7-cdb6-4133-bd7f-d4f7a0f2f1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:03.566970 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194938f7-cdb6-4133-bd7f-d4f7a0f2f1ee None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:03.567250 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194938f7-cdb6-4133-bd7f-d4f7a0f2f1ee None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:03.567521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194938f7-cdb6-4133-bd7f-d4f7a0f2f1ee None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:03.568287 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194938f7-cdb6-4133-bd7f-d4f7a0f2f1ee None admin] RBAC: Adding query filter params (type=network) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:03.568595 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194938f7-cdb6-4133-bd7f-d4f7a0f2f1ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:03.570176 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194938f7-cdb6-4133-bd7f-d4f7a0f2f1ee None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:03.575228 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb25778-dbdd-41b4-b66a-14e2ed1554de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:03.575897 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb25778-dbdd-41b4-b66a-14e2ed1554de None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:03.576181 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb25778-dbdd-41b4-b66a-14e2ed1554de None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:03.576393 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 357/718] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 12 09:21:03 2022] GET /identity/v3/services?type=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:03.576556 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb25778-dbdd-41b4-b66a-14e2ed1554de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:03.577276 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb25778-dbdd-41b4-b66a-14e2ed1554de None admin] RBAC: Adding query filter params (role.id=8f01c4c38fa44034a54c1f8cd2d2db1a, scope.project.id=9cf4f2954dd44516b3e594ed440781cc, user.id=2915babd40aa42e8bf7cc85c5a97daa6) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:03.577504 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae0c64-ea39-4a09-a07f-a5d3b394ba3f None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:03.577676 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb25778-dbdd-41b4-b66a-14e2ed1554de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:03.577833 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae0c64-ea39-4a09-a07f-a5d3b394ba3f None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:03.578087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae0c64-ea39-4a09-a07f-a5d3b394ba3f None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:03.579358 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 358/719] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:03.583353 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb25778-dbdd-41b4-b66a-14e2ed1554de None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:03.593164 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91891b17-e99f-46f3-919d-d9406a534035 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:03.593513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91891b17-e99f-46f3-919d-d9406a534035 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:03.593695 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91891b17-e99f-46f3-919d-d9406a534035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:03.599838 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 362/720] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:21:03 2022] GET /identity/v3/role_assignments?user.id=2915babd40aa42e8bf7cc85c5a97daa6&scope.project.id=9cf4f2954dd44516b3e594ed440781cc&role.id=8f01c4c38fa44034a54c1f8cd2d2db1a => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:03.616970 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-91891b17-e99f-46f3-919d-d9406a534035 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:03.618327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-91891b17-e99f-46f3-919d-d9406a534035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:03.735338 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 359/721] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:21:03.767194 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb25778-dbdd-41b4-b66a-14e2ed1554de None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:03.881542 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb25778-dbdd-41b4-b66a-14e2ed1554de None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:03.914767 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585df24f-c70e-40b4-a501-70799345dfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:03.915568 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585df24f-c70e-40b4-a501-70799345dfb1 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:03.915849 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585df24f-c70e-40b4-a501-70799345dfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:03.916120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585df24f-c70e-40b4-a501-70799345dfb1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:03.926769 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585df24f-c70e-40b4-a501-70799345dfb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:21:03.935150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-585df24f-c70e-40b4-a501-70799345dfb1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 09:21:03.935150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:03.935150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:03.935150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:03.935150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:03.935150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:03.935150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:03.935150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:03.935150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:03.935150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:03.935150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:03.935150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:03.935150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:21:03.935150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:21:03.935150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:21:03.935150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:21:03.936872 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:21:03.936872 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:21:03.936872 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:21:03.936872 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:21:03.936872 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:03.936872 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:03.936872 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:03.936872 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:03.936872 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:03.936872 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:03.936872 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:03.936872 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:03.936872 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:03.936872 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:03.936872 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:03.936872 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:03.937856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:03.937856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:03.937856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:03.937856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:03.937856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:21:03.937856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:21:03.937856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:21:03.937856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:21:03.937856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:21:03.937856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:21:03.937856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 09:21:03.937856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:03.937856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 363/722] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 12 09:21:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:03.942814 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91891b17-e99f-46f3-919d-d9406a534035 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:03.987145 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d7420-8d86-448d-9098-ec33ac884f69 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:03.987464 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d7420-8d86-448d-9098-ec33ac884f69 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:03.987689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d7420-8d86-448d-9098-ec33ac884f69 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:03.989031 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 364/723] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:21:03.994152 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6527b-536a-4650-9fd9-1bfe1b0351f2 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:03.994433 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6527b-536a-4650-9fd9-1bfe1b0351f2 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:03.994707 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6527b-536a-4650-9fd9-1bfe1b0351f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:04.012756 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-36e6527b-536a-4650-9fd9-1bfe1b0351f2 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:04.014267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-36e6527b-536a-4650-9fd9-1bfe1b0351f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:04.090061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 365/724] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 09:21:04.112353 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91891b17-e99f-46f3-919d-d9406a534035 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:04.125715 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6527b-536a-4650-9fd9-1bfe1b0351f2 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:04.157881 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab2888-1573-4b11-baba-d873326ea424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:04.159140 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab2888-1573-4b11-baba-d873326ea424 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:04.159647 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab2888-1573-4b11-baba-d873326ea424 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:04.160137 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab2888-1573-4b11-baba-d873326ea424 None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:04.161090 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab2888-1573-4b11-baba-d873326ea424 None admin] RBAC: Adding query filter params (name=service) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:04.161601 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab2888-1573-4b11-baba-d873326ea424 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:04.163224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab2888-1573-4b11-baba-d873326ea424 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:04.176274 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 360/725] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 12 09:21:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:04.177811 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab2888-1573-4b11-baba-d873326ea424 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:04.237994 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6527b-536a-4650-9fd9-1bfe1b0351f2 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:04.276007 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407dcabe-70f1-4f19-b182-ea6604c8e102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:04.277134 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407dcabe-70f1-4f19-b182-ea6604c8e102 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:04.277421 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407dcabe-70f1-4f19-b182-ea6604c8e102 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:04.277698 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407dcabe-70f1-4f19-b182-ea6604c8e102 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:04.288835 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407dcabe-70f1-4f19-b182-ea6604c8e102 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:21:04.298564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-407dcabe-70f1-4f19-b182-ea6604c8e102 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:21:04.298564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:04.298564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:04.298564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:04.298564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:04.298564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:04.298564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:04.298564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:04.298564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:04.298564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:04.298564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:04.298564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:04.298564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:21:04.298564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:21:04.298564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:21:04.298564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:21:04.299521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:21:04.299521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:21:04.299521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:21:04.299521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:21:04.299521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:04.299521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:04.299521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:04.299521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:04.299521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:04.299521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:04.299521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:04.299521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:04.299521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:04.299521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:04.299521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:04.299521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:04.300564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:04.300564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:04.300564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:04.300564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:04.300564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:21:04.300564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:21:04.300564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:21:04.300564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:21:04.300564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:21:04.300564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:21:04.300564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:21:04.300564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:04.300564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 366/726] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:21:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:04.305449 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407dcabe-70f1-4f19-b182-ea6604c8e102 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:04.374571 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab2888-1573-4b11-baba-d873326ea424 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:04.439420 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b80a3f-947d-4d63-9d25-5a5886e99dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:04.440146 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b80a3f-947d-4d63-9d25-5a5886e99dc8 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:04.440427 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b80a3f-947d-4d63-9d25-5a5886e99dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:04.440702 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b80a3f-947d-4d63-9d25-5a5886e99dc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:04.462992 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b80a3f-947d-4d63-9d25-5a5886e99dc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:04.463461 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407dcabe-70f1-4f19-b182-ea6604c8e102 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:04.465321 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b80a3f-947d-4d63-9d25-5a5886e99dc8 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:04.498800 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-39b80a3f-947d-4d63-9d25-5a5886e99dc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:04.498800 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:04.498800 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:04.498800 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:04.498800 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:04.498800 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:04.498800 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:04.498800 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:04.498800 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:04.498800 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:04.498800 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:04.498800 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:04.498800 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:21:04.498800 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:21:04.498800 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:21:04.499745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:21:04.499745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:04.499745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:04.499745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:04.499745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:04.499745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:04.499745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:04.499745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:04.499745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:04.499745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:04.499745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:04.499745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:04.499745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:04.499745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:04.499745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:04.499745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:04.499745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:04.501088 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:21:04.501088 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:21:04.501088 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:04.501088 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:04.501088 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 361/727] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:04.507606 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b80a3f-947d-4d63-9d25-5a5886e99dc8 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:04.515161 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628707a4-ce99-4700-a68b-ad18eaccd8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:04.515854 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628707a4-ce99-4700-a68b-ad18eaccd8e8 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:04.516139 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628707a4-ce99-4700-a68b-ad18eaccd8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:04.516418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628707a4-ce99-4700-a68b-ad18eaccd8e8 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:04.517178 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628707a4-ce99-4700-a68b-ad18eaccd8e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:04.517488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628707a4-ce99-4700-a68b-ad18eaccd8e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:04.519231 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628707a4-ce99-4700-a68b-ad18eaccd8e8 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:04.536691 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 367/728] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:21:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:04.542128 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628707a4-ce99-4700-a68b-ad18eaccd8e8 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:04.613736 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b80a3f-947d-4d63-9d25-5a5886e99dc8 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:04.648812 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c26646-5644-49ec-9df2-834022a769d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:04.649861 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c26646-5644-49ec-9df2-834022a769d5 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:04.650376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c26646-5644-49ec-9df2-834022a769d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:04.650858 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c26646-5644-49ec-9df2-834022a769d5 None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:04.652319 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c26646-5644-49ec-9df2-834022a769d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:04.652858 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c26646-5644-49ec-9df2-834022a769d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:04.654457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c26646-5644-49ec-9df2-834022a769d5 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:04.672196 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 362/729] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:04.673853 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c26646-5644-49ec-9df2-834022a769d5 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:04.775033 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c26646-5644-49ec-9df2-834022a769d5 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:04.800074 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628707a4-ce99-4700-a68b-ad18eaccd8e8 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:04.810250 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9ca1b-d909-46b0-b463-364ba27bd424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:04.811423 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9ca1b-d909-46b0-b463-364ba27bd424 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:04.811918 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9ca1b-d909-46b0-b463-364ba27bd424 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:04.812398 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9ca1b-d909-46b0-b463-364ba27bd424 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:04.819947 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9ca1b-d909-46b0-b463-364ba27bd424 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:04.821741 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9ca1b-d909-46b0-b463-364ba27bd424 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:04.838736 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-e1f9ca1b-d909-46b0-b463-364ba27bd424 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 09:21:04.838736 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:04.838736 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:04.838736 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:04.838736 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:04.838736 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:04.838736 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:04.838736 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:04.838736 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:04.838736 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:04.838736 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:04.838736 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:04.838736 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:21:04.838736 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:21:04.838736 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:21:04.838736 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:21:04.840348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:04.840348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:04.840348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:21:04.840348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:04.840348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:21:04.840348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:04.840348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:04.840348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:04.840348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:04.840348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:04.840348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:04.840348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:04.840348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:04.840348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:04.840348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:04.840348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:04.840348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:04.840348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:04.841345 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:04.841345 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:04.841345 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:21:04.841345 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:21:04.841345 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:21:04.841345 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:21:04.841345 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:21:04.841345 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:21:04.841345 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 09:21:04.841345 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:04.848978 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 363/730] 10.222.0.60 () {56 vars in 1117 bytes} [Thu May 12 09:21:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:04.850435 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9ca1b-d909-46b0-b463-364ba27bd424 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:04.883517 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f017d5-3654-4c18-b463-1aa401a21379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:04.884337 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f017d5-3654-4c18-b463-1aa401a21379 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:04.884620 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f017d5-3654-4c18-b463-1aa401a21379 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:04.884894 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f017d5-3654-4c18-b463-1aa401a21379 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:04.911861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f017d5-3654-4c18-b463-1aa401a21379 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:04.913309 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f017d5-3654-4c18-b463-1aa401a21379 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:04.946473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-89f017d5-3654-4c18-b463-1aa401a21379 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:04.946473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:04.946473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:04.946473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:04.946473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:04.946473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:04.946473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:04.946473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:04.946473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:04.946473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:04.946473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:04.946473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:04.946473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:21:04.946473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:21:04.946473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:21:04.947474 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:21:04.947474 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:04.947474 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:04.947474 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:04.947474 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:04.947474 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:04.947474 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:04.947474 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:04.947474 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:04.947474 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:04.947474 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:04.947474 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:04.947474 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:04.947474 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:04.947474 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:04.947474 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:04.947474 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:04.949005 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:21:04.949005 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:21:04.949005 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:04.949005 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:04.954397 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 368/731] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:04.960641 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9ca1b-d909-46b0-b463-364ba27bd424 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:04.962944 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f017d5-3654-4c18-b463-1aa401a21379 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:05.024079 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548896f4-4dad-4715-8578-5d2b94fb249e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:05.024760 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548896f4-4dad-4715-8578-5d2b94fb249e None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:05.025094 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548896f4-4dad-4715-8578-5d2b94fb249e None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:05.025319 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548896f4-4dad-4715-8578-5d2b94fb249e None admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:05.026188 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548896f4-4dad-4715-8578-5d2b94fb249e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:05.026587 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548896f4-4dad-4715-8578-5d2b94fb249e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:05.028036 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548896f4-4dad-4715-8578-5d2b94fb249e None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:05.054954 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 364/732] 10.222.0.60 () {56 vars in 1149 bytes} [Thu May 12 09:21:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:05.061191 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548896f4-4dad-4715-8578-5d2b94fb249e None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:05.110007 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f017d5-3654-4c18-b463-1aa401a21379 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:05.139696 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b52fb7-dcb7-47d0-95bc-1bfb5183a40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:05.140363 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b52fb7-dcb7-47d0-95bc-1bfb5183a40c None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:05.140641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b52fb7-dcb7-47d0-95bc-1bfb5183a40c None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:05.140911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b52fb7-dcb7-47d0-95bc-1bfb5183a40c None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:05.141629 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b52fb7-dcb7-47d0-95bc-1bfb5183a40c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:05.141968 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b52fb7-dcb7-47d0-95bc-1bfb5183a40c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:05.143340 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b52fb7-dcb7-47d0-95bc-1bfb5183a40c None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:05.156186 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 369/733] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:05.161395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b52fb7-dcb7-47d0-95bc-1bfb5183a40c None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:05.237108 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548896f4-4dad-4715-8578-5d2b94fb249e None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:05.279104 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3dc2ab-176c-4943-a9f1-fff9541cc24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:05.279823 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dc2ab-176c-4943-a9f1-fff9541cc24c None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:05.279936 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dc2ab-176c-4943-a9f1-fff9541cc24c None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:05.280205 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dc2ab-176c-4943-a9f1-fff9541cc24c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:05.291168 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b52fb7-dcb7-47d0-95bc-1bfb5183a40c None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:05.332308 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42cd057-c845-4432-afda-73cd95ab8110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:05.333109 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cd057-c845-4432-afda-73cd95ab8110 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:05.333539 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cd057-c845-4432-afda-73cd95ab8110 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:05.333818 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cd057-c845-4432-afda-73cd95ab8110 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:05.342771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42cd057-c845-4432-afda-73cd95ab8110 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:05.344783 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42cd057-c845-4432-afda-73cd95ab8110 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:05.352127 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3dc2ab-176c-4943-a9f1-fff9541cc24c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:05.353623 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3dc2ab-176c-4943-a9f1-fff9541cc24c None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:05.362274 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-f42cd057-c845-4432-afda-73cd95ab8110 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 09:21:05.362274 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:05.362274 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:05.362274 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:05.362274 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:05.362274 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:05.362274 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:05.362274 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:05.362274 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:05.362274 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:05.362274 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:05.362274 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:05.362274 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:21:05.362274 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:21:05.362274 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:21:05.362274 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:21:05.363238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:05.363238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:05.363238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:21:05.363238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:05.363238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:21:05.363238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:05.363238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:05.363238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:05.363238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:05.363238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:05.363238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:05.363238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:05.363238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:05.363238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:05.363238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:05.363238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:05.363238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:05.363238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:05.364188 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:05.364188 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:05.364188 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:21:05.364188 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:21:05.364188 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:21:05.364188 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:21:05.364188 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:21:05.364188 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:21:05.364188 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 09:21:05.364188 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:05.366030 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 370/734] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:21:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:05.367941 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc10401-f990-4979-8579-5c5fdc645daf None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:05.367941 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc10401-f990-4979-8579-5c5fdc645daf None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:05.367941 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc10401-f990-4979-8579-5c5fdc645daf None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:05.369292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 371/735] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:05.370794 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc10401-f990-4979-8579-5c5fdc645daf None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:05.480904 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc10401-f990-4979-8579-5c5fdc645daf None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:05.481769 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 365/736] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:21:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:21:05.484207 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c7094-6e6f-4b7e-a899-238b5c103251 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:05.484493 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c7094-6e6f-4b7e-a899-238b5c103251 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:05.484767 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c7094-6e6f-4b7e-a899-238b5c103251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:05.503558 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-0b0c7094-6e6f-4b7e-a899-238b5c103251 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:05.505169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-0b0c7094-6e6f-4b7e-a899-238b5c103251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:05.518460 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4716492-3b10-4684-9dd5-5dadbde00b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:05.519478 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4716492-3b10-4684-9dd5-5dadbde00b50 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:05.519769 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4716492-3b10-4684-9dd5-5dadbde00b50 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:05.520046 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4716492-3b10-4684-9dd5-5dadbde00b50 None admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:05.521061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4716492-3b10-4684-9dd5-5dadbde00b50 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:05.521752 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4716492-3b10-4684-9dd5-5dadbde00b50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:05.523492 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4716492-3b10-4684-9dd5-5dadbde00b50 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:05.546124 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 372/737] 10.222.0.60 () {56 vars in 1135 bytes} [Thu May 12 09:21:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:05.546903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4716492-3b10-4684-9dd5-5dadbde00b50 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:05.587224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 366/738] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:21:05.588105 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c7094-6e6f-4b7e-a899-238b5c103251 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:05.671819 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4716492-3b10-4684-9dd5-5dadbde00b50 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:05.705653 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e3418-a60e-49b6-87dc-484587e4147d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:05.706487 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e3418-a60e-49b6-87dc-484587e4147d None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:05.706764 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e3418-a60e-49b6-87dc-484587e4147d None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:05.707034 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e3418-a60e-49b6-87dc-484587e4147d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:05.707255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c7094-6e6f-4b7e-a899-238b5c103251 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:05.717375 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e3418-a60e-49b6-87dc-484587e4147d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:05.718861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e3418-a60e-49b6-87dc-484587e4147d None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:05.740975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-d63e3418-a60e-49b6-87dc-484587e4147d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:05.740975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:05.740975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:05.740975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:05.740975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:05.740975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:05.740975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:05.740975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:05.740975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:05.740975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:05.740975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:05.740975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:05.740975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:21:05.740975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:21:05.740975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:21:05.743634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:21:05.743634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:05.743634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:05.743634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:05.743634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:05.743634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:05.743634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:05.743634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:05.743634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:05.743634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:05.743634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:05.743634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:05.743634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:05.743634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:05.743634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:05.743634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:05.743634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:05.746327 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:21:05.746327 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:21:05.746327 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:05.746327 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:05.746327 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 373/739] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:05.746327 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e3418-a60e-49b6-87dc-484587e4147d None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:05.746969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48948a79-afa6-449a-b2ae-a44334efe5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:05.746969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48948a79-afa6-449a-b2ae-a44334efe5ca None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:05.746969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48948a79-afa6-449a-b2ae-a44334efe5ca None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:05.751378 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48948a79-afa6-449a-b2ae-a44334efe5ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:05.844077 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48948a79-afa6-449a-b2ae-a44334efe5ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:05.845631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48948a79-afa6-449a-b2ae-a44334efe5ca None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:05.860534 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e3418-a60e-49b6-87dc-484587e4147d None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:05.894936 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a324b-6fcc-453d-bb38-060d97dea7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:05.895982 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a324b-6fcc-453d-bb38-060d97dea7ec None admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:05.896473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a324b-6fcc-453d-bb38-060d97dea7ec None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:05.896952 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a324b-6fcc-453d-bb38-060d97dea7ec None admin] PATH_INFO: `/v3/services` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:05.897869 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a324b-6fcc-453d-bb38-060d97dea7ec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:05.899467 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a324b-6fcc-453d-bb38-060d97dea7ec None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:05.919687 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 374/740] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 12 09:21:05 2022] POST /identity/v3/services => generated 251 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:21:05.920896 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a324b-6fcc-453d-bb38-060d97dea7ec None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:06.014421 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 367/741] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:21:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 09:21:06.020962 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48948a79-afa6-449a-b2ae-a44334efe5ca None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:06.053369 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a324b-6fcc-453d-bb38-060d97dea7ec None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:06.106700 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40650cf3-67e5-44dd-a8eb-25868ef7deea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:06.107747 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40650cf3-67e5-44dd-a8eb-25868ef7deea None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:06.108239 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40650cf3-67e5-44dd-a8eb-25868ef7deea None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:06.108718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40650cf3-67e5-44dd-a8eb-25868ef7deea None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:06.109839 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40650cf3-67e5-44dd-a8eb-25868ef7deea None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:06.110415 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40650cf3-67e5-44dd-a8eb-25868ef7deea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:06.112500 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40650cf3-67e5-44dd-a8eb-25868ef7deea None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:06.130043 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 375/742] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:06.133888 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40650cf3-67e5-44dd-a8eb-25868ef7deea None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:06.222311 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48948a79-afa6-449a-b2ae-a44334efe5ca None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:06.255033 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40650cf3-67e5-44dd-a8eb-25868ef7deea None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:06.265269 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072c0d3-ecfe-4fc1-9aa9-33c9c15e0b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:06.266136 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072c0d3-ecfe-4fc1-9aa9-33c9c15e0b1d None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:06.266444 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072c0d3-ecfe-4fc1-9aa9-33c9c15e0b1d None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:06.267340 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072c0d3-ecfe-4fc1-9aa9-33c9c15e0b1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:06.282132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072c0d3-ecfe-4fc1-9aa9-33c9c15e0b1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:06.284515 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072c0d3-ecfe-4fc1-9aa9-33c9c15e0b1d None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:06.293580 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279ed40-26f7-4979-ba7b-a5d87f2a36e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:06.294488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279ed40-26f7-4979-ba7b-a5d87f2a36e7 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:06.294836 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279ed40-26f7-4979-ba7b-a5d87f2a36e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:06.295178 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279ed40-26f7-4979-ba7b-a5d87f2a36e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:06.302369 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279ed40-26f7-4979-ba7b-a5d87f2a36e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:06.303897 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279ed40-26f7-4979-ba7b-a5d87f2a36e7 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:06.309562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-e072c0d3-ecfe-4fc1-9aa9-33c9c15e0b1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:06.309562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:06.309562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:06.309562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:06.309562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:06.309562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:06.309562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:06.309562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:06.309562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:06.309562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:06.309562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:06.309562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:06.309562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:21:06.309562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:21:06.309562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:21:06.310612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:21:06.310612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:06.310612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:06.310612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:06.310612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:06.310612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:06.310612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:06.310612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:06.310612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:06.310612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:06.310612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:06.310612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:06.310612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:06.310612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:06.310612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:06.310612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:06.310612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:06.311534 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:21:06.311534 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:21:06.311534 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:06.311534 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:06.313739 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 368/743] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:06.315263 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154fa19-67ac-42b4-b0a2-c84fb1ae4623 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:06.315697 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154fa19-67ac-42b4-b0a2-c84fb1ae4623 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:06.316127 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154fa19-67ac-42b4-b0a2-c84fb1ae4623 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:06.317784 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 369/744] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:06.321794 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-f279ed40-26f7-4979-ba7b-a5d87f2a36e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:06.321794 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:06.321794 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:06.321794 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:06.321794 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:06.321794 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:06.321794 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:06.321794 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:06.321794 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:06.321794 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:06.321794 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:06.321794 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:06.321794 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:21:06.321794 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:21:06.321794 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:21:06.322884 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:21:06.322884 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:06.322884 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:06.322884 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:06.322884 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:06.322884 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:06.322884 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:06.322884 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:06.322884 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:06.322884 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:06.322884 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:06.322884 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:06.322884 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:06.322884 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:06.322884 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:06.322884 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:06.322884 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:06.324067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:21:06.324067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:21:06.324067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:21:06.324067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:21:06.324067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:21:06.324067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:21:06.324067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:06.324067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:06.325427 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154fa19-67ac-42b4-b0a2-c84fb1ae4623 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:06.329808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 376/745] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:21:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:06.331251 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a848b7a-dabf-4d75-8048-0d178e746aad None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:06.331607 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a848b7a-dabf-4d75-8048-0d178e746aad None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:06.331950 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a848b7a-dabf-4d75-8048-0d178e746aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:06.349161 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-1a848b7a-dabf-4d75-8048-0d178e746aad None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:06.350481 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-1a848b7a-dabf-4d75-8048-0d178e746aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:06.418801 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 377/746] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:06 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 09:21:06.419559 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a848b7a-dabf-4d75-8048-0d178e746aad None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:06.453913 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154fa19-67ac-42b4-b0a2-c84fb1ae4623 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:06.488776 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3f317-6575-4ddd-85a7-9893f8d58c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:06.489434 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3f317-6575-4ddd-85a7-9893f8d58c4d None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:06.489717 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3f317-6575-4ddd-85a7-9893f8d58c4d None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:06.490016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3f317-6575-4ddd-85a7-9893f8d58c4d None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:06.490736 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3f317-6575-4ddd-85a7-9893f8d58c4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:06.491042 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3f317-6575-4ddd-85a7-9893f8d58c4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:06.492409 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3f317-6575-4ddd-85a7-9893f8d58c4d None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:06.508683 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 370/747] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:06.510048 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fde7b7-2bb6-4617-ab31-0bea7a9b84ac None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:06.510345 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fde7b7-2bb6-4617-ab31-0bea7a9b84ac None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:06.510649 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fde7b7-2bb6-4617-ab31-0bea7a9b84ac None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:06.512150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 371/748] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:06.512836 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fde7b7-2bb6-4617-ab31-0bea7a9b84ac None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:06.523313 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a848b7a-dabf-4d75-8048-0d178e746aad None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:06.558616 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57622887-7c2a-4dca-810d-a490a54a59c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:06.559274 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57622887-7c2a-4dca-810d-a490a54a59c5 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:06.559554 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57622887-7c2a-4dca-810d-a490a54a59c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:06.559822 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57622887-7c2a-4dca-810d-a490a54a59c5 None admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:06.560601 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57622887-7c2a-4dca-810d-a490a54a59c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:06.560905 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57622887-7c2a-4dca-810d-a490a54a59c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:06.562348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57622887-7c2a-4dca-810d-a490a54a59c5 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:06.578560 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 378/749] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:21:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:06.578560 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57622887-7c2a-4dca-810d-a490a54a59c5 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:06.619370 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fde7b7-2bb6-4617-ab31-0bea7a9b84ac None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:06.653282 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08861f0-1cab-4431-bd0f-093ae870ef43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:06.653974 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08861f0-1cab-4431-bd0f-093ae870ef43 None admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:06.654264 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08861f0-1cab-4431-bd0f-093ae870ef43 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:06.654540 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08861f0-1cab-4431-bd0f-093ae870ef43 None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:06.655262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08861f0-1cab-4431-bd0f-093ae870ef43 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:06.656624 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08861f0-1cab-4431-bd0f-093ae870ef43 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:06.675732 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57622887-7c2a-4dca-810d-a490a54a59c5 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:06.682255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 372/750] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 12 09:21:06 2022] POST /identity/v3/services => generated 240 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:21:06.683668 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd80682-45f9-4166-b4d4-c4bf7f149388 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:06.683961 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd80682-45f9-4166-b4d4-c4bf7f149388 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:06.684244 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd80682-45f9-4166-b4d4-c4bf7f149388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:06.701765 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-edd80682-45f9-4166-b4d4-c4bf7f149388 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:06.703023 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-edd80682-45f9-4166-b4d4-c4bf7f149388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:06.752618 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f8c77-3471-4d4d-9496-47720983c7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:06.754531 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f8c77-3471-4d4d-9496-47720983c7a0 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:06.755097 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f8c77-3471-4d4d-9496-47720983c7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:06.755836 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f8c77-3471-4d4d-9496-47720983c7a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:06.766487 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f8c77-3471-4d4d-9496-47720983c7a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:06.768923 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f8c77-3471-4d4d-9496-47720983c7a0 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:06.783324 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 373/751] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:21:06.784266 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd80682-45f9-4166-b4d4-c4bf7f149388 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:06.790267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-162f8c77-3471-4d4d-9496-47720983c7a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:06.790267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:06.790267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:06.790267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:06.790267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:06.790267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:06.790267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:06.790267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:06.790267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:06.790267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:06.790267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:06.790267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:06.790267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:21:06.790267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:21:06.790267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:21:06.791227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:21:06.791227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:06.791227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:06.791227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:06.791227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:06.791227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:06.791227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:06.791227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:06.791227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:06.791227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:06.791227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:06.791227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:06.791227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:06.791227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:06.791227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:06.791227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:06.791227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:06.792770 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:21:06.792770 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:21:06.792770 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:21:06.792770 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:21:06.792770 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:21:06.792770 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:21:06.792770 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:06.792770 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:06.795466 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 379/752] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:21:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:06.811053 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f8c77-3471-4d4d-9496-47720983c7a0 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:06.934936 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f8c77-3471-4d4d-9496-47720983c7a0 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:06.971330 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f51563-5b90-4992-b8bc-d905a66a1598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:06.971996 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f51563-5b90-4992-b8bc-d905a66a1598 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:06.972269 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f51563-5b90-4992-b8bc-d905a66a1598 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:06.972536 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f51563-5b90-4992-b8bc-d905a66a1598 None admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:06.973318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f51563-5b90-4992-b8bc-d905a66a1598 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:06.973619 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f51563-5b90-4992-b8bc-d905a66a1598 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:06.975069 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f51563-5b90-4992-b8bc-d905a66a1598 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:06.991567 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 380/753] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:21:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:06.991567 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f51563-5b90-4992-b8bc-d905a66a1598 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:07.035846 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd80682-45f9-4166-b4d4-c4bf7f149388 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:07.071181 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd0c2a-d6a2-4e4f-bce7-4b5cf520b488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:07.071830 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd0c2a-d6a2-4e4f-bce7-4b5cf520b488 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:07.072106 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd0c2a-d6a2-4e4f-bce7-4b5cf520b488 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:07.072376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd0c2a-d6a2-4e4f-bce7-4b5cf520b488 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:07.073717 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd0c2a-d6a2-4e4f-bce7-4b5cf520b488 None admin] RBAC: Adding query filter params (role.id=4798f242077c416e9292660af5469faf, scope.project.id=9cf4f2954dd44516b3e594ed440781cc, user.id=bd41f419750140268f4d4b77456065c2) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:07.074054 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd0c2a-d6a2-4e4f-bce7-4b5cf520b488 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:07.075490 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd0c2a-d6a2-4e4f-bce7-4b5cf520b488 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:07.086040 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 374/754] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:21:06 2022] GET /identity/v3/role_assignments?user.id=bd41f419750140268f4d4b77456065c2&scope.project.id=9cf4f2954dd44516b3e594ed440781cc&role.id=4798f242077c416e9292660af5469faf => generated 259 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:07.087004 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd0c2a-d6a2-4e4f-bce7-4b5cf520b488 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:07.115348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f51563-5b90-4992-b8bc-d905a66a1598 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:07.156415 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671a024-e8e3-4aca-8d90-87f28aee27b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:07.157626 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671a024-e8e3-4aca-8d90-87f28aee27b3 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:07.158157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671a024-e8e3-4aca-8d90-87f28aee27b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:07.158653 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671a024-e8e3-4aca-8d90-87f28aee27b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:07.172469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671a024-e8e3-4aca-8d90-87f28aee27b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:21:07.182100 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-4671a024-e8e3-4aca-8d90-87f28aee27b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:21:07.182100 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:07.182100 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:07.182100 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:07.182100 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:07.182100 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:07.182100 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:07.182100 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:07.182100 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:07.182100 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:07.182100 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:07.182100 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:07.182100 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:21:07.182100 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:21:07.182100 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:21:07.182100 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:21:07.183215 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:21:07.183215 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:21:07.183215 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:21:07.183215 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:21:07.183215 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:07.183215 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:07.183215 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:07.183215 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:07.183215 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:07.183215 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:07.183215 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:07.183215 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:07.183215 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:07.183215 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:07.183215 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:07.183215 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:07.184695 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:07.184695 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:07.184695 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:07.184695 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:07.184695 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:21:07.184695 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:21:07.184695 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:21:07.184695 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:21:07.184695 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:21:07.184695 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:21:07.184695 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:21:07.184695 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:07.187823 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 381/755] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:21:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:07.193375 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671a024-e8e3-4aca-8d90-87f28aee27b3 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:07.297168 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd0c2a-d6a2-4e4f-bce7-4b5cf520b488 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:07.343709 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5e831-d4fd-4142-91c4-e09cfcd18963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:07.345354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5e831-d4fd-4142-91c4-e09cfcd18963 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:07.346495 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5e831-d4fd-4142-91c4-e09cfcd18963 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:07.347173 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5e831-d4fd-4142-91c4-e09cfcd18963 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:07.349200 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5e831-d4fd-4142-91c4-e09cfcd18963 None admin] RBAC: Adding query filter params (role.id=8f01c4c38fa44034a54c1f8cd2d2db1a, scope.project.id=9cf4f2954dd44516b3e594ed440781cc, user.id=f7693a31911346f9bb2c01efcd8e16e6) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:07.350390 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5e831-d4fd-4142-91c4-e09cfcd18963 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:07.352019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5e831-d4fd-4142-91c4-e09cfcd18963 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:07.363849 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 375/756] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:21:07 2022] GET /identity/v3/role_assignments?user.id=f7693a31911346f9bb2c01efcd8e16e6&scope.project.id=9cf4f2954dd44516b3e594ed440781cc&role.id=8f01c4c38fa44034a54c1f8cd2d2db1a => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:07.420953 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671a024-e8e3-4aca-8d90-87f28aee27b3 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:07.468492 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b7da1-38c1-4d1d-a8a5-27eeb98a989d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:07.469526 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b7da1-38c1-4d1d-a8a5-27eeb98a989d None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:07.470059 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b7da1-38c1-4d1d-a8a5-27eeb98a989d None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:07.470534 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b7da1-38c1-4d1d-a8a5-27eeb98a989d None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:07.471500 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b7da1-38c1-4d1d-a8a5-27eeb98a989d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:07.472019 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b7da1-38c1-4d1d-a8a5-27eeb98a989d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:07.473575 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b7da1-38c1-4d1d-a8a5-27eeb98a989d None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:07.482784 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 382/757] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:21:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:07.489960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5e831-d4fd-4142-91c4-e09cfcd18963 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:07.643300 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5e831-d4fd-4142-91c4-e09cfcd18963 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:07.678696 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421c51b-229e-4da7-86c2-2a9e79734a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:07.679498 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421c51b-229e-4da7-86c2-2a9e79734a5b None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:07.679796 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421c51b-229e-4da7-86c2-2a9e79734a5b None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:07.680057 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421c51b-229e-4da7-86c2-2a9e79734a5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:07.692142 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421c51b-229e-4da7-86c2-2a9e79734a5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:07.693597 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421c51b-229e-4da7-86c2-2a9e79734a5b None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:07.710690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-f421c51b-229e-4da7-86c2-2a9e79734a5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:07.710690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:07.710690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:07.710690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:07.710690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:07.710690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:07.710690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:07.710690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:07.710690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:07.710690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:07.710690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:07.710690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:07.710690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:21:07.710690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:21:07.710690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:21:07.711648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:21:07.711648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:07.711648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:07.711648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:07.711648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:07.711648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:07.711648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:07.711648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:07.711648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:07.711648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:07.711648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:07.711648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:07.711648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:07.711648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:07.711648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:07.711648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:07.711648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:07.712794 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:21:07.712794 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:21:07.712794 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:07.712794 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:07.712794 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 376/758] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:07.719564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b7da1-38c1-4d1d-a8a5-27eeb98a989d None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:07.868274 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b7da1-38c1-4d1d-a8a5-27eeb98a989d None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:07.914480 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8284b08-0a46-4450-ad75-5a40a83fe2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:07.915152 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8284b08-0a46-4450-ad75-5a40a83fe2a1 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:07.915434 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8284b08-0a46-4450-ad75-5a40a83fe2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:07.915704 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8284b08-0a46-4450-ad75-5a40a83fe2a1 None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:07.916421 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8284b08-0a46-4450-ad75-5a40a83fe2a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:07.916725 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8284b08-0a46-4450-ad75-5a40a83fe2a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:07.918642 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8284b08-0a46-4450-ad75-5a40a83fe2a1 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:07.938172 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 383/759] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:07.944887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421c51b-229e-4da7-86c2-2a9e79734a5b None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:08.135420 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421c51b-229e-4da7-86c2-2a9e79734a5b None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:08.180987 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b915a8-634d-4507-8c30-767650a1c465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:08.181787 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b915a8-634d-4507-8c30-767650a1c465 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:08.182095 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b915a8-634d-4507-8c30-767650a1c465 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:08.182372 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b915a8-634d-4507-8c30-767650a1c465 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:08.190920 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b915a8-634d-4507-8c30-767650a1c465 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:08.192360 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b915a8-634d-4507-8c30-767650a1c465 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:08.212414 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-d5b915a8-634d-4507-8c30-767650a1c465 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 09:21:08.212414 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:08.212414 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:08.212414 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:08.212414 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:08.212414 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:08.212414 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:08.212414 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:08.212414 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:08.212414 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:08.212414 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:08.212414 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:08.212414 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:21:08.212414 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:21:08.212414 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:21:08.212414 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:21:08.213395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:08.213395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:08.213395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:21:08.213395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:08.213395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:21:08.213395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:08.213395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:08.213395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:08.213395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:08.213395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:08.213395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:08.213395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:08.213395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:08.213395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:08.213395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:08.213395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:08.213395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:08.213395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:08.214869 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:08.214869 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:08.214869 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:21:08.214869 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:21:08.214869 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:21:08.214869 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:21:08.214869 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:21:08.214869 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:21:08.214869 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 09:21:08.214869 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:08.218001 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 377/760] 10.222.0.60 () {56 vars in 1093 bytes} [Thu May 12 09:21:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:08.221991 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8284b08-0a46-4450-ad75-5a40a83fe2a1 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:08.349604 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8284b08-0a46-4450-ad75-5a40a83fe2a1 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:08.387127 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785a9c6-213a-46ab-8716-3de32bfc2c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:08.387822 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785a9c6-213a-46ab-8716-3de32bfc2c27 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:08.388102 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785a9c6-213a-46ab-8716-3de32bfc2c27 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:08.388374 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785a9c6-213a-46ab-8716-3de32bfc2c27 None admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:08.389220 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785a9c6-213a-46ab-8716-3de32bfc2c27 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:08.389526 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785a9c6-213a-46ab-8716-3de32bfc2c27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:08.390997 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785a9c6-213a-46ab-8716-3de32bfc2c27 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:08.416785 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 384/761] 10.222.0.60 () {56 vars in 1133 bytes} [Thu May 12 09:21:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:08.422419 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b915a8-634d-4507-8c30-767650a1c465 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:08.499881 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684546b7-f813-4bb8-a7cf-038095328dcd None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:08.500209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684546b7-f813-4bb8-a7cf-038095328dcd None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:08.500588 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684546b7-f813-4bb8-a7cf-038095328dcd None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:08.502797 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 385/762] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:21:08.515112 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57cebd-efd4-4aa6-808a-d39ec7c6fb4a None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:08.515713 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57cebd-efd4-4aa6-808a-d39ec7c6fb4a None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:08.515993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57cebd-efd4-4aa6-808a-d39ec7c6fb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:08.551303 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-8d57cebd-efd4-4aa6-808a-d39ec7c6fb4a None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:08.553472 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-8d57cebd-efd4-4aa6-808a-d39ec7c6fb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:08.556318 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b915a8-634d-4507-8c30-767650a1c465 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:08.616839 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003769cc-ed08-4af7-8dd8-4aaf5393c63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:08.618021 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003769cc-ed08-4af7-8dd8-4aaf5393c63e None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:08.618546 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003769cc-ed08-4af7-8dd8-4aaf5393c63e None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:08.619021 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003769cc-ed08-4af7-8dd8-4aaf5393c63e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:08.637886 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003769cc-ed08-4af7-8dd8-4aaf5393c63e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:08.641004 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003769cc-ed08-4af7-8dd8-4aaf5393c63e None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:08.667483 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-003769cc-ed08-4af7-8dd8-4aaf5393c63e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:08.667483 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:08.667483 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:08.667483 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:08.667483 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:08.667483 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:08.667483 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:08.667483 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:08.667483 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:08.667483 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:08.667483 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:08.667483 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:08.667483 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:21:08.667483 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:21:08.667483 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:21:08.668453 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:21:08.668453 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:08.668453 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:08.668453 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:08.668453 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:08.668453 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:08.668453 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:08.668453 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:08.668453 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:08.668453 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:08.668453 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:08.668453 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:08.668453 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:08.668453 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:08.668453 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:08.668453 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:08.668453 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:08.669365 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:21:08.669365 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:21:08.669365 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:08.669365 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:08.679860 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 386/763] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 09:21:08.680842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 378/764] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:08.686742 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57cebd-efd4-4aa6-808a-d39ec7c6fb4a None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:08.702428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003769cc-ed08-4af7-8dd8-4aaf5393c63e None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:08.829341 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003769cc-ed08-4af7-8dd8-4aaf5393c63e None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:08.866209 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62a968-c430-4878-b02c-11e08ada4dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:08.867071 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62a968-c430-4878-b02c-11e08ada4dbb None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:08.867292 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62a968-c430-4878-b02c-11e08ada4dbb None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:08.867565 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62a968-c430-4878-b02c-11e08ada4dbb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:08.869961 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62a968-c430-4878-b02c-11e08ada4dbb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:08.870193 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62a968-c430-4878-b02c-11e08ada4dbb None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:08.883997 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-9a62a968-c430-4878-b02c-11e08ada4dbb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 09:21:08.883997 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:08.883997 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 09:21:08.883997 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 09:21:08.883997 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 09:21:08.883997 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 09:21:08.883997 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 09:21:08.883997 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:08.883997 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 09:21:08.883997 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:08.883997 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 09:21:08.883997 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:08.883997 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:08.883997 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:08.883997 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:08.883997 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:08.885228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:08.885228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:08.885228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:08.885228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:08.885228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:08.885228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:08.885228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:08.885228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 09:21:08.885228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 09:21:08.885228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 09:21:08.885228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 09:21:08.885228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:08.885228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:08.885228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:08.885228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:08.885228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:08.886806 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:08.886806 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:08.886806 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:08.886806 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:08.886806 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:08.886806 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:08.886806 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:08.886806 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:08.886806 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:08.886806 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:08.886806 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:08.886806 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 09:21:08.886806 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:08.886806 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 09:21:08.886806 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:08.889503 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 379/765] 10.222.0.60 () {56 vars in 1129 bytes} [Thu May 12 09:21:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:08.895288 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62a968-c430-4878-b02c-11e08ada4dbb None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:08.920144 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57cebd-efd4-4aa6-808a-d39ec7c6fb4a None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:09.008510 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62a968-c430-4878-b02c-11e08ada4dbb None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:09.022629 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a4f17-4a08-4f5b-8f09-c754b18885dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:09.023322 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a4f17-4a08-4f5b-8f09-c754b18885dd None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:09.023610 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a4f17-4a08-4f5b-8f09-c754b18885dd None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:09.023892 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a4f17-4a08-4f5b-8f09-c754b18885dd None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:09.024627 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a4f17-4a08-4f5b-8f09-c754b18885dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:09.024937 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a4f17-4a08-4f5b-8f09-c754b18885dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:09.026879 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a4f17-4a08-4f5b-8f09-c754b18885dd None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:09.038524 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 387/766] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:21:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:09.043844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a4f17-4a08-4f5b-8f09-c754b18885dd None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:09.048786 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278ff1a-1c2f-4a1b-9559-7faf4238d454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:09.049791 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278ff1a-1c2f-4a1b-9559-7faf4238d454 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:09.050318 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278ff1a-1c2f-4a1b-9559-7faf4238d454 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:09.050844 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278ff1a-1c2f-4a1b-9559-7faf4238d454 None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:09.051816 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278ff1a-1c2f-4a1b-9559-7faf4238d454 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:09.052330 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278ff1a-1c2f-4a1b-9559-7faf4238d454 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:09.054696 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278ff1a-1c2f-4a1b-9559-7faf4238d454 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:09.061918 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 380/767] 10.222.0.60 () {56 vars in 1124 bytes} [Thu May 12 09:21:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:09.067600 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278ff1a-1c2f-4a1b-9559-7faf4238d454 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:09.192845 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278ff1a-1c2f-4a1b-9559-7faf4238d454 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:09.241933 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daee4ef-bdab-4778-9eee-1f627a081a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:09.243026 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daee4ef-bdab-4778-9eee-1f627a081a98 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:09.243515 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daee4ef-bdab-4778-9eee-1f627a081a98 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:09.243990 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daee4ef-bdab-4778-9eee-1f627a081a98 None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:09.245444 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daee4ef-bdab-4778-9eee-1f627a081a98 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:09.246002 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daee4ef-bdab-4778-9eee-1f627a081a98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:09.247566 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daee4ef-bdab-4778-9eee-1f627a081a98 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:09.250924 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a4f17-4a08-4f5b-8f09-c754b18885dd None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:09.261245 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 381/768] 10.222.0.60 () {56 vars in 1124 bytes} [Thu May 12 09:21:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:09.267407 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daee4ef-bdab-4778-9eee-1f627a081a98 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:09.296680 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c257e-ac74-4053-a2fc-336617f2c0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:09.299186 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c257e-ac74-4053-a2fc-336617f2c0ec None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:09.300178 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c257e-ac74-4053-a2fc-336617f2c0ec None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:09.300463 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c257e-ac74-4053-a2fc-336617f2c0ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:09.315622 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c257e-ac74-4053-a2fc-336617f2c0ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:09.317137 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c257e-ac74-4053-a2fc-336617f2c0ec None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:09.342259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-139c257e-ac74-4053-a2fc-336617f2c0ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:09.342259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:09.342259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:09.342259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:09.342259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:09.342259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:09.342259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:09.342259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:09.342259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:09.342259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:09.342259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:09.342259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:09.342259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:21:09.342259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:21:09.342259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:21:09.343181 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:21:09.343181 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:09.343181 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:09.343181 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:09.343181 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:09.343181 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:09.343181 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:09.343181 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:09.343181 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:09.343181 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:09.343181 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:09.343181 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:09.343181 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:09.343181 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:09.343181 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:09.343181 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:09.343181 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:09.344087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:21:09.344087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:21:09.344087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:21:09.344087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:21:09.344087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:21:09.344087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:21:09.344087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:09.344087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:09.347901 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 388/769] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:21:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:09.350450 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c257e-ac74-4053-a2fc-336617f2c0ec None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:09.434271 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daee4ef-bdab-4778-9eee-1f627a081a98 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:09.470212 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdb6f6-2c6f-4cc6-8bdd-7245a9e94b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:09.471278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdb6f6-2c6f-4cc6-8bdd-7245a9e94b4c None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:09.471769 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdb6f6-2c6f-4cc6-8bdd-7245a9e94b4c None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:09.472249 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdb6f6-2c6f-4cc6-8bdd-7245a9e94b4c None admin] PATH_INFO: `/v3/endpoints` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:09.473268 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdb6f6-2c6f-4cc6-8bdd-7245a9e94b4c None admin] RBAC: Adding query filter params (interface=public, service_id=fc8601f4f3444aafba4683a9404f7369, region_id=RegionOne) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:09.473823 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdb6f6-2c6f-4cc6-8bdd-7245a9e94b4c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:09.475483 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdb6f6-2c6f-4cc6-8bdd-7245a9e94b4c None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:09.481652 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c257e-ac74-4053-a2fc-336617f2c0ec None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:09.485169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 382/770] 10.222.0.60 () {56 vars in 1251 bytes} [Thu May 12 09:21:09 2022] GET /identity/v3/endpoints?service_id=fc8601f4f3444aafba4683a9404f7369&interface=public®ion_id=RegionOne => generated 194 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:09.486876 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6ce01-036f-448a-95ed-c2a911a233a8 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:09.487418 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6ce01-036f-448a-95ed-c2a911a233a8 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:09.487909 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6ce01-036f-448a-95ed-c2a911a233a8 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:09.493751 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 383/771] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:09.495009 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6ce01-036f-448a-95ed-c2a911a233a8 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:09.523220 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541f73d-e84d-4e2a-96dd-93dcd740eaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:09.523889 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541f73d-e84d-4e2a-96dd-93dcd740eaf9 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:09.524170 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541f73d-e84d-4e2a-96dd-93dcd740eaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:09.524495 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541f73d-e84d-4e2a-96dd-93dcd740eaf9 None admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:09.525275 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541f73d-e84d-4e2a-96dd-93dcd740eaf9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:09.525632 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541f73d-e84d-4e2a-96dd-93dcd740eaf9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:09.527248 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541f73d-e84d-4e2a-96dd-93dcd740eaf9 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:09.540275 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 389/772] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:21:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:09.541539 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5284bb4-17c4-4151-a133-1c2d71f106e4 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:09.542353 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5284bb4-17c4-4151-a133-1c2d71f106e4 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:09.542650 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5284bb4-17c4-4151-a133-1c2d71f106e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:09.559362 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-a5284bb4-17c4-4151-a133-1c2d71f106e4 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:09.560593 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-a5284bb4-17c4-4151-a133-1c2d71f106e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:09.605343 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6ce01-036f-448a-95ed-c2a911a233a8 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:09.635326 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 390/773] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:21:09.635326 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5284bb4-17c4-4151-a133-1c2d71f106e4 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:09.659385 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28438f-0fbc-44cf-87de-185993bf7da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:09.660445 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28438f-0fbc-44cf-87de-185993bf7da3 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:09.660930 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28438f-0fbc-44cf-87de-185993bf7da3 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:09.661405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28438f-0fbc-44cf-87de-185993bf7da3 None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:09.662339 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28438f-0fbc-44cf-87de-185993bf7da3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:09.663952 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28438f-0fbc-44cf-87de-185993bf7da3 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:09.670130 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 384/774] 10.222.0.60 () {56 vars in 1087 bytes} [Thu May 12 09:21:09 2022] GET /identity/v3/services => generated 772 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:09.671616 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cbfe5-90ad-49df-8b0d-d89bcffad981 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:09.672126 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cbfe5-90ad-49df-8b0d-d89bcffad981 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:09.672460 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cbfe5-90ad-49df-8b0d-d89bcffad981 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:09.674087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 385/775] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:09.674881 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564cbfe5-90ad-49df-8b0d-d89bcffad981 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:09.756812 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5284bb4-17c4-4151-a133-1c2d71f106e4 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:09.791820 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564cbfe5-90ad-49df-8b0d-d89bcffad981 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:09.805648 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883eaac0-ffe7-4a4e-a285-990cc5c6a52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:09.806610 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883eaac0-ffe7-4a4e-a285-990cc5c6a52e None admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:09.807082 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883eaac0-ffe7-4a4e-a285-990cc5c6a52e None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:09.807365 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883eaac0-ffe7-4a4e-a285-990cc5c6a52e None admin] PATH_INFO: `/v3/projects/9cf4f2954dd44516b3e594ed440781cc/users/2915babd40aa42e8bf7cc85c5a97daa6/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:09.810806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883eaac0-ffe7-4a4e-a285-990cc5c6a52e None admin] RBAC: Authorizing `identity:create_grant(project_id=9cf4f2954dd44516b3e594ed440781cc, user_id=2915babd40aa42e8bf7cc85c5a97daa6, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:09.812432 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883eaac0-ffe7-4a4e-a285-990cc5c6a52e None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:09.829796 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 391/776] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 12 09:21:09 2022] PUT /identity/v3/projects/9cf4f2954dd44516b3e594ed440781cc/users/2915babd40aa42e8bf7cc85c5a97daa6/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:21:09.831225 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de7219-70bc-4bde-9b86-11195a75ee8c None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:09.831569 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de7219-70bc-4bde-9b86-11195a75ee8c None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:09.831798 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de7219-70bc-4bde-9b86-11195a75ee8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:09.833971 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efe507-ff84-4a59-be24-9ac7a9fe408e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:09.835105 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efe507-ff84-4a59-be24-9ac7a9fe408e None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:09.835672 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efe507-ff84-4a59-be24-9ac7a9fe408e None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:09.836096 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efe507-ff84-4a59-be24-9ac7a9fe408e None admin] PATH_INFO: `/v3/services/network` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:09.837036 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00efe507-ff84-4a59-be24-9ac7a9fe408e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:09.839502 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00efe507-ff84-4a59-be24-9ac7a9fe408e None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:09.851616 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-c0de7219-70bc-4bde-9b86-11195a75ee8c None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:09.852811 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-c0de7219-70bc-4bde-9b86-11195a75ee8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:09.853877 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-00efe507-ff84-4a59-be24-9ac7a9fe408e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 09:21:09.853877 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:09.853877 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 09:21:09.853877 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 09:21:09.853877 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 09:21:09.853877 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 09:21:09.853877 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 09:21:09.853877 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:09.853877 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 09:21:09.853877 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:09.853877 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 09:21:09.853877 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:09.853877 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:09.853877 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:09.853877 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:09.853877 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:09.853877 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:09.855495 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:09.855495 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:09.855495 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:09.855495 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:09.855495 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:09.855495 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:09.855495 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 09:21:09.855495 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 09:21:09.855495 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 09:21:09.855495 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 09:21:09.855495 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:09.855495 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:09.855495 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:09.855495 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:09.855495 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:09.855495 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:09.856348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:09.856348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:09.856348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:09.856348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:09.856348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:09.856348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:09.856348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:09.856348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:09.856348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:09.856348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:09.856348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 09:21:09.856348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:09.856348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 09:21:09.856348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:09.859591 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 386/777] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:21:09 2022] GET /identity/v3/services/network => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:09.867060 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efe507-ff84-4a59-be24-9ac7a9fe408e None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:09.945109 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 392/778] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:21:09.974050 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de7219-70bc-4bde-9b86-11195a75ee8c None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:10.014873 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efe507-ff84-4a59-be24-9ac7a9fe408e None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:10.073786 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ec60a-049f-4985-81a6-f343b5e82091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:10.074558 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ec60a-049f-4985-81a6-f343b5e82091 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:10.074833 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ec60a-049f-4985-81a6-f343b5e82091 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:10.075117 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ec60a-049f-4985-81a6-f343b5e82091 None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:10.075979 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ec60a-049f-4985-81a6-f343b5e82091 None admin] RBAC: Adding query filter params (name=network) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:10.076115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ec60a-049f-4985-81a6-f343b5e82091 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:10.077446 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ec60a-049f-4985-81a6-f343b5e82091 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:10.085567 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 387/779] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 12 09:21:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:10.095166 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ec60a-049f-4985-81a6-f343b5e82091 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:10.125669 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de7219-70bc-4bde-9b86-11195a75ee8c None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:10.185091 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5789df-4486-4fa3-95c7-b2b8981bc127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:10.185921 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5789df-4486-4fa3-95c7-b2b8981bc127 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:10.186201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5789df-4486-4fa3-95c7-b2b8981bc127 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:10.186473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5789df-4486-4fa3-95c7-b2b8981bc127 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:10.210749 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5789df-4486-4fa3-95c7-b2b8981bc127 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:21:10.220511 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-af5789df-4486-4fa3-95c7-b2b8981bc127 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 09:21:10.220511 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:10.220511 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:10.220511 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:10.220511 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:10.220511 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:10.220511 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:10.220511 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:10.220511 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:10.220511 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:10.220511 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:10.220511 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:10.220511 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:21:10.220511 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:21:10.220511 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:21:10.220511 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:21:10.222684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:21:10.222684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:21:10.222684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:21:10.222684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:21:10.222684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:10.222684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:10.222684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:10.222684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:10.222684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:10.222684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:10.222684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:10.222684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:10.222684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:10.222684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:10.222684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:10.222684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:10.223938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:10.223938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:10.223938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:10.223938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:10.223938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:21:10.223938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:21:10.223938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:21:10.223938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:21:10.223938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:21:10.223938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:21:10.223938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 09:21:10.223938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:10.223938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 393/780] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 12 09:21:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:10.223938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a28e08-e4e6-49a4-91cb-b2d176c4154e None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:10.224712 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a28e08-e4e6-49a4-91cb-b2d176c4154e None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:10.224712 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a28e08-e4e6-49a4-91cb-b2d176c4154e None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:10.228497 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 394/781] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:10.232487 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a28e08-e4e6-49a4-91cb-b2d176c4154e None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:10.269762 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ec60a-049f-4985-81a6-f343b5e82091 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:10.304846 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4fca3-4e61-47d3-8e6d-f2d2c78498fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:10.305866 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4fca3-4e61-47d3-8e6d-f2d2c78498fe None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:10.306423 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4fca3-4e61-47d3-8e6d-f2d2c78498fe None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:10.306924 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4fca3-4e61-47d3-8e6d-f2d2c78498fe None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:10.307911 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4fca3-4e61-47d3-8e6d-f2d2c78498fe None admin] RBAC: Adding query filter params (type=network) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:10.308429 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4fca3-4e61-47d3-8e6d-f2d2c78498fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:10.310072 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4fca3-4e61-47d3-8e6d-f2d2c78498fe None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:10.315690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 388/782] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 12 09:21:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:10.317284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45c319-fc4d-4141-b121-54536dd060a4 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:10.317796 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45c319-fc4d-4141-b121-54536dd060a4 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:10.318314 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45c319-fc4d-4141-b121-54536dd060a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:10.336367 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-dd45c319-fc4d-4141-b121-54536dd060a4 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:10.337592 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-dd45c319-fc4d-4141-b121-54536dd060a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:10.346393 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a28e08-e4e6-49a4-91cb-b2d176c4154e None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:10.388321 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6d14b-3349-4a0c-a412-193c16493327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:10.389047 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6d14b-3349-4a0c-a412-193c16493327 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:10.389325 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6d14b-3349-4a0c-a412-193c16493327 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:10.389640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6d14b-3349-4a0c-a412-193c16493327 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:10.390417 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6d14b-3349-4a0c-a412-193c16493327 None admin] RBAC: Adding query filter params (name=service) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:10.390772 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6d14b-3349-4a0c-a412-193c16493327 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:10.392131 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6d14b-3349-4a0c-a412-193c16493327 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:10.400757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 395/783] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 12 09:21:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:10.402185 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6d14b-3349-4a0c-a412-193c16493327 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:10.416054 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 389/784] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:21:10.418799 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45c319-fc4d-4141-b121-54536dd060a4 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:10.521937 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6d14b-3349-4a0c-a412-193c16493327 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:10.553929 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45c319-fc4d-4141-b121-54536dd060a4 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:10.556289 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae0861-f113-4426-9fbc-d559d887dbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:10.556978 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae0861-f113-4426-9fbc-d559d887dbc2 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:10.557247 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae0861-f113-4426-9fbc-d559d887dbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:10.557578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae0861-f113-4426-9fbc-d559d887dbc2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:10.558505 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae0861-f113-4426-9fbc-d559d887dbc2 None admin] RBAC: Adding query filter params (interface=public, service_id=ab958db6f3f6477fa1ca99e981643195, region_id=RegionOne) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:10.558785 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae0861-f113-4426-9fbc-d559d887dbc2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:10.560168 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae0861-f113-4426-9fbc-d559d887dbc2 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:10.567989 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 396/785] 10.222.0.60 () {56 vars in 1251 bytes} [Thu May 12 09:21:10 2022] GET /identity/v3/endpoints?service_id=ab958db6f3f6477fa1ca99e981643195&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:10.568886 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae0861-f113-4426-9fbc-d559d887dbc2 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:10.594725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459d0fd-4ee1-4a84-a024-feb933cae074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:10.595415 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459d0fd-4ee1-4a84-a024-feb933cae074 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:10.595697 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459d0fd-4ee1-4a84-a024-feb933cae074 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:10.595974 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459d0fd-4ee1-4a84-a024-feb933cae074 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:10.607378 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459d0fd-4ee1-4a84-a024-feb933cae074 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:10.609118 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459d0fd-4ee1-4a84-a024-feb933cae074 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:10.628374 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-f459d0fd-4ee1-4a84-a024-feb933cae074 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:10.628374 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:10.628374 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:10.628374 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:10.628374 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:10.628374 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:10.628374 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:10.628374 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:10.628374 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:10.628374 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:10.628374 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:10.628374 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:10.628374 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:21:10.628374 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:21:10.628374 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:21:10.629361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:21:10.629361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:10.629361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:10.629361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:10.629361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:10.629361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:10.629361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:10.629361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:10.629361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:10.629361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:10.629361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:10.629361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:10.629361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:10.629361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:10.629361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:10.629361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:10.629361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:10.630547 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:21:10.630547 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:21:10.630547 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:10.630547 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:10.631201 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 390/786] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:10.631883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459d0fd-4ee1-4a84-a024-feb933cae074 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:10.691467 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae0861-f113-4426-9fbc-d559d887dbc2 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:10.732133 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459d0fd-4ee1-4a84-a024-feb933cae074 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:10.736856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985642a9-fb81-4356-982b-b308f9ee91c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:10.737929 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985642a9-fb81-4356-982b-b308f9ee91c6 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:10.738407 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985642a9-fb81-4356-982b-b308f9ee91c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:10.738868 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985642a9-fb81-4356-982b-b308f9ee91c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:10.751744 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985642a9-fb81-4356-982b-b308f9ee91c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:21:10.762226 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-985642a9-fb81-4356-982b-b308f9ee91c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:21:10.762226 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:10.762226 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:10.762226 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:10.762226 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:10.762226 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:10.762226 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:10.762226 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:10.762226 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:10.762226 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:10.762226 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:10.762226 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:10.762226 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:21:10.762226 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:21:10.762226 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:21:10.762226 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:21:10.763162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:21:10.763162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:21:10.763162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:21:10.763162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:21:10.763162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:10.763162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:10.763162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:10.763162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:10.763162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:10.763162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:10.763162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:10.763162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:10.763162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:10.763162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:10.763162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:10.763162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:10.764012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:10.764012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:10.764012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:10.764012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:10.764012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:21:10.764012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:21:10.764012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:21:10.764012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:21:10.764012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:21:10.764012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:21:10.764012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:21:10.764012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:10.766922 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 397/787] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:21:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:10.767829 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985642a9-fb81-4356-982b-b308f9ee91c6 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:10.775025 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ddc94-0b5d-42d6-b66e-c4f95be236ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:10.775755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ddc94-0b5d-42d6-b66e-c4f95be236ee None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:10.776713 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ddc94-0b5d-42d6-b66e-c4f95be236ee None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:10.777121 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ddc94-0b5d-42d6-b66e-c4f95be236ee None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:10.777924 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ddc94-0b5d-42d6-b66e-c4f95be236ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:10.779464 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ddc94-0b5d-42d6-b66e-c4f95be236ee None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:10.784995 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 391/788] 10.222.0.60 () {56 vars in 1087 bytes} [Thu May 12 09:21:10 2022] GET /identity/v3/services => generated 772 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:10.786196 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ddc94-0b5d-42d6-b66e-c4f95be236ee None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:10.894632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ddc94-0b5d-42d6-b66e-c4f95be236ee None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:10.895547 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985642a9-fb81-4356-982b-b308f9ee91c6 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:10.930861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134625f-1748-449e-a74b-26f54329317e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:10.931697 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134625f-1748-449e-a74b-26f54329317e None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:10.932085 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134625f-1748-449e-a74b-26f54329317e None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:10.932519 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134625f-1748-449e-a74b-26f54329317e None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:10.933838 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134625f-1748-449e-a74b-26f54329317e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:10.934269 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134625f-1748-449e-a74b-26f54329317e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:10.935782 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134625f-1748-449e-a74b-26f54329317e None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:10.952854 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2025427-3912-4822-984f-63b633d2e3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:10.953547 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2025427-3912-4822-984f-63b633d2e3e2 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:10.953830 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2025427-3912-4822-984f-63b633d2e3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:10.954145 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2025427-3912-4822-984f-63b633d2e3e2 None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:10.954928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2025427-3912-4822-984f-63b633d2e3e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:10.955236 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2025427-3912-4822-984f-63b633d2e3e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:10.956663 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2025427-3912-4822-984f-63b633d2e3e2 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:10.964926 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 398/789] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:10.968550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134625f-1748-449e-a74b-26f54329317e None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:10.982295 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 392/790] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:21:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:10.989849 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2025427-3912-4822-984f-63b633d2e3e2 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:11.134689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134625f-1748-449e-a74b-26f54329317e None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:11.149601 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2025427-3912-4822-984f-63b633d2e3e2 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:11.178279 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71612d-ede2-4f48-b2bf-46ed7aed9750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:11.179693 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71612d-ede2-4f48-b2bf-46ed7aed9750 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:11.179980 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71612d-ede2-4f48-b2bf-46ed7aed9750 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:11.180255 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71612d-ede2-4f48-b2bf-46ed7aed9750 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:11.187571 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18ce6a-50c8-4a80-903e-d4a4eabeb6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:11.188836 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18ce6a-50c8-4a80-903e-d4a4eabeb6bf None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:11.189317 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18ce6a-50c8-4a80-903e-d4a4eabeb6bf None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:11.189556 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71612d-ede2-4f48-b2bf-46ed7aed9750 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:11.190024 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18ce6a-50c8-4a80-903e-d4a4eabeb6bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:11.191086 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71612d-ede2-4f48-b2bf-46ed7aed9750 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:11.202755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18ce6a-50c8-4a80-903e-d4a4eabeb6bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:11.204546 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18ce6a-50c8-4a80-903e-d4a4eabeb6bf None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:11.210086 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-6c71612d-ede2-4f48-b2bf-46ed7aed9750 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 09:21:11.210086 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:11.210086 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:11.210086 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:11.210086 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:11.210086 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:11.210086 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:11.210086 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:11.210086 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:11.210086 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:11.210086 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:11.210086 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:11.210086 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:21:11.210086 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:21:11.210086 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:21:11.210086 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:21:11.211032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:11.211032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:11.211032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:21:11.211032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:11.211032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:21:11.211032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:11.211032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:11.211032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:11.211032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:11.211032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:11.211032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:11.211032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:11.211032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:11.211032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:11.211032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:11.211032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:11.211032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:11.211032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:11.211973 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:11.211973 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:11.211973 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:21:11.211973 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:21:11.211973 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:21:11.211973 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:21:11.211973 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:21:11.211973 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:21:11.211973 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 09:21:11.211973 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:11.216420 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 399/791] 10.222.0.60 () {56 vars in 1117 bytes} [Thu May 12 09:21:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:11.217592 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71612d-ede2-4f48-b2bf-46ed7aed9750 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:11.227533 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-6d18ce6a-50c8-4a80-903e-d4a4eabeb6bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:11.227533 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:11.227533 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:11.227533 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:11.227533 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:11.227533 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:11.227533 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:11.227533 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:11.227533 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:11.227533 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:11.227533 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:11.227533 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:11.227533 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:21:11.227533 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:21:11.227533 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:21:11.228428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:21:11.228428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:11.228428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:11.228428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:11.228428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:11.228428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:11.228428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:11.228428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:11.228428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:11.228428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:11.228428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:11.228428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:11.228428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:11.228428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:11.228428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:11.228428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:11.228428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:11.229383 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:21:11.229383 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:21:11.229383 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:11.229383 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:11.231592 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 393/792] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:11.237076 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18ce6a-50c8-4a80-903e-d4a4eabeb6bf None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:11.353641 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18ce6a-50c8-4a80-903e-d4a4eabeb6bf None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:11.372109 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71612d-ede2-4f48-b2bf-46ed7aed9750 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:11.395969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e8465-dc55-45c3-9b19-99e32a632792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:11.396642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e8465-dc55-45c3-9b19-99e32a632792 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:11.396926 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e8465-dc55-45c3-9b19-99e32a632792 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:11.397202 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e8465-dc55-45c3-9b19-99e32a632792 None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:11.397941 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e8465-dc55-45c3-9b19-99e32a632792 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:11.398254 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e8465-dc55-45c3-9b19-99e32a632792 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:11.399619 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e8465-dc55-45c3-9b19-99e32a632792 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:11.425913 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 394/793] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:11.431521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e8465-dc55-45c3-9b19-99e32a632792 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:11.445877 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16465ae0-1879-402b-aca0-f5a24976897e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:11.446590 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16465ae0-1879-402b-aca0-f5a24976897e None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:11.446871 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16465ae0-1879-402b-aca0-f5a24976897e None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:11.447148 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16465ae0-1879-402b-aca0-f5a24976897e None admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:11.447988 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16465ae0-1879-402b-aca0-f5a24976897e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:11.448328 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16465ae0-1879-402b-aca0-f5a24976897e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:11.449748 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16465ae0-1879-402b-aca0-f5a24976897e None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:11.484556 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 400/794] 10.222.0.60 () {56 vars in 1149 bytes} [Thu May 12 09:21:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:11.490139 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16465ae0-1879-402b-aca0-f5a24976897e None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:11.613573 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e8465-dc55-45c3-9b19-99e32a632792 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:11.678321 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda73d7a-a012-429b-9c88-291da8994470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:11.679044 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda73d7a-a012-429b-9c88-291da8994470 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:11.679327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda73d7a-a012-429b-9c88-291da8994470 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:11.679602 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda73d7a-a012-429b-9c88-291da8994470 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:11.689364 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda73d7a-a012-429b-9c88-291da8994470 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:11.690846 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda73d7a-a012-429b-9c88-291da8994470 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:11.692082 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16465ae0-1879-402b-aca0-f5a24976897e None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:11.712999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-fda73d7a-a012-429b-9c88-291da8994470 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 09:21:11.712999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:11.712999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:11.712999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:11.712999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:11.712999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:11.712999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:11.712999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:11.712999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:11.712999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:11.712999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:11.712999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:11.712999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:21:11.712999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:21:11.712999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:21:11.712999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:21:11.714958 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:11.714958 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:11.714958 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:21:11.714958 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:11.714958 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:21:11.714958 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:11.714958 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:11.714958 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:11.714958 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:11.714958 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:11.714958 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:11.714958 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:11.714958 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:11.714958 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:11.714958 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:11.714958 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:11.714958 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:11.714958 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:11.715964 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:11.715964 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:11.715964 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:21:11.715964 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:21:11.715964 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:21:11.715964 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:21:11.715964 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:21:11.715964 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:21:11.715964 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 09:21:11.715964 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:11.715964 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 395/795] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:21:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:11.722047 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda73d7a-a012-429b-9c88-291da8994470 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:11.742123 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0253f-ea1a-46be-93f6-f6a8179ae7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:11.742921 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0253f-ea1a-46be-93f6-f6a8179ae7b4 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:11.743196 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0253f-ea1a-46be-93f6-f6a8179ae7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:11.743465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0253f-ea1a-46be-93f6-f6a8179ae7b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:11.758754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e0253f-ea1a-46be-93f6-f6a8179ae7b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:11.760209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e0253f-ea1a-46be-93f6-f6a8179ae7b4 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:11.797576 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-45e0253f-ea1a-46be-93f6-f6a8179ae7b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:11.797576 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:11.797576 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:11.797576 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:11.797576 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:11.797576 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:11.797576 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:11.797576 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:11.797576 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:11.797576 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:11.797576 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:11.797576 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:11.797576 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:21:11.797576 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:21:11.797576 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:21:11.799865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:21:11.799865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:11.799865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:11.799865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:11.799865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:11.799865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:11.799865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:11.799865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:11.799865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:11.799865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:11.799865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:11.799865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:11.799865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:11.799865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:11.799865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:11.799865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:11.799865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:11.802165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:21:11.802165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:21:11.802165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:11.802165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:11.802701 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 401/796] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:11.813326 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0253f-ea1a-46be-93f6-f6a8179ae7b4 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:11.863779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda73d7a-a012-429b-9c88-291da8994470 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:11.909643 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a809c57-2ce2-47d3-ad32-91d071e4d874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:11.911691 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a809c57-2ce2-47d3-ad32-91d071e4d874 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:11.911966 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a809c57-2ce2-47d3-ad32-91d071e4d874 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:11.912234 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a809c57-2ce2-47d3-ad32-91d071e4d874 None admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:11.914051 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a809c57-2ce2-47d3-ad32-91d071e4d874 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:11.914340 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a809c57-2ce2-47d3-ad32-91d071e4d874 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:11.915775 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a809c57-2ce2-47d3-ad32-91d071e4d874 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:11.949570 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 396/797] 10.222.0.60 () {56 vars in 1135 bytes} [Thu May 12 09:21:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:11.956216 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a809c57-2ce2-47d3-ad32-91d071e4d874 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:12.022931 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0253f-ea1a-46be-93f6-f6a8179ae7b4 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:12.089489 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597045df-2700-4f56-be35-5d90b9951395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:12.091512 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597045df-2700-4f56-be35-5d90b9951395 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:12.092165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597045df-2700-4f56-be35-5d90b9951395 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:12.093793 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597045df-2700-4f56-be35-5d90b9951395 None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:12.094775 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597045df-2700-4f56-be35-5d90b9951395 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:12.096006 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597045df-2700-4f56-be35-5d90b9951395 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:12.099157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597045df-2700-4f56-be35-5d90b9951395 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:12.123187 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 402/798] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:12.131204 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597045df-2700-4f56-be35-5d90b9951395 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:12.161728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a809c57-2ce2-47d3-ad32-91d071e4d874 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:12.213191 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fad062-da16-459e-b74a-e0ec797e6c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:12.214357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fad062-da16-459e-b74a-e0ec797e6c19 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:12.214652 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fad062-da16-459e-b74a-e0ec797e6c19 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:12.214932 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fad062-da16-459e-b74a-e0ec797e6c19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:12.229195 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fad062-da16-459e-b74a-e0ec797e6c19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:12.231018 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fad062-da16-459e-b74a-e0ec797e6c19 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:12.237753 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597045df-2700-4f56-be35-5d90b9951395 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:12.252011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-d8fad062-da16-459e-b74a-e0ec797e6c19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:12.252011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:12.252011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:12.252011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:12.252011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:12.252011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:12.252011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:12.252011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:12.252011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:12.252011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:12.252011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:12.252011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:12.252011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:21:12.252011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:21:12.252011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:21:12.252948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:21:12.252948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:12.252948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:12.252948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:12.252948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:12.252948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:12.252948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:12.252948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:12.252948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:12.252948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:12.252948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:12.252948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:12.252948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:12.252948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:12.252948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:12.252948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:12.252948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:12.253845 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:21:12.253845 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:21:12.253845 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:12.253845 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:12.257125 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 397/799] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:12.263109 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d97823-1959-42d7-9e9c-405c033dfd29 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:12.263687 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d97823-1959-42d7-9e9c-405c033dfd29 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:12.264173 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d97823-1959-42d7-9e9c-405c033dfd29 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:12.266027 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 398/800] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:12.266955 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d97823-1959-42d7-9e9c-405c033dfd29 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:12.283943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869610b6-75ab-4f5a-8ce6-5252396f618f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:12.284764 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869610b6-75ab-4f5a-8ce6-5252396f618f None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:12.285043 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869610b6-75ab-4f5a-8ce6-5252396f618f None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:12.285315 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869610b6-75ab-4f5a-8ce6-5252396f618f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:12.293397 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869610b6-75ab-4f5a-8ce6-5252396f618f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:12.294932 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869610b6-75ab-4f5a-8ce6-5252396f618f None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:12.317164 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-869610b6-75ab-4f5a-8ce6-5252396f618f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:12.317164 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:12.317164 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:12.317164 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:12.317164 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:12.317164 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:12.317164 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:12.317164 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:12.317164 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:12.317164 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:12.317164 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:12.317164 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:12.317164 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:21:12.317164 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:21:12.317164 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:21:12.318192 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:21:12.318192 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:12.318192 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:12.318192 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:12.318192 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:12.318192 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:12.318192 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:12.318192 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:12.318192 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:12.318192 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:12.318192 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:12.318192 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:12.318192 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:12.318192 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:12.318192 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:12.318192 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:12.318192 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:12.319105 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:21:12.319105 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:21:12.319105 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:21:12.319105 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:21:12.319105 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:21:12.319105 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:21:12.319105 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:12.319105 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:12.319552 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 403/801] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:21:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:12.320620 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209a911-1711-420e-952f-89af38f3c16a None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:12.320810 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209a911-1711-420e-952f-89af38f3c16a None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:12.321154 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209a911-1711-420e-952f-89af38f3c16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:12.340059 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-7209a911-1711-420e-952f-89af38f3c16a None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:12.341231 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-7209a911-1711-420e-952f-89af38f3c16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:12.407167 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d97823-1959-42d7-9e9c-405c033dfd29 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:12.410588 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 404/802] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:21:12.411141 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209a911-1711-420e-952f-89af38f3c16a None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:12.450289 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97cb3d-b302-4784-9f4e-923975921332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:12.451285 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97cb3d-b302-4784-9f4e-923975921332 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:12.452084 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97cb3d-b302-4784-9f4e-923975921332 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:12.452568 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97cb3d-b302-4784-9f4e-923975921332 None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:12.453798 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97cb3d-b302-4784-9f4e-923975921332 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:12.454575 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97cb3d-b302-4784-9f4e-923975921332 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:12.456283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97cb3d-b302-4784-9f4e-923975921332 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:12.472179 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 399/803] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:12.477244 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97cb3d-b302-4784-9f4e-923975921332 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:12.513818 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209a911-1711-420e-952f-89af38f3c16a None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:12.546896 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff25842-c1e1-439e-b7e2-a09c3c0f4325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:12.547558 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff25842-c1e1-439e-b7e2-a09c3c0f4325 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:12.547843 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff25842-c1e1-439e-b7e2-a09c3c0f4325 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:12.548120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff25842-c1e1-439e-b7e2-a09c3c0f4325 None admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:12.548896 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff25842-c1e1-439e-b7e2-a09c3c0f4325 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:12.549208 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff25842-c1e1-439e-b7e2-a09c3c0f4325 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:12.550654 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff25842-c1e1-439e-b7e2-a09c3c0f4325 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:12.562421 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 405/804] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:21:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:12.563514 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff25842-c1e1-439e-b7e2-a09c3c0f4325 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:12.581527 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97cb3d-b302-4784-9f4e-923975921332 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:12.614837 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95d0e7-a8b1-4972-bd75-cbd326348319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:12.615649 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95d0e7-a8b1-4972-bd75-cbd326348319 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:12.615931 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95d0e7-a8b1-4972-bd75-cbd326348319 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:12.616202 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95d0e7-a8b1-4972-bd75-cbd326348319 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:12.616857 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95d0e7-a8b1-4972-bd75-cbd326348319 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:12.618244 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95d0e7-a8b1-4972-bd75-cbd326348319 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:12.630550 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-3f95d0e7-a8b1-4972-bd75-cbd326348319 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 09:21:12.630550 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:12.630550 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 09:21:12.630550 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 09:21:12.630550 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 09:21:12.630550 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 09:21:12.630550 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 09:21:12.630550 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:12.630550 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 09:21:12.630550 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:12.630550 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 09:21:12.630550 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:12.630550 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:12.630550 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:12.630550 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:12.630550 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:12.631646 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:12.631646 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:12.631646 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:12.631646 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:12.631646 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:12.631646 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:12.631646 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:12.631646 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 09:21:12.631646 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 09:21:12.631646 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 09:21:12.631646 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 09:21:12.631646 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:12.631646 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:12.631646 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:12.631646 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:12.631646 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:12.632732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:12.632732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:12.632732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:12.632732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:12.632732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:12.632732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:12.632732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:12.632732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:12.632732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:12.632732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:12.632732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:12.632732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 09:21:12.632732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:12.632732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 09:21:12.632732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:12.637248 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 400/805] 10.222.0.60 () {56 vars in 1129 bytes} [Thu May 12 09:21:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:12.638561 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e530479-0b61-4fc4-90df-2e009d5f2b3a None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:12.638853 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e530479-0b61-4fc4-90df-2e009d5f2b3a None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:12.639134 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e530479-0b61-4fc4-90df-2e009d5f2b3a None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:12.640401 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 401/806] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:12.641069 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e530479-0b61-4fc4-90df-2e009d5f2b3a None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:12.672297 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff25842-c1e1-439e-b7e2-a09c3c0f4325 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:12.716440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8eb7a4-d219-4e5f-bc7d-6d859e4ae275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:12.717241 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8eb7a4-d219-4e5f-bc7d-6d859e4ae275 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:12.717955 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8eb7a4-d219-4e5f-bc7d-6d859e4ae275 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:12.718246 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8eb7a4-d219-4e5f-bc7d-6d859e4ae275 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:12.726804 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8eb7a4-d219-4e5f-bc7d-6d859e4ae275 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:12.728597 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8eb7a4-d219-4e5f-bc7d-6d859e4ae275 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:12.741860 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e530479-0b61-4fc4-90df-2e009d5f2b3a None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:12.743640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-6b8eb7a4-d219-4e5f-bc7d-6d859e4ae275 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:12.743640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:12.743640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:12.743640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:12.743640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:12.743640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:12.743640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:12.743640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:12.743640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:12.743640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:12.743640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:12.743640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:12.743640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:21:12.743640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:21:12.743640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:21:12.744549 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:21:12.744549 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:12.744549 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:12.744549 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:12.744549 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:12.744549 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:12.744549 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:12.744549 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:12.744549 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:12.744549 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:12.744549 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:12.744549 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:12.744549 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:12.744549 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:12.744549 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:12.744549 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:12.744549 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:12.746545 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:21:12.746545 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:21:12.746545 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:21:12.746545 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:21:12.746545 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:21:12.746545 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:21:12.746545 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:12.746545 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:12.746545 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 406/807] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:21:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:12.746545 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8eb7a4-d219-4e5f-bc7d-6d859e4ae275 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:12.779999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bfb5c-e28a-46a1-ad9a-408a6466ea05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:12.780876 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bfb5c-e28a-46a1-ad9a-408a6466ea05 None admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:12.781155 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bfb5c-e28a-46a1-ad9a-408a6466ea05 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:12.781425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bfb5c-e28a-46a1-ad9a-408a6466ea05 None admin] PATH_INFO: `/v3/projects/9cf4f2954dd44516b3e594ed440781cc/users/bd41f419750140268f4d4b77456065c2/roles/4798f242077c416e9292660af5469faf` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:12.796575 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81bfb5c-e28a-46a1-ad9a-408a6466ea05 None admin] RBAC: Authorizing `identity:create_grant(project_id=9cf4f2954dd44516b3e594ed440781cc, user_id=bd41f419750140268f4d4b77456065c2, role_id=4798f242077c416e9292660af5469faf)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:12.798057 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81bfb5c-e28a-46a1-ad9a-408a6466ea05 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:12.811421 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 402/808] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 12 09:21:12 2022] PUT /identity/v3/projects/9cf4f2954dd44516b3e594ed440781cc/users/bd41f419750140268f4d4b77456065c2/roles/4798f242077c416e9292660af5469faf => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:21:12.812947 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72d0d2-86b3-4dd2-ba5e-f2ebea759513 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:12.813446 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72d0d2-86b3-4dd2-ba5e-f2ebea759513 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:12.813964 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72d0d2-86b3-4dd2-ba5e-f2ebea759513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:12.838670 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-5a72d0d2-86b3-4dd2-ba5e-f2ebea759513 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:12.842098 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-5a72d0d2-86b3-4dd2-ba5e-f2ebea759513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:12.869291 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8eb7a4-d219-4e5f-bc7d-6d859e4ae275 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:12.909882 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cacd279-16e9-4ccf-bab7-24c17d401972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:12.910953 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacd279-16e9-4ccf-bab7-24c17d401972 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:12.911473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacd279-16e9-4ccf-bab7-24c17d401972 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:12.911971 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacd279-16e9-4ccf-bab7-24c17d401972 None admin] PATH_INFO: `/v3/services` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:12.913006 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cacd279-16e9-4ccf-bab7-24c17d401972 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:12.913526 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cacd279-16e9-4ccf-bab7-24c17d401972 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:12.915276 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cacd279-16e9-4ccf-bab7-24c17d401972 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:12.926205 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 407/809] 10.222.0.60 () {56 vars in 1124 bytes} [Thu May 12 09:21:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:12.927530 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cacd279-16e9-4ccf-bab7-24c17d401972 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:12.932947 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 403/810] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:21:12.933969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72d0d2-86b3-4dd2-ba5e-f2ebea759513 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:13.036454 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72d0d2-86b3-4dd2-ba5e-f2ebea759513 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:13.036817 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cacd279-16e9-4ccf-bab7-24c17d401972 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:13.070794 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95395e-9da6-4c60-9a25-4656614a3a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:13.071612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95395e-9da6-4c60-9a25-4656614a3a29 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:13.071896 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95395e-9da6-4c60-9a25-4656614a3a29 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:13.072167 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95395e-9da6-4c60-9a25-4656614a3a29 None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:13.072871 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95395e-9da6-4c60-9a25-4656614a3a29 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:13.073207 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95395e-9da6-4c60-9a25-4656614a3a29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:13.073815 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3c1b1-9552-43be-858b-b4346ae9be5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:13.074601 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95395e-9da6-4c60-9a25-4656614a3a29 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:13.075004 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3c1b1-9552-43be-858b-b4346ae9be5a None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:13.075483 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3c1b1-9552-43be-858b-b4346ae9be5a None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:13.075969 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3c1b1-9552-43be-858b-b4346ae9be5a None admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:13.076948 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3c1b1-9552-43be-858b-b4346ae9be5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:13.077472 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3c1b1-9552-43be-858b-b4346ae9be5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:13.079102 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3c1b1-9552-43be-858b-b4346ae9be5a None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:13.079903 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 404/811] 10.222.0.60 () {56 vars in 1124 bytes} [Thu May 12 09:21:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:13.080684 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95395e-9da6-4c60-9a25-4656614a3a29 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:13.101065 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 408/812] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:21:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:13.101728 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3c1b1-9552-43be-858b-b4346ae9be5a None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:13.203014 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95395e-9da6-4c60-9a25-4656614a3a29 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:13.203235 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3c1b1-9552-43be-858b-b4346ae9be5a None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:13.240416 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fe1c2-3da3-4264-b9fb-8a8e776be031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:13.241087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fe1c2-3da3-4264-b9fb-8a8e776be031 None admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:13.241368 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fe1c2-3da3-4264-b9fb-8a8e776be031 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:13.241641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fe1c2-3da3-4264-b9fb-8a8e776be031 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:13.242418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fe1c2-3da3-4264-b9fb-8a8e776be031 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:13.242710 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b12dfd-d670-4ff7-baad-faa3f1ebb685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:13.243599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b12dfd-d670-4ff7-baad-faa3f1ebb685 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:13.243775 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fe1c2-3da3-4264-b9fb-8a8e776be031 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:13.244055 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b12dfd-d670-4ff7-baad-faa3f1ebb685 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:13.244430 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b12dfd-d670-4ff7-baad-faa3f1ebb685 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:13.257993 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b12dfd-d670-4ff7-baad-faa3f1ebb685 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:21:13.266410 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-16b12dfd-d670-4ff7-baad-faa3f1ebb685 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:21:13.266410 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:13.266410 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:13.266410 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:13.266410 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:13.266410 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:13.266410 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:13.266410 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:13.266410 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:13.266410 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:13.266410 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:13.266410 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:13.266410 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:21:13.266410 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:21:13.266410 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:21:13.266410 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:21:13.268025 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:21:13.268025 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:21:13.268025 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:21:13.268025 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:21:13.268025 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:13.268025 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:13.268025 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:13.268025 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:13.268025 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:13.268025 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:13.268025 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:13.268025 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:13.268025 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:13.268025 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:13.268025 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:13.268025 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:13.269517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:13.269517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:13.269517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:13.269517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:13.269517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:21:13.269517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:21:13.269517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:21:13.269517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:21:13.269517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:21:13.269517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:21:13.269517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:21:13.269517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:13.270332 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 409/813] 10.222.0.60 () {60 vars in 1144 bytes} [Thu May 12 09:21:13 2022] POST /identity/v3/endpoints => generated 346 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:21:13.270332 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fe1c2-3da3-4264-b9fb-8a8e776be031 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:13.270513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 405/814] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:21:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:13.277938 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b12dfd-d670-4ff7-baad-faa3f1ebb685 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:13.426333 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b12dfd-d670-4ff7-baad-faa3f1ebb685 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:13.469282 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7cd03c-f7aa-45e8-9b7b-085aa3fefea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:13.469973 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cd03c-f7aa-45e8-9b7b-085aa3fefea3 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:13.470266 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cd03c-f7aa-45e8-9b7b-085aa3fefea3 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:13.470536 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cd03c-f7aa-45e8-9b7b-085aa3fefea3 None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:13.471793 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7cd03c-f7aa-45e8-9b7b-085aa3fefea3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:13.472100 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7cd03c-f7aa-45e8-9b7b-085aa3fefea3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:13.473952 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7cd03c-f7aa-45e8-9b7b-085aa3fefea3 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:13.485682 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 406/815] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:21:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:13.485855 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fe1c2-3da3-4264-b9fb-8a8e776be031 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:13.487116 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a19b05-96c3-40fa-9ae9-a158c45adee1 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:13.487589 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a19b05-96c3-40fa-9ae9-a158c45adee1 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:13.487874 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a19b05-96c3-40fa-9ae9-a158c45adee1 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:13.490376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 407/816] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:13.491102 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a19b05-96c3-40fa-9ae9-a158c45adee1 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:13.527148 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257c54a-cd52-4278-bec9-b977301a18c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:13.528133 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257c54a-cd52-4278-bec9-b977301a18c7 None admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:13.528409 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257c54a-cd52-4278-bec9-b977301a18c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:13.528685 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257c54a-cd52-4278-bec9-b977301a18c7 None admin] PATH_INFO: `/v3/projects/9cf4f2954dd44516b3e594ed440781cc/users/f7693a31911346f9bb2c01efcd8e16e6/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:13.530701 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257c54a-cd52-4278-bec9-b977301a18c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=9cf4f2954dd44516b3e594ed440781cc, user_id=f7693a31911346f9bb2c01efcd8e16e6, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:13.532125 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257c54a-cd52-4278-bec9-b977301a18c7 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:13.546982 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 410/817] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 12 09:21:13 2022] PUT /identity/v3/projects/9cf4f2954dd44516b3e594ed440781cc/users/f7693a31911346f9bb2c01efcd8e16e6/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:21:13.548376 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cde1ca-7187-49c8-95fe-0b72bccfee50 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:13.548666 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cde1ca-7187-49c8-95fe-0b72bccfee50 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:13.548989 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cde1ca-7187-49c8-95fe-0b72bccfee50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:13.568548 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-49cde1ca-7187-49c8-95fe-0b72bccfee50 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:13.570238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-49cde1ca-7187-49c8-95fe-0b72bccfee50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:13.642545 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a19b05-96c3-40fa-9ae9-a158c45adee1 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:13.687734 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 411/818] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:21:13.709366 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cde1ca-7187-49c8-95fe-0b72bccfee50 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:13.710667 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26061378-292c-4d2a-9b26-a221168db9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:13.711540 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26061378-292c-4d2a-9b26-a221168db9c7 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:13.711822 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26061378-292c-4d2a-9b26-a221168db9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:13.712147 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26061378-292c-4d2a-9b26-a221168db9c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:13.733510 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26061378-292c-4d2a-9b26-a221168db9c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:13.735016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26061378-292c-4d2a-9b26-a221168db9c7 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:13.768874 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-26061378-292c-4d2a-9b26-a221168db9c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:13.768874 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:13.768874 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:13.768874 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:13.768874 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:13.768874 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:13.768874 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:13.768874 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:13.768874 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:13.768874 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:13.768874 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:13.768874 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:13.768874 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:21:13.768874 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:21:13.768874 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:21:13.769849 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:21:13.769849 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:13.769849 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:13.769849 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:13.769849 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:13.769849 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:13.769849 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:13.769849 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:13.769849 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:13.769849 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:13.769849 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:13.769849 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:13.769849 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:13.769849 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:13.769849 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:13.769849 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:13.769849 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:13.770791 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:21:13.770791 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:21:13.770791 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:13.770791 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:13.778576 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 408/819] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:13.786934 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26061378-292c-4d2a-9b26-a221168db9c7 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:13.813410 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cde1ca-7187-49c8-95fe-0b72bccfee50 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:13.853466 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10e763-637e-4229-b5d7-300c0902f9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:13.854824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10e763-637e-4229-b5d7-300c0902f9fb None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:13.855102 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10e763-637e-4229-b5d7-300c0902f9fb None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:13.855417 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10e763-637e-4229-b5d7-300c0902f9fb None admin] PATH_INFO: `/v3/services/network` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:13.856543 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10e763-637e-4229-b5d7-300c0902f9fb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:13.858952 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10e763-637e-4229-b5d7-300c0902f9fb None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:13.875245 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-8a10e763-637e-4229-b5d7-300c0902f9fb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 09:21:13.875245 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:13.875245 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 09:21:13.875245 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 09:21:13.875245 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 09:21:13.875245 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 09:21:13.875245 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 09:21:13.875245 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:13.875245 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 09:21:13.875245 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:13.875245 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 09:21:13.875245 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:13.875245 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:13.875245 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:13.875245 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:13.875245 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:13.875245 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:13.877709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:13.877709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:13.877709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:13.877709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:13.877709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:13.877709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:13.877709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 09:21:13.877709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 09:21:13.877709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 09:21:13.877709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 09:21:13.877709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:13.877709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:13.877709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:13.877709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:13.877709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:13.877709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:13.879808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:13.879808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:13.879808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:13.879808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:13.879808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:13.879808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:13.879808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:13.879808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:13.879808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:13.879808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:13.879808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 09:21:13.879808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:13.879808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 09:21:13.879808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:13.879808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 412/820] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:21:13 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:13.886500 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10e763-637e-4229-b5d7-300c0902f9fb None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:13.936930 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26061378-292c-4d2a-9b26-a221168db9c7 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:13.986175 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa19163-f6c3-41c9-8969-6e111d326185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:13.986840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa19163-f6c3-41c9-8969-6e111d326185 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:13.987116 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa19163-f6c3-41c9-8969-6e111d326185 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:13.987384 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa19163-f6c3-41c9-8969-6e111d326185 None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:13.988101 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa19163-f6c3-41c9-8969-6e111d326185 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:13.988401 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa19163-f6c3-41c9-8969-6e111d326185 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:13.989773 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa19163-f6c3-41c9-8969-6e111d326185 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:14.014197 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 409/821] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:14.018803 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10e763-637e-4229-b5d7-300c0902f9fb None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:14.021044 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa19163-f6c3-41c9-8969-6e111d326185 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:14.075261 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d8b92-b00d-4aba-91e1-d66d20157a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:14.075942 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d8b92-b00d-4aba-91e1-d66d20157a19 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:14.076218 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d8b92-b00d-4aba-91e1-d66d20157a19 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:14.076485 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d8b92-b00d-4aba-91e1-d66d20157a19 None admin] PATH_INFO: `/v3/services` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:14.077194 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d8b92-b00d-4aba-91e1-d66d20157a19 None admin] RBAC: Adding query filter params (name=network) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:14.077493 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d8b92-b00d-4aba-91e1-d66d20157a19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:14.078925 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d8b92-b00d-4aba-91e1-d66d20157a19 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:14.090417 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 413/822] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 12 09:21:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:14.091404 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d8b92-b00d-4aba-91e1-d66d20157a19 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:14.123775 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa19163-f6c3-41c9-8969-6e111d326185 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:14.158019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23cb9f1-25a7-4be4-be29-b94ba8d7dec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:14.158814 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cb9f1-25a7-4be4-be29-b94ba8d7dec5 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:14.159237 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cb9f1-25a7-4be4-be29-b94ba8d7dec5 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:14.159518 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cb9f1-25a7-4be4-be29-b94ba8d7dec5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:14.167113 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23cb9f1-25a7-4be4-be29-b94ba8d7dec5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:14.168551 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23cb9f1-25a7-4be4-be29-b94ba8d7dec5 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:14.184152 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-e23cb9f1-25a7-4be4-be29-b94ba8d7dec5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 09:21:14.184152 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:14.184152 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:14.184152 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:14.184152 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:14.184152 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:14.184152 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:14.184152 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:14.184152 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:14.184152 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:14.184152 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:14.184152 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:14.184152 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:21:14.184152 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:21:14.184152 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:21:14.184152 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:21:14.185132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:14.185132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:14.185132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:21:14.185132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:14.185132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:21:14.185132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:14.185132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:14.185132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:14.185132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:14.185132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:14.185132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:14.185132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:14.185132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:14.185132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:14.185132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:14.185132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:14.185132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:14.185132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:14.186607 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:14.186607 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:14.186607 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:21:14.186607 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:21:14.186607 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:21:14.186607 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:21:14.186607 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:21:14.186607 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:21:14.186607 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 09:21:14.186607 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:14.186607 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 410/823] 10.222.0.60 () {56 vars in 1093 bytes} [Thu May 12 09:21:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:14.191294 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23cb9f1-25a7-4be4-be29-b94ba8d7dec5 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:14.292747 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d8b92-b00d-4aba-91e1-d66d20157a19 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:14.343494 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23cb9f1-25a7-4be4-be29-b94ba8d7dec5 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:14.377614 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe481544-0c3d-4248-8327-7ba0711a6bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:14.378311 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe481544-0c3d-4248-8327-7ba0711a6bbe None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:14.378721 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe481544-0c3d-4248-8327-7ba0711a6bbe None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:14.379089 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe481544-0c3d-4248-8327-7ba0711a6bbe None admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:14.380006 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe481544-0c3d-4248-8327-7ba0711a6bbe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:14.380571 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe481544-0c3d-4248-8327-7ba0711a6bbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:14.382002 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe481544-0c3d-4248-8327-7ba0711a6bbe None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:14.388519 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6df65-9585-4fe5-8693-be3b1d3623db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:14.388519 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6df65-9585-4fe5-8693-be3b1d3623db None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:14.388519 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6df65-9585-4fe5-8693-be3b1d3623db None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:14.388519 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6df65-9585-4fe5-8693-be3b1d3623db None admin] PATH_INFO: `/v3/services` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:14.389832 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6df65-9585-4fe5-8693-be3b1d3623db None admin] RBAC: Adding query filter params (type=network) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:14.389832 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6df65-9585-4fe5-8693-be3b1d3623db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:14.390336 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6df65-9585-4fe5-8693-be3b1d3623db None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:14.398327 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 414/824] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 12 09:21:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:14.400473 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 411/825] 10.222.0.60 () {56 vars in 1133 bytes} [Thu May 12 09:21:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:14.405735 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6df65-9585-4fe5-8693-be3b1d3623db None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:14.408870 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe481544-0c3d-4248-8327-7ba0711a6bbe None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:14.506447 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe481544-0c3d-4248-8327-7ba0711a6bbe None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:14.510431 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6df65-9585-4fe5-8693-be3b1d3623db None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:14.541375 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f719d0f-70e1-4510-8e52-6407f5f6ffba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:14.543098 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f719d0f-70e1-4510-8e52-6407f5f6ffba None admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:14.543599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f719d0f-70e1-4510-8e52-6407f5f6ffba None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:14.544135 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f719d0f-70e1-4510-8e52-6407f5f6ffba None admin] PATH_INFO: `/v3/endpoints` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:14.544614 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272dc748-e817-40cd-a348-0e4bca6531b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:14.545208 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f719d0f-70e1-4510-8e52-6407f5f6ffba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:14.545391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dc748-e817-40cd-a348-0e4bca6531b3 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:14.545735 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dc748-e817-40cd-a348-0e4bca6531b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:14.546138 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dc748-e817-40cd-a348-0e4bca6531b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:14.547365 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f719d0f-70e1-4510-8e52-6407f5f6ffba None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:14.573497 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 412/826] 10.222.0.60 () {60 vars in 1144 bytes} [Thu May 12 09:21:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:21:14.641283 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272dc748-e817-40cd-a348-0e4bca6531b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:14.642920 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272dc748-e817-40cd-a348-0e4bca6531b3 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:14.758379 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 415/827] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:21:14 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 09:21:14.763717 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f719d0f-70e1-4510-8e52-6407f5f6ffba None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:14.904010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f719d0f-70e1-4510-8e52-6407f5f6ffba None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:14.939541 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbfd86-00ef-4e76-95c0-de483157b527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:14.940480 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbfd86-00ef-4e76-95c0-de483157b527 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:14.940614 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbfd86-00ef-4e76-95c0-de483157b527 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:14.940878 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbfd86-00ef-4e76-95c0-de483157b527 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:14.952318 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fbfd86-00ef-4e76-95c0-de483157b527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:14.953776 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fbfd86-00ef-4e76-95c0-de483157b527 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:14.971269 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-54fbfd86-00ef-4e76-95c0-de483157b527 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:14.971269 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:14.971269 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:14.971269 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:14.971269 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:14.971269 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:14.971269 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:14.971269 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:14.971269 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:14.971269 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:14.971269 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:14.971269 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:14.971269 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:21:14.971269 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:21:14.971269 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:21:14.972199 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:21:14.972199 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:14.972199 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:14.972199 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:14.972199 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:14.972199 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:14.972199 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:14.972199 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:14.972199 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:14.972199 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:14.972199 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:14.972199 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:14.972199 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:14.972199 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:14.972199 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:14.972199 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:14.972199 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:14.973111 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:21:14.973111 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:21:14.973111 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:14.973111 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:14.973111 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 413/828] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:14.978192 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272dc748-e817-40cd-a348-0e4bca6531b3 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:15.086568 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272dc748-e817-40cd-a348-0e4bca6531b3 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:15.122170 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8e1d1-72a3-4f3e-bb69-f8765425523b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:15.122886 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8e1d1-72a3-4f3e-bb69-f8765425523b None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:15.123184 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8e1d1-72a3-4f3e-bb69-f8765425523b None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:15.123470 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8e1d1-72a3-4f3e-bb69-f8765425523b None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:15.124183 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8e1d1-72a3-4f3e-bb69-f8765425523b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:15.124492 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8e1d1-72a3-4f3e-bb69-f8765425523b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:15.125849 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8e1d1-72a3-4f3e-bb69-f8765425523b None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:15.139047 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 416/829] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:15.144615 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbfd86-00ef-4e76-95c0-de483157b527 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:15.263536 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbfd86-00ef-4e76-95c0-de483157b527 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:15.301083 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777346a4-3d5e-417f-97e3-3d721164a394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:15.302278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777346a4-3d5e-417f-97e3-3d721164a394 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:15.302763 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777346a4-3d5e-417f-97e3-3d721164a394 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:15.303236 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777346a4-3d5e-417f-97e3-3d721164a394 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:15.310576 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777346a4-3d5e-417f-97e3-3d721164a394 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:15.312242 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777346a4-3d5e-417f-97e3-3d721164a394 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:15.327190 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-777346a4-3d5e-417f-97e3-3d721164a394 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:15.327190 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:15.327190 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:15.327190 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:15.327190 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:15.327190 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:15.327190 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:15.327190 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:15.327190 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:15.327190 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:15.327190 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:15.327190 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:15.327190 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:21:15.327190 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:21:15.327190 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:21:15.328221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:21:15.328221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:15.328221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:15.328221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:15.328221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:15.328221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:15.328221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:15.328221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:15.328221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:15.328221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:15.328221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:15.328221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:15.328221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:15.328221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:15.328221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:15.328221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:15.328221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:15.329139 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:21:15.329139 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:21:15.329139 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:21:15.329139 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:21:15.329139 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:21:15.329139 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:21:15.329139 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:15.329139 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:15.331745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 414/830] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:21:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:15.337929 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8e1d1-72a3-4f3e-bb69-f8765425523b None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:15.407102 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fddf14-cf41-4c7d-9e3e-4d23837eff38 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:15.407778 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fddf14-cf41-4c7d-9e3e-4d23837eff38 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:15.408254 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fddf14-cf41-4c7d-9e3e-4d23837eff38 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:15.411169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 415/831] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:21:15.415271 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda7e61-7601-4d19-adfc-b314d3beb0a5 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:15.415775 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda7e61-7601-4d19-adfc-b314d3beb0a5 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:15.416273 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda7e61-7601-4d19-adfc-b314d3beb0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:15.443706 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-fdda7e61-7601-4d19-adfc-b314d3beb0a5 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:15.445422 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-fdda7e61-7601-4d19-adfc-b314d3beb0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:15.453771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8e1d1-72a3-4f3e-bb69-f8765425523b None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:15.491063 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7794a-9d26-4989-8d12-94e59efcd3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:15.492021 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7794a-9d26-4989-8d12-94e59efcd3ea None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:15.492455 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7794a-9d26-4989-8d12-94e59efcd3ea None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:15.492878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7794a-9d26-4989-8d12-94e59efcd3ea None admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:15.493791 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7794a-9d26-4989-8d12-94e59efcd3ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:15.494278 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7794a-9d26-4989-8d12-94e59efcd3ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:15.495863 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7794a-9d26-4989-8d12-94e59efcd3ea None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:15.508695 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 417/832] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:21:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:15.517496 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7794a-9d26-4989-8d12-94e59efcd3ea None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:15.519179 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 416/833] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 09:21:15.542545 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda7e61-7601-4d19-adfc-b314d3beb0a5 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:15.615508 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7794a-9d26-4989-8d12-94e59efcd3ea None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:15.639807 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda7e61-7601-4d19-adfc-b314d3beb0a5 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:15.648549 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba281b-b1ae-427f-b8cd-2f4f616f93ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:15.649263 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba281b-b1ae-427f-b8cd-2f4f616f93ae None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:15.649552 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba281b-b1ae-427f-b8cd-2f4f616f93ae None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:15.649826 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba281b-b1ae-427f-b8cd-2f4f616f93ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:15.650704 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba281b-b1ae-427f-b8cd-2f4f616f93ae None admin] RBAC: Adding query filter params (role.id=8f01c4c38fa44034a54c1f8cd2d2db1a, scope.project.id=9cf4f2954dd44516b3e594ed440781cc, user.id=2915babd40aa42e8bf7cc85c5a97daa6) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:15.651530 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba281b-b1ae-427f-b8cd-2f4f616f93ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:15.652972 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba281b-b1ae-427f-b8cd-2f4f616f93ae None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:15.665528 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 418/834] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:21:15 2022] GET /identity/v3/role_assignments?user.id=2915babd40aa42e8bf7cc85c5a97daa6&scope.project.id=9cf4f2954dd44516b3e594ed440781cc&role.id=8f01c4c38fa44034a54c1f8cd2d2db1a => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:15.675395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81467fb2-2be5-42a3-ba28-4f1bb3f9321e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:15.676222 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81467fb2-2be5-42a3-ba28-4f1bb3f9321e None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:15.676501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81467fb2-2be5-42a3-ba28-4f1bb3f9321e None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:15.676772 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81467fb2-2be5-42a3-ba28-4f1bb3f9321e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:15.690427 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81467fb2-2be5-42a3-ba28-4f1bb3f9321e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:21:15.698999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-81467fb2-2be5-42a3-ba28-4f1bb3f9321e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 09:21:15.698999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:15.698999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:15.698999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:15.698999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:15.698999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:15.698999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:15.698999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:15.698999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:15.698999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:15.698999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:15.698999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:15.698999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:21:15.698999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:21:15.698999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:21:15.698999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:21:15.700020 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:21:15.700020 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:21:15.700020 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:21:15.700020 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:21:15.700020 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:15.700020 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:15.700020 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:15.700020 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:15.700020 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:15.700020 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:15.700020 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:15.700020 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:15.700020 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:15.700020 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:15.700020 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:15.700020 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:15.700885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:15.700885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:15.700885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:15.700885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:15.700885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:21:15.700885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:21:15.700885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:21:15.700885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:21:15.700885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:21:15.700885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:21:15.700885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 09:21:15.700885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:15.700885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 417/835] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 12 09:21:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:15.706159 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba281b-b1ae-427f-b8cd-2f4f616f93ae None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:15.824276 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba281b-b1ae-427f-b8cd-2f4f616f93ae None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:15.860530 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b344f-1b20-43f0-b7fa-2fc053a31ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:15.861199 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b344f-1b20-43f0-b7fa-2fc053a31ca0 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:15.861484 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b344f-1b20-43f0-b7fa-2fc053a31ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:15.861762 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b344f-1b20-43f0-b7fa-2fc053a31ca0 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:15.862553 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b344f-1b20-43f0-b7fa-2fc053a31ca0 None admin] RBAC: Adding query filter params (name=service) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:15.862862 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b344f-1b20-43f0-b7fa-2fc053a31ca0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:15.864235 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b344f-1b20-43f0-b7fa-2fc053a31ca0 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:15.873699 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 419/836] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 12 09:21:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:15.879175 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81467fb2-2be5-42a3-ba28-4f1bb3f9321e None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:15.978735 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d7cd9-f4ac-407f-ba9e-5a0b3eacac35 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:15.979925 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d7cd9-f4ac-407f-ba9e-5a0b3eacac35 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:15.980409 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d7cd9-f4ac-407f-ba9e-5a0b3eacac35 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:15.982425 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 420/837] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:21:15.987941 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81467fb2-2be5-42a3-ba28-4f1bb3f9321e None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:15.988082 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f43dd9-92c8-46ae-b738-57464b3ced7e None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:15.988308 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f43dd9-92c8-46ae-b738-57464b3ced7e None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:15.988594 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f43dd9-92c8-46ae-b738-57464b3ced7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:16.005858 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-11f43dd9-92c8-46ae-b738-57464b3ced7e None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:16.007108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-11f43dd9-92c8-46ae-b738-57464b3ced7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:16.027063 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead09ef0-521c-482b-9221-692211b818de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:16.028268 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead09ef0-521c-482b-9221-692211b818de None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:16.028800 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead09ef0-521c-482b-9221-692211b818de None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:16.029304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead09ef0-521c-482b-9221-692211b818de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:16.040621 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead09ef0-521c-482b-9221-692211b818de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:16.042915 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead09ef0-521c-482b-9221-692211b818de None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:16.061258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-ead09ef0-521c-482b-9221-692211b818de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:16.061258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:16.061258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:16.061258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:16.061258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:16.061258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:16.061258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:16.061258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:16.061258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:16.061258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:16.061258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:16.061258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:16.061258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:21:16.061258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:21:16.061258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:21:16.062219 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:21:16.062219 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:16.062219 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:16.062219 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:16.062219 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:16.062219 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:16.062219 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:16.062219 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:16.062219 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:16.062219 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:16.062219 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:16.062219 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:16.062219 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:16.062219 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:16.062219 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:16.062219 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:16.062219 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:16.063165 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:21:16.063165 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:21:16.063165 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:16.063165 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:16.065349 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 418/838] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:16.070859 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead09ef0-521c-482b-9221-692211b818de None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:16.090046 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 421/839] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 09:21:16.107564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f43dd9-92c8-46ae-b738-57464b3ced7e None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:16.198257 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead09ef0-521c-482b-9221-692211b818de None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:16.227636 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f43dd9-92c8-46ae-b738-57464b3ced7e None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:16.243901 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafa3bf-c7a8-4709-843b-ce227da677cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:16.245151 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafa3bf-c7a8-4709-843b-ce227da677cd None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:16.245793 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafa3bf-c7a8-4709-843b-ce227da677cd None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:16.246325 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafa3bf-c7a8-4709-843b-ce227da677cd None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:16.247533 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafa3bf-c7a8-4709-843b-ce227da677cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:16.248065 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafa3bf-c7a8-4709-843b-ce227da677cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:16.250116 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafa3bf-c7a8-4709-843b-ce227da677cd None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:16.264012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229ae6c-e576-4c15-ab3c-b935ef13a6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:16.264865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229ae6c-e576-4c15-ab3c-b935ef13a6c3 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:16.265148 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229ae6c-e576-4c15-ab3c-b935ef13a6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:16.265424 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229ae6c-e576-4c15-ab3c-b935ef13a6c3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:16.266209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229ae6c-e576-4c15-ab3c-b935ef13a6c3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:16.266695 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 419/840] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:16.268540 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229ae6c-e576-4c15-ab3c-b935ef13a6c3 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:16.272306 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafa3bf-c7a8-4709-843b-ce227da677cd None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:16.282435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-f229ae6c-e576-4c15-ab3c-b935ef13a6c3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 09:21:16.282435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:16.282435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 09:21:16.282435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 09:21:16.282435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 09:21:16.282435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 09:21:16.282435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 09:21:16.282435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:16.282435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 09:21:16.282435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:16.282435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 09:21:16.282435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:16.282435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:16.282435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:16.282435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:16.282435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:16.282435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:16.283663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:16.283663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:16.283663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:16.283663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:16.283663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:16.283663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:16.283663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 09:21:16.283663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 09:21:16.283663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 09:21:16.283663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 09:21:16.283663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:16.283663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:16.283663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:16.283663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:16.283663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:16.283663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:16.284833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:16.284833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:16.284833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:16.284833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:16.284833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:16.284833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:16.284833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:16.284833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:16.284833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:16.284833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:16.284833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 09:21:16.284833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:16.284833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 09:21:16.284833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:16.287309 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 422/841] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 12 09:21:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:16.293443 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229ae6c-e576-4c15-ab3c-b935ef13a6c3 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:16.374964 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafa3bf-c7a8-4709-843b-ce227da677cd None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:16.407726 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229ae6c-e576-4c15-ab3c-b935ef13a6c3 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:16.408088 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21e714-8827-41d2-8ebc-f64a63521b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:16.408891 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21e714-8827-41d2-8ebc-f64a63521b28 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:16.409173 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21e714-8827-41d2-8ebc-f64a63521b28 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:16.409444 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21e714-8827-41d2-8ebc-f64a63521b28 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:16.416292 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21e714-8827-41d2-8ebc-f64a63521b28 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:16.418339 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21e714-8827-41d2-8ebc-f64a63521b28 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:16.433027 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-6a21e714-8827-41d2-8ebc-f64a63521b28 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 09:21:16.433027 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:16.433027 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:16.433027 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:16.433027 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:16.433027 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:16.433027 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:16.433027 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:16.433027 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:16.433027 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:16.433027 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:16.433027 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:16.433027 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:21:16.433027 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:21:16.433027 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:21:16.433027 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:21:16.434058 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:16.434058 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:16.434058 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:21:16.434058 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:16.434058 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:21:16.434058 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:16.434058 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:16.434058 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:16.434058 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:16.434058 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:16.434058 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:16.434058 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:16.434058 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:16.434058 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:16.434058 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:16.434058 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:16.434058 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:16.434058 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:16.435224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:16.435224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:16.435224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:21:16.435224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:21:16.435224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:21:16.435224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:21:16.435224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:21:16.435224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:21:16.435224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 09:21:16.435224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:16.438763 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 420/842] 10.222.0.60 () {56 vars in 1117 bytes} [Thu May 12 09:21:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:16.440019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b676b4-86d3-49f4-87f2-afedd6747a11 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:16.440309 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b676b4-86d3-49f4-87f2-afedd6747a11 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:16.440591 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b676b4-86d3-49f4-87f2-afedd6747a11 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:16.441878 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 421/843] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:16.442579 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b676b4-86d3-49f4-87f2-afedd6747a11 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:16.447523 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc0a1ea-4dcc-4061-a59a-f6c736a998d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:16.448739 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0a1ea-4dcc-4061-a59a-f6c736a998d5 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:16.449019 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0a1ea-4dcc-4061-a59a-f6c736a998d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:16.449291 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0a1ea-4dcc-4061-a59a-f6c736a998d5 None admin] PATH_INFO: `/v3/services` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:16.450030 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc0a1ea-4dcc-4061-a59a-f6c736a998d5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:16.450340 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc0a1ea-4dcc-4061-a59a-f6c736a998d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:16.451980 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc0a1ea-4dcc-4061-a59a-f6c736a998d5 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:16.460657 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 423/844] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 12 09:21:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:16.460657 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248ee58-a002-4421-ac2f-3a04aa5f4818 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:16.460657 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248ee58-a002-4421-ac2f-3a04aa5f4818 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:16.460657 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248ee58-a002-4421-ac2f-3a04aa5f4818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:16.474740 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-2248ee58-a002-4421-ac2f-3a04aa5f4818 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:16.475895 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-2248ee58-a002-4421-ac2f-3a04aa5f4818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:16.545711 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b676b4-86d3-49f4-87f2-afedd6747a11 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:16.554044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 424/845] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:21:16.554044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248ee58-a002-4421-ac2f-3a04aa5f4818 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:16.588018 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7590b58-a81c-41f0-b986-c831a8376cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:16.588745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7590b58-a81c-41f0-b986-c831a8376cc4 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:16.589032 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7590b58-a81c-41f0-b986-c831a8376cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:16.589306 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7590b58-a81c-41f0-b986-c831a8376cc4 None admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:16.590170 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7590b58-a81c-41f0-b986-c831a8376cc4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:16.590481 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7590b58-a81c-41f0-b986-c831a8376cc4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:16.591912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7590b58-a81c-41f0-b986-c831a8376cc4 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:16.616245 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 422/846] 10.222.0.60 () {56 vars in 1149 bytes} [Thu May 12 09:21:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:16.616245 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7590b58-a81c-41f0-b986-c831a8376cc4 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:16.659550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248ee58-a002-4421-ac2f-3a04aa5f4818 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:16.691960 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650f898-8995-412a-99f2-09fccfedc3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:16.692613 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650f898-8995-412a-99f2-09fccfedc3f5 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:16.692889 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650f898-8995-412a-99f2-09fccfedc3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:16.693153 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650f898-8995-412a-99f2-09fccfedc3f5 None admin] PATH_INFO: `/v3/services` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:16.693842 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650f898-8995-412a-99f2-09fccfedc3f5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:16.694171 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650f898-8995-412a-99f2-09fccfedc3f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:16.695513 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650f898-8995-412a-99f2-09fccfedc3f5 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:16.700027 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 425/847] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 12 09:21:16 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:16.701012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650f898-8995-412a-99f2-09fccfedc3f5 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:16.721870 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7590b58-a81c-41f0-b986-c831a8376cc4 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:16.759931 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a199107-b987-4a8b-ab47-4d92c08d5a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:16.761334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a199107-b987-4a8b-ab47-4d92c08d5a3b None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:16.761617 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a199107-b987-4a8b-ab47-4d92c08d5a3b None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:16.761891 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a199107-b987-4a8b-ab47-4d92c08d5a3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:16.773678 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a199107-b987-4a8b-ab47-4d92c08d5a3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:21:16.782333 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-9a199107-b987-4a8b-ab47-4d92c08d5a3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:21:16.782333 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:16.782333 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:16.782333 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:16.782333 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:16.782333 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:16.782333 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:16.782333 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:16.782333 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:16.782333 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:16.782333 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:16.782333 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:16.782333 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:21:16.782333 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:21:16.782333 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:21:16.782333 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:21:16.783394 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:21:16.783394 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:21:16.783394 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:21:16.783394 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:21:16.783394 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:16.783394 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:16.783394 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:16.783394 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:16.783394 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:16.783394 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:16.783394 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:16.783394 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:16.783394 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:16.783394 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:16.783394 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:16.783394 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:16.784241 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:16.784241 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:16.784241 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:16.784241 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:16.784241 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:21:16.784241 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:21:16.784241 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:21:16.784241 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:21:16.784241 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:21:16.784241 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:21:16.784241 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:21:16.784241 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:16.784241 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 423/848] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:21:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:16.792404 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a199107-b987-4a8b-ab47-4d92c08d5a3b None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:16.832274 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650f898-8995-412a-99f2-09fccfedc3f5 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:16.880454 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b6614-ca9d-44e3-b1f5-e52b5279f01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:16.881146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b6614-ca9d-44e3-b1f5-e52b5279f01c None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:16.881424 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b6614-ca9d-44e3-b1f5-e52b5279f01c None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:16.881696 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b6614-ca9d-44e3-b1f5-e52b5279f01c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:16.915096 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a199107-b987-4a8b-ab47-4d92c08d5a3b None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:16.957248 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b6614-ca9d-44e3-b1f5-e52b5279f01c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:16.957595 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43309952-45a0-4912-a21d-bba8d2ec1377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:16.958303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43309952-45a0-4912-a21d-bba8d2ec1377 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:16.958587 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43309952-45a0-4912-a21d-bba8d2ec1377 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:16.958701 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b6614-ca9d-44e3-b1f5-e52b5279f01c None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:16.958860 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43309952-45a0-4912-a21d-bba8d2ec1377 None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:16.959699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43309952-45a0-4912-a21d-bba8d2ec1377 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:16.960009 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43309952-45a0-4912-a21d-bba8d2ec1377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:16.962380 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43309952-45a0-4912-a21d-bba8d2ec1377 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:16.972850 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 424/849] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:21:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:16.978817 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43309952-45a0-4912-a21d-bba8d2ec1377 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:17.063985 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 426/850] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:21:16 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 09:21:17.069692 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b6614-ca9d-44e3-b1f5-e52b5279f01c None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:17.077791 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43309952-45a0-4912-a21d-bba8d2ec1377 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:17.111405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094ec3a-8031-468e-a918-e25e4fa74263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:17.112195 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094ec3a-8031-468e-a918-e25e4fa74263 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:17.112473 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094ec3a-8031-468e-a918-e25e4fa74263 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:17.112739 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094ec3a-8031-468e-a918-e25e4fa74263 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:17.124034 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094ec3a-8031-468e-a918-e25e4fa74263 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:17.125498 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094ec3a-8031-468e-a918-e25e4fa74263 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:17.143175 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-9094ec3a-8031-468e-a918-e25e4fa74263 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:17.143175 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:17.143175 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:17.143175 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:17.143175 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:17.143175 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:17.143175 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:17.143175 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:17.143175 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:17.143175 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:17.143175 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:17.143175 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:17.143175 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:21:17.143175 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:21:17.143175 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:21:17.144283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:21:17.144283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:17.144283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:17.144283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:17.144283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:17.144283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:17.144283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:17.144283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:17.144283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:17.144283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:17.144283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:17.144283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:17.144283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:17.144283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:17.144283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:17.144283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:17.144283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:17.145357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:21:17.145357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:21:17.145357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:17.145357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:17.148967 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 425/851] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:17.149784 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094ec3a-8031-468e-a918-e25e4fa74263 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:17.177884 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b6614-ca9d-44e3-b1f5-e52b5279f01c None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:17.213378 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accc39b-b8a4-4e54-99f0-a5f9bf20d44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:17.214517 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accc39b-b8a4-4e54-99f0-a5f9bf20d44d None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:17.214996 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accc39b-b8a4-4e54-99f0-a5f9bf20d44d None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:17.215410 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accc39b-b8a4-4e54-99f0-a5f9bf20d44d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:17.225753 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1accc39b-b8a4-4e54-99f0-a5f9bf20d44d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:17.227468 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1accc39b-b8a4-4e54-99f0-a5f9bf20d44d None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:17.246379 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-1accc39b-b8a4-4e54-99f0-a5f9bf20d44d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:17.246379 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:17.246379 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:17.246379 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:17.246379 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:17.246379 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:17.246379 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:17.246379 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:17.246379 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:17.246379 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:17.246379 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:17.246379 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:17.246379 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:21:17.246379 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:21:17.246379 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:21:17.247485 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:21:17.247485 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:17.247485 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:17.247485 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:17.247485 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:17.247485 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:17.247485 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:17.247485 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:17.247485 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:17.247485 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:17.247485 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:17.247485 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:17.247485 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:17.247485 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:17.247485 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:17.247485 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:17.247485 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:17.248606 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:21:17.248606 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:21:17.248606 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:17.248606 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:17.248842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094ec3a-8031-468e-a918-e25e4fa74263 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:17.254787 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 427/852] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:17.256093 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accc39b-b8a4-4e54-99f0-a5f9bf20d44d None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:17.283866 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae91143-41bd-49dc-a62b-0b72c55e3610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:17.285514 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae91143-41bd-49dc-a62b-0b72c55e3610 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:17.286039 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae91143-41bd-49dc-a62b-0b72c55e3610 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:17.286655 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae91143-41bd-49dc-a62b-0b72c55e3610 None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:17.288136 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae91143-41bd-49dc-a62b-0b72c55e3610 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:17.288597 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae91143-41bd-49dc-a62b-0b72c55e3610 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:17.290304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae91143-41bd-49dc-a62b-0b72c55e3610 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:17.306769 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 426/853] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:21:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:17.313558 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae91143-41bd-49dc-a62b-0b72c55e3610 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:17.372043 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accc39b-b8a4-4e54-99f0-a5f9bf20d44d None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:17.416350 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ff8ed-0dc4-4511-937d-24d835a8d84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:17.417046 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ff8ed-0dc4-4511-937d-24d835a8d84a None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:17.417323 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ff8ed-0dc4-4511-937d-24d835a8d84a None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:17.417648 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ff8ed-0dc4-4511-937d-24d835a8d84a None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:17.418376 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ff8ed-0dc4-4511-937d-24d835a8d84a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:17.418676 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ff8ed-0dc4-4511-937d-24d835a8d84a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:17.420253 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ff8ed-0dc4-4511-937d-24d835a8d84a None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:17.423065 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae91143-41bd-49dc-a62b-0b72c55e3610 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:17.436718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 428/854] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:21:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:17.438742 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ff8ed-0dc4-4511-937d-24d835a8d84a None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:17.466229 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e513599-b7b1-465d-9ca7-40724475aea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:17.467126 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e513599-b7b1-465d-9ca7-40724475aea3 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:17.467696 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e513599-b7b1-465d-9ca7-40724475aea3 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:17.468037 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e513599-b7b1-465d-9ca7-40724475aea3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:17.476361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e513599-b7b1-465d-9ca7-40724475aea3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:17.478017 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e513599-b7b1-465d-9ca7-40724475aea3 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:17.493426 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-0e513599-b7b1-465d-9ca7-40724475aea3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 09:21:17.493426 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:17.493426 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:17.493426 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:17.493426 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:17.493426 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:17.493426 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:17.493426 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:17.493426 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:17.493426 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:17.493426 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:17.493426 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:17.493426 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:21:17.493426 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:21:17.493426 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:21:17.493426 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:21:17.494536 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:17.494536 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:17.494536 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:21:17.494536 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:17.494536 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:21:17.494536 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:17.494536 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:17.494536 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:17.494536 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:17.494536 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:17.494536 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:17.494536 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:17.494536 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:17.494536 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:17.494536 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:17.494536 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:17.494536 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:17.494536 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:17.495562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:17.495562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:17.495562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:21:17.495562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:21:17.495562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:21:17.495562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:21:17.495562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:21:17.495562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:21:17.495562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 09:21:17.495562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:17.498118 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 427/855] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:21:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:17.503698 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e513599-b7b1-465d-9ca7-40724475aea3 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:17.567861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ff8ed-0dc4-4511-937d-24d835a8d84a None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:17.603283 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114cac6-7557-480c-af70-48fd13e9fcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:17.604424 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114cac6-7557-480c-af70-48fd13e9fcaf None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:17.604851 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114cac6-7557-480c-af70-48fd13e9fcaf None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:17.605266 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114cac6-7557-480c-af70-48fd13e9fcaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:17.612832 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114cac6-7557-480c-af70-48fd13e9fcaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:17.614581 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114cac6-7557-480c-af70-48fd13e9fcaf None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:17.621852 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e513599-b7b1-465d-9ca7-40724475aea3 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:17.629295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-2114cac6-7557-480c-af70-48fd13e9fcaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:17.629295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:17.629295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:17.629295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:17.629295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:17.629295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:17.629295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:17.629295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:17.629295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:17.629295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:17.629295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:17.629295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:17.629295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:21:17.629295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:21:17.629295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:21:17.630472 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:21:17.630472 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:17.630472 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:17.630472 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:17.630472 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:17.630472 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:17.630472 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:17.630472 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:17.630472 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:17.630472 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:17.630472 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:17.630472 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:17.630472 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:17.630472 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:17.630472 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:17.630472 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:17.630472 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:17.631383 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:21:17.631383 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:21:17.631383 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:21:17.631383 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:21:17.631383 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:21:17.631383 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:21:17.631383 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:17.631383 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:17.638536 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 429/856] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:21:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:17.639602 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114cac6-7557-480c-af70-48fd13e9fcaf None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:17.660956 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e31b1-b833-4f25-9869-aea40d1442e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:17.661739 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e31b1-b833-4f25-9869-aea40d1442e5 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:17.662114 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e31b1-b833-4f25-9869-aea40d1442e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:17.662453 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e31b1-b833-4f25-9869-aea40d1442e5 None admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:17.663791 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e31b1-b833-4f25-9869-aea40d1442e5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:17.664166 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e31b1-b833-4f25-9869-aea40d1442e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:17.665944 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e31b1-b833-4f25-9869-aea40d1442e5 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:17.689220 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 428/857] 10.222.0.60 () {56 vars in 1135 bytes} [Thu May 12 09:21:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:17.690221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e31b1-b833-4f25-9869-aea40d1442e5 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:17.742437 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114cac6-7557-480c-af70-48fd13e9fcaf None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:17.778724 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2f66d-7911-4311-b169-f8b9e4c32f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:17.779697 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2f66d-7911-4311-b169-f8b9e4c32f42 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:17.780186 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2f66d-7911-4311-b169-f8b9e4c32f42 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:17.780637 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2f66d-7911-4311-b169-f8b9e4c32f42 None admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:17.781660 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c2f66d-7911-4311-b169-f8b9e4c32f42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:17.782220 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c2f66d-7911-4311-b169-f8b9e4c32f42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:17.783819 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c2f66d-7911-4311-b169-f8b9e4c32f42 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:17.794993 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e31b1-b833-4f25-9869-aea40d1442e5 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:17.801831 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 430/858] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:21:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:17.802979 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2f66d-7911-4311-b169-f8b9e4c32f42 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:17.831040 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35b2d6-fdab-4067-ac7d-62667e9b40c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:17.831806 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35b2d6-fdab-4067-ac7d-62667e9b40c7 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:17.832195 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35b2d6-fdab-4067-ac7d-62667e9b40c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:17.832480 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35b2d6-fdab-4067-ac7d-62667e9b40c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:17.904010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a35b2d6-fdab-4067-ac7d-62667e9b40c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:17.905574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a35b2d6-fdab-4067-ac7d-62667e9b40c7 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:17.911197 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2f66d-7911-4311-b169-f8b9e4c32f42 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:17.946042 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55701f-ed8f-48a5-931f-781b54acfe0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:17.946984 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55701f-ed8f-48a5-931f-781b54acfe0a None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:17.947475 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55701f-ed8f-48a5-931f-781b54acfe0a None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:17.948499 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55701f-ed8f-48a5-931f-781b54acfe0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:17.949596 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55701f-ed8f-48a5-931f-781b54acfe0a None admin] RBAC: Adding query filter params (role.id=4798f242077c416e9292660af5469faf, scope.project.id=9cf4f2954dd44516b3e594ed440781cc, user.id=bd41f419750140268f4d4b77456065c2) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:17.950167 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55701f-ed8f-48a5-931f-781b54acfe0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:17.951835 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55701f-ed8f-48a5-931f-781b54acfe0a None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:17.966225 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 431/859] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:21:17 2022] GET /identity/v3/role_assignments?user.id=bd41f419750140268f4d4b77456065c2&scope.project.id=9cf4f2954dd44516b3e594ed440781cc&role.id=4798f242077c416e9292660af5469faf => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:18.009365 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 429/860] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:21:17 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 09:21:18.015645 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55701f-ed8f-48a5-931f-781b54acfe0a None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:18.019495 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d00d40-5996-4f66-848b-b51e03f66f77 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:18.019786 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d00d40-5996-4f66-848b-b51e03f66f77 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:18.020068 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d00d40-5996-4f66-848b-b51e03f66f77 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:18.021741 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 430/861] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:21:18.027478 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bafe6-2705-460e-b21d-ddc91e956925 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:18.027783 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bafe6-2705-460e-b21d-ddc91e956925 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:18.028040 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bafe6-2705-460e-b21d-ddc91e956925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:18.046059 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-9f1bafe6-2705-460e-b21d-ddc91e956925 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:18.047280 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-9f1bafe6-2705-460e-b21d-ddc91e956925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:18.132542 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 431/862] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 09:21:18.135054 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55701f-ed8f-48a5-931f-781b54acfe0a None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:18.155820 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bafe6-2705-460e-b21d-ddc91e956925 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:18.180041 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5a029-d601-4d6e-aa37-0e6b954e4867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:18.181240 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5a029-d601-4d6e-aa37-0e6b954e4867 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:18.181535 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5a029-d601-4d6e-aa37-0e6b954e4867 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:18.181812 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5a029-d601-4d6e-aa37-0e6b954e4867 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:18.195199 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5a029-d601-4d6e-aa37-0e6b954e4867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:18.196698 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5a029-d601-4d6e-aa37-0e6b954e4867 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:18.214267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-21b5a029-d601-4d6e-aa37-0e6b954e4867 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:18.214267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:18.214267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:18.214267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:18.214267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:18.214267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:18.214267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:18.214267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:18.214267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:18.214267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:18.214267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:18.214267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:18.214267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:21:18.214267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:21:18.214267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:21:18.215488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:21:18.215488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:18.215488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:18.215488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:18.215488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:18.215488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:18.215488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:18.215488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:18.215488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:18.215488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:18.215488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:18.215488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:18.215488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:18.215488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:18.215488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:18.215488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:18.215488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:18.216932 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:21:18.216932 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:21:18.216932 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:18.216932 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:18.216932 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 432/863] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:18.223947 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5a029-d601-4d6e-aa37-0e6b954e4867 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:18.281407 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bafe6-2705-460e-b21d-ddc91e956925 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:18.316149 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f1f0e-bd0e-4adc-82b0-4c613ac29433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:18.317137 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f1f0e-bd0e-4adc-82b0-4c613ac29433 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:18.317416 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f1f0e-bd0e-4adc-82b0-4c613ac29433 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:18.317690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f1f0e-bd0e-4adc-82b0-4c613ac29433 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:18.318376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f1f0e-bd0e-4adc-82b0-4c613ac29433 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:18.319755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f1f0e-bd0e-4adc-82b0-4c613ac29433 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:18.332705 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-296f1f0e-bd0e-4adc-82b0-4c613ac29433 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 09:21:18.332705 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:18.332705 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 09:21:18.332705 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 09:21:18.332705 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 09:21:18.332705 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 09:21:18.332705 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 09:21:18.332705 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:18.332705 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 09:21:18.332705 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:18.332705 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 09:21:18.332705 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:18.332705 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:18.332705 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:18.332705 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:18.332705 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:18.333654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:18.333654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:18.333654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:18.333654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:18.333654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:18.333654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:18.333654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:18.333654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 09:21:18.333654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 09:21:18.333654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 09:21:18.333654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 09:21:18.333654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:18.333654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:18.333654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:18.333654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:18.333654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:18.334557 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:18.334557 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:18.334557 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:18.334557 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:18.334557 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:18.334557 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:18.334557 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:18.334557 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:18.334557 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:18.334557 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:18.334557 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:18.334557 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 09:21:18.334557 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:18.334557 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 09:21:18.334557 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:18.334557 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 432/864] 10.222.0.60 () {56 vars in 1132 bytes} [Thu May 12 09:21:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:18.341022 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f1f0e-bd0e-4adc-82b0-4c613ac29433 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:18.346854 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5a029-d601-4d6e-aa37-0e6b954e4867 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:18.388482 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75259a-1601-44a3-ad96-bc552bb1cef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:18.389301 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75259a-1601-44a3-ad96-bc552bb1cef7 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:18.390140 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75259a-1601-44a3-ad96-bc552bb1cef7 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:18.390656 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75259a-1601-44a3-ad96-bc552bb1cef7 None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:18.391998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75259a-1601-44a3-ad96-bc552bb1cef7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:18.392981 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75259a-1601-44a3-ad96-bc552bb1cef7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:18.395447 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75259a-1601-44a3-ad96-bc552bb1cef7 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:18.410744 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 433/865] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:18.416135 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75259a-1601-44a3-ad96-bc552bb1cef7 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:18.460627 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f1f0e-bd0e-4adc-82b0-4c613ac29433 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:18.500710 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621dd49c-ed2a-4d59-9b44-30fcaa141f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:18.501468 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621dd49c-ed2a-4d59-9b44-30fcaa141f0a None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:18.501815 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621dd49c-ed2a-4d59-9b44-30fcaa141f0a None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:18.502173 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621dd49c-ed2a-4d59-9b44-30fcaa141f0a None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:18.502943 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621dd49c-ed2a-4d59-9b44-30fcaa141f0a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:18.503330 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621dd49c-ed2a-4d59-9b44-30fcaa141f0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:18.504796 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621dd49c-ed2a-4d59-9b44-30fcaa141f0a None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:18.514705 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 433/866] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 12 09:21:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:18.515753 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621dd49c-ed2a-4d59-9b44-30fcaa141f0a None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:18.536871 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75259a-1601-44a3-ad96-bc552bb1cef7 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:18.578960 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab77a9-526b-408d-98e5-915ba119eb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:18.579961 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab77a9-526b-408d-98e5-915ba119eb52 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:18.580279 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab77a9-526b-408d-98e5-915ba119eb52 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:18.580553 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab77a9-526b-408d-98e5-915ba119eb52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:18.589753 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab77a9-526b-408d-98e5-915ba119eb52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:18.592079 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab77a9-526b-408d-98e5-915ba119eb52 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:18.613035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-53ab77a9-526b-408d-98e5-915ba119eb52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:18.613035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:18.613035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:18.613035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:18.613035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:18.613035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:18.613035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:18.613035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:18.613035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:18.613035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:18.613035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:18.613035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:18.613035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:21:18.613035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:21:18.613035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:21:18.614287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:21:18.614287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:18.614287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:18.614287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:18.614287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:18.614287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:18.614287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:18.614287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:18.614287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:18.614287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:18.614287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:18.614287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:18.614287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:18.614287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:18.614287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:18.614287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:18.614287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:18.615234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:21:18.615234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:21:18.615234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:21:18.615234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:21:18.615234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:21:18.615234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:21:18.615234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:18.615234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:18.617583 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 434/867] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:21:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:18.624032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab77a9-526b-408d-98e5-915ba119eb52 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:18.645232 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621dd49c-ed2a-4d59-9b44-30fcaa141f0a None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:18.687712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2339ab3-da3e-48f4-9fd6-b21950fe3a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:18.688628 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2339ab3-da3e-48f4-9fd6-b21950fe3a38 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:18.688920 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2339ab3-da3e-48f4-9fd6-b21950fe3a38 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:18.689195 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2339ab3-da3e-48f4-9fd6-b21950fe3a38 None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:18.689912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2339ab3-da3e-48f4-9fd6-b21950fe3a38 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:18.690238 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2339ab3-da3e-48f4-9fd6-b21950fe3a38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:18.691601 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2339ab3-da3e-48f4-9fd6-b21950fe3a38 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:18.705941 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 434/868] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 12 09:21:18 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:18.734165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab77a9-526b-408d-98e5-915ba119eb52 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:18.771336 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78138af2-68b5-49cf-ba3e-d80d13d41af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:18.772011 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78138af2-68b5-49cf-ba3e-d80d13d41af2 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:18.772286 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78138af2-68b5-49cf-ba3e-d80d13d41af2 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:18.772558 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78138af2-68b5-49cf-ba3e-d80d13d41af2 None admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:18.773344 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78138af2-68b5-49cf-ba3e-d80d13d41af2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:18.773645 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78138af2-68b5-49cf-ba3e-d80d13d41af2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:18.775102 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78138af2-68b5-49cf-ba3e-d80d13d41af2 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:18.789401 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 435/869] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:21:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:18.796093 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2339ab3-da3e-48f4-9fd6-b21950fe3a38 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:18.906735 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2339ab3-da3e-48f4-9fd6-b21950fe3a38 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:18.940498 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24c638-d11f-4235-8fd9-871e96959188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:18.941153 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24c638-d11f-4235-8fd9-871e96959188 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:18.941427 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24c638-d11f-4235-8fd9-871e96959188 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:18.941695 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24c638-d11f-4235-8fd9-871e96959188 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:18.942562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24c638-d11f-4235-8fd9-871e96959188 None admin] RBAC: Adding query filter params (role.id=8f01c4c38fa44034a54c1f8cd2d2db1a, scope.project.id=9cf4f2954dd44516b3e594ed440781cc, user.id=f7693a31911346f9bb2c01efcd8e16e6) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:18.942854 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24c638-d11f-4235-8fd9-871e96959188 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:18.944264 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24c638-d11f-4235-8fd9-871e96959188 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:18.950461 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 435/870] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:21:18 2022] GET /identity/v3/role_assignments?user.id=f7693a31911346f9bb2c01efcd8e16e6&scope.project.id=9cf4f2954dd44516b3e594ed440781cc&role.id=8f01c4c38fa44034a54c1f8cd2d2db1a => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:19.032655 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f5509-740b-475e-bbce-a3e045761337 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:19.032849 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f5509-740b-475e-bbce-a3e045761337 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:19.033122 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f5509-740b-475e-bbce-a3e045761337 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:19.034813 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 436/871] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:19.040481 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff972814-caff-4fde-bc0c-ad1230bab6fd None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:19.040984 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff972814-caff-4fde-bc0c-ad1230bab6fd None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:19.041091 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff972814-caff-4fde-bc0c-ad1230bab6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:19.059522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-ff972814-caff-4fde-bc0c-ad1230bab6fd None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:19.060738 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-ff972814-caff-4fde-bc0c-ad1230bab6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:19.141407 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 436/872] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:21:19.164076 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f5509-740b-475e-bbce-a3e045761337 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:19.269390 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f5509-740b-475e-bbce-a3e045761337 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:19.304956 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea50f7e-993c-4dab-954f-cc85f5392854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:19.305546 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea50f7e-993c-4dab-954f-cc85f5392854 None admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:19.305824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea50f7e-993c-4dab-954f-cc85f5392854 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:19.306128 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea50f7e-993c-4dab-954f-cc85f5392854 None admin] PATH_INFO: `/v3/services` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:19.306920 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea50f7e-993c-4dab-954f-cc85f5392854 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:19.308852 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea50f7e-993c-4dab-954f-cc85f5392854 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:19.324654 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 437/873] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 12 09:21:19 2022] POST /identity/v3/services => generated 251 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:21:20.447493 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc4cd8-a18c-4457-a3c6-030d300e0119 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:20.448046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc4cd8-a18c-4457-a3c6-030d300e0119 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:20.448046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc4cd8-a18c-4457-a3c6-030d300e0119 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:20.449570 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 437/874] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:20.456334 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25eef0-f4db-44fa-a154-67245b11eff4 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:20.456781 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25eef0-f4db-44fa-a154-67245b11eff4 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:20.456952 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25eef0-f4db-44fa-a154-67245b11eff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:20.474527 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-bd25eef0-f4db-44fa-a154-67245b11eff4 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:20.475708 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-bd25eef0-f4db-44fa-a154-67245b11eff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:20.559548 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 438/875] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:20 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:21:20.582519 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc4cd8-a18c-4457-a3c6-030d300e0119 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:20.694890 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc4cd8-a18c-4457-a3c6-030d300e0119 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:20.729066 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e353de7-1a45-402a-bacf-d82230f52cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:20.729917 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e353de7-1a45-402a-bacf-d82230f52cbc None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:20.730205 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e353de7-1a45-402a-bacf-d82230f52cbc None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:20.730483 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e353de7-1a45-402a-bacf-d82230f52cbc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:20.740626 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e353de7-1a45-402a-bacf-d82230f52cbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:21:20.749354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-8e353de7-1a45-402a-bacf-d82230f52cbc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 09:21:20.749354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:20.749354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:20.749354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:20.749354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:20.749354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:20.749354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:20.749354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:20.749354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:20.749354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:20.749354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:20.749354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:20.749354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:21:20.749354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:21:20.749354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:21:20.749354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:21:20.750378 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:21:20.750378 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:21:20.750378 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:21:20.750378 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:21:20.750378 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:20.750378 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:20.750378 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:20.750378 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:20.750378 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:20.750378 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:20.750378 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:20.750378 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:20.750378 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:20.750378 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:20.750378 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:20.750378 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:20.751255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:20.751255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:20.751255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:20.751255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:20.751255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:21:20.751255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:21:20.751255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:21:20.751255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:21:20.751255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:21:20.751255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:21:20.751255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 09:21:20.751255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:20.751255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 438/876] 10.222.0.60 () {56 vars in 1120 bytes} [Thu May 12 09:21:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:20.756922 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25eef0-f4db-44fa-a154-67245b11eff4 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:20.858818 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25eef0-f4db-44fa-a154-67245b11eff4 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:20.893260 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417b6bc-076f-4d21-b105-c5321f6341d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:20.893983 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417b6bc-076f-4d21-b105-c5321f6341d8 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:20.894270 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417b6bc-076f-4d21-b105-c5321f6341d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:20.894545 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417b6bc-076f-4d21-b105-c5321f6341d8 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:20.895313 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417b6bc-076f-4d21-b105-c5321f6341d8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:20.895618 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417b6bc-076f-4d21-b105-c5321f6341d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:20.897038 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417b6bc-076f-4d21-b105-c5321f6341d8 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:20.906982 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 439/877] 10.222.0.60 () {56 vars in 1115 bytes} [Thu May 12 09:21:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:20.912440 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e353de7-1a45-402a-bacf-d82230f52cbc None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:21.016934 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e353de7-1a45-402a-bacf-d82230f52cbc None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:21.050716 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d3722-27e5-41fb-9249-881261b4f555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:21.051513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d3722-27e5-41fb-9249-881261b4f555 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:21.051795 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d3722-27e5-41fb-9249-881261b4f555 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:21.052077 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d3722-27e5-41fb-9249-881261b4f555 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:21.064048 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d3722-27e5-41fb-9249-881261b4f555 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:21.065497 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d3722-27e5-41fb-9249-881261b4f555 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:21.082890 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-a14d3722-27e5-41fb-9249-881261b4f555 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:21.082890 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:21.082890 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:21.082890 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:21.082890 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:21.082890 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:21.082890 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:21.082890 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:21.082890 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:21.082890 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:21.082890 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:21.082890 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:21.082890 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:21:21.082890 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:21:21.082890 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:21:21.084969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:21:21.084969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:21.084969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:21.084969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:21.084969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:21.084969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:21.084969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:21.084969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:21.084969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:21.084969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:21.084969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:21.084969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:21.084969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:21.084969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:21.084969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:21.084969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:21.084969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:21.087150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:21:21.087150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:21:21.087150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:21.087150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:21.087150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 439/878] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:21.090973 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417b6bc-076f-4d21-b105-c5321f6341d8 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:21.098840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacb360-5ea4-4a24-828c-8f20f66bf8d0 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:21.099130 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacb360-5ea4-4a24-828c-8f20f66bf8d0 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:21.099415 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacb360-5ea4-4a24-828c-8f20f66bf8d0 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:21.100762 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 440/879] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:21.110565 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f40ce-5e7f-4e43-b692-4f36300e52fb None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:21.110851 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f40ce-5e7f-4e43-b692-4f36300e52fb None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:21.111609 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f40ce-5e7f-4e43-b692-4f36300e52fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:21.134337 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-4d7f40ce-5e7f-4e43-b692-4f36300e52fb None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:21.136394 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-4d7f40ce-5e7f-4e43-b692-4f36300e52fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:21.221765 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 441/880] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:21 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 09:21:21.227027 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417b6bc-076f-4d21-b105-c5321f6341d8 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:21.244306 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f40ce-5e7f-4e43-b692-4f36300e52fb None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:21.264033 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926b8ce-ce0e-4c57-9004-813d9e9d4c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:21.264708 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926b8ce-ce0e-4c57-9004-813d9e9d4c43 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:21.264990 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926b8ce-ce0e-4c57-9004-813d9e9d4c43 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:21.265266 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926b8ce-ce0e-4c57-9004-813d9e9d4c43 None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:21.266020 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0926b8ce-ce0e-4c57-9004-813d9e9d4c43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:21.266328 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0926b8ce-ce0e-4c57-9004-813d9e9d4c43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:21.267749 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0926b8ce-ce0e-4c57-9004-813d9e9d4c43 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:21.280534 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 440/881] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:21.285634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926b8ce-ce0e-4c57-9004-813d9e9d4c43 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:21.351528 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f40ce-5e7f-4e43-b692-4f36300e52fb None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:21.388525 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac9ed6-bd57-4356-a550-bdf1a3accf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:21.389194 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac9ed6-bd57-4356-a550-bdf1a3accf8c None admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:21.389480 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac9ed6-bd57-4356-a550-bdf1a3accf8c None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:21.389758 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac9ed6-bd57-4356-a550-bdf1a3accf8c None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:21.390516 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac9ed6-bd57-4356-a550-bdf1a3accf8c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:21.391625 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926b8ce-ce0e-4c57-9004-813d9e9d4c43 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:21.391930 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac9ed6-bd57-4356-a550-bdf1a3accf8c None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:21.405673 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 442/882] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 12 09:21:21 2022] POST /identity/v3/services => generated 269 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:21:21.407007 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d34d3-ffe5-4a63-bab5-d5c6c0e4a2e6 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:21.407298 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d34d3-ffe5-4a63-bab5-d5c6c0e4a2e6 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:21.407574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d34d3-ffe5-4a63-bab5-d5c6c0e4a2e6 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:21.408996 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 443/883] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:21.419838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb56043-1c57-4f3c-b3c5-9eb9738f2be1 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:21.420150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb56043-1c57-4f3c-b3c5-9eb9738f2be1 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:21.420397 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb56043-1c57-4f3c-b3c5-9eb9738f2be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:21.446311 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-9bb56043-1c57-4f3c-b3c5-9eb9738f2be1 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:21.449224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-9bb56043-1c57-4f3c-b3c5-9eb9738f2be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:21.452487 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8912c-024f-433e-9bba-9134b78627c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:21.453335 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8912c-024f-433e-9bba-9134b78627c2 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:21.453717 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8912c-024f-433e-9bba-9134b78627c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:21.454035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8912c-024f-433e-9bba-9134b78627c2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:21.462542 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8912c-024f-433e-9bba-9134b78627c2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:21.464068 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8912c-024f-433e-9bba-9134b78627c2 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:21.480480 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-24c8912c-024f-433e-9bba-9134b78627c2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 09:21:21.480480 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:21.480480 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:21.480480 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:21.480480 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:21.480480 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:21.480480 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:21.480480 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:21.480480 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:21.480480 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:21.480480 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:21.480480 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:21.480480 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:21:21.480480 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:21:21.480480 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:21:21.480480 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:21:21.481537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:21.481537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:21.481537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:21:21.481537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:21.481537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:21:21.481537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:21.481537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:21.481537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:21.481537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:21.481537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:21.481537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:21.481537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:21.481537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:21.481537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:21.481537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:21.481537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:21.481537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:21.481537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:21.482912 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:21.482912 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:21.482912 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:21:21.482912 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:21:21.482912 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:21:21.482912 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:21:21.482912 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:21:21.482912 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:21:21.482912 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 09:21:21.482912 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:21.486789 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 441/884] 10.222.0.60 () {56 vars in 1117 bytes} [Thu May 12 09:21:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:21.487736 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8912c-024f-433e-9bba-9134b78627c2 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:21.547829 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 444/885] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 09:21:21.570727 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb56043-1c57-4f3c-b3c5-9eb9738f2be1 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:21.608027 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8912c-024f-433e-9bba-9134b78627c2 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:21.653776 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc71b7a-9313-4658-a35c-1edf28c6474f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:21.654467 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc71b7a-9313-4658-a35c-1edf28c6474f None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:21.654755 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc71b7a-9313-4658-a35c-1edf28c6474f None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:21.655016 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc71b7a-9313-4658-a35c-1edf28c6474f None admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:21.655840 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc71b7a-9313-4658-a35c-1edf28c6474f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:21.656146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc71b7a-9313-4658-a35c-1edf28c6474f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:21.657548 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc71b7a-9313-4658-a35c-1edf28c6474f None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:21.679941 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 442/886] 10.222.0.60 () {56 vars in 1149 bytes} [Thu May 12 09:21:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:21.686707 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc71b7a-9313-4658-a35c-1edf28c6474f None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:21.696950 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb56043-1c57-4f3c-b3c5-9eb9738f2be1 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:21.732491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e561137-c946-44f8-bc30-811d39442173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:21.733305 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e561137-c946-44f8-bc30-811d39442173 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:21.733585 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e561137-c946-44f8-bc30-811d39442173 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:21.733859 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e561137-c946-44f8-bc30-811d39442173 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:21.734545 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e561137-c946-44f8-bc30-811d39442173 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:21.735926 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e561137-c946-44f8-bc30-811d39442173 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:21.748879 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-0e561137-c946-44f8-bc30-811d39442173 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 09:21:21.748879 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:21.748879 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 09:21:21.748879 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 09:21:21.748879 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 09:21:21.748879 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 09:21:21.748879 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 09:21:21.748879 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:21.748879 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 09:21:21.748879 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:21.748879 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 09:21:21.748879 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:21.748879 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:21.748879 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:21.748879 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:21.748879 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:21.748879 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:21.749960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:21.749960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:21.749960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:21.749960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:21.749960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:21.749960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:21.749960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 09:21:21.749960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 09:21:21.749960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 09:21:21.749960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 09:21:21.749960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:21.749960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:21.749960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:21.749960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:21.749960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:21.749960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:21.751487 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:21.751487 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:21.751487 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:21.751487 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:21.751487 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:21.751487 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:21.751487 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:21.751487 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:21.751487 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:21.751487 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:21.751487 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 09:21:21.751487 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:21.751487 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 09:21:21.751487 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:21.751487 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 445/887] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 12 09:21:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:21.752502 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcac4bf-7708-424f-b7f0-3bd642256a44 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:21.752502 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcac4bf-7708-424f-b7f0-3bd642256a44 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:21.752502 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcac4bf-7708-424f-b7f0-3bd642256a44 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:21.753930 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 446/888] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:21.759018 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcac4bf-7708-424f-b7f0-3bd642256a44 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:21.804929 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc71b7a-9313-4658-a35c-1edf28c6474f None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:21.837579 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66c4ef-1beb-4e3a-a8fd-a78f95485a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:21.838269 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66c4ef-1beb-4e3a-a8fd-a78f95485a73 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:21.838579 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66c4ef-1beb-4e3a-a8fd-a78f95485a73 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:21.838851 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66c4ef-1beb-4e3a-a8fd-a78f95485a73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:21.860836 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcac4bf-7708-424f-b7f0-3bd642256a44 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:21.899795 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a458c2-e9fb-4868-b8ef-8615538efedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:21.900470 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a458c2-e9fb-4868-b8ef-8615538efedf None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:21.900738 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a458c2-e9fb-4868-b8ef-8615538efedf None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:21.901051 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a458c2-e9fb-4868-b8ef-8615538efedf None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:21.901757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a458c2-e9fb-4868-b8ef-8615538efedf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:21.902190 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a458c2-e9fb-4868-b8ef-8615538efedf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:21.903572 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a458c2-e9fb-4868-b8ef-8615538efedf None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:21.907776 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66c4ef-1beb-4e3a-a8fd-a78f95485a73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:21.913113 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 447/889] 10.222.0.60 () {56 vars in 1122 bytes} [Thu May 12 09:21:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:21.913259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66c4ef-1beb-4e3a-a8fd-a78f95485a73 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:21.913371 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c5573-eae9-4928-9a5a-9f6914381ca2 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:21.913371 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c5573-eae9-4928-9a5a-9f6914381ca2 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:21.913371 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c5573-eae9-4928-9a5a-9f6914381ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:21.926845 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-a32c5573-eae9-4928-9a5a-9f6914381ca2 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:21.928015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-a32c5573-eae9-4928-9a5a-9f6914381ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:21.993957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 448/890] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:21:21.993957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c5573-eae9-4928-9a5a-9f6914381ca2 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:22.018221 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 443/891] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:21:21 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 09:21:22.019060 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66c4ef-1beb-4e3a-a8fd-a78f95485a73 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:22.096029 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c5573-eae9-4928-9a5a-9f6914381ca2 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:22.123016 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66c4ef-1beb-4e3a-a8fd-a78f95485a73 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:22.134855 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ed8bf-7f14-4043-bb17-5e856e471ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:22.136082 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ed8bf-7f14-4043-bb17-5e856e471ddd None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:22.136363 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ed8bf-7f14-4043-bb17-5e856e471ddd None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:22.136637 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ed8bf-7f14-4043-bb17-5e856e471ddd None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:22.137336 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ed8bf-7f14-4043-bb17-5e856e471ddd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:22.137641 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ed8bf-7f14-4043-bb17-5e856e471ddd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:22.139058 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ed8bf-7f14-4043-bb17-5e856e471ddd None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:22.143548 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 449/892] 10.222.0.60 () {56 vars in 1122 bytes} [Thu May 12 09:21:21 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:22.144305 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ed8bf-7f14-4043-bb17-5e856e471ddd None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:22.158830 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de0f49-22c3-47dd-9e01-83cf49398580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:22.159983 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de0f49-22c3-47dd-9e01-83cf49398580 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:22.160484 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de0f49-22c3-47dd-9e01-83cf49398580 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:22.160945 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de0f49-22c3-47dd-9e01-83cf49398580 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:22.161796 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de0f49-22c3-47dd-9e01-83cf49398580 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:22.163499 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de0f49-22c3-47dd-9e01-83cf49398580 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:22.184051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-99de0f49-22c3-47dd-9e01-83cf49398580 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 09:21:22.184051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:22.184051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 09:21:22.184051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 09:21:22.184051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 09:21:22.184051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 09:21:22.184051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 09:21:22.184051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:22.184051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 09:21:22.184051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:22.184051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 09:21:22.184051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:22.184051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:22.184051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:22.184051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:22.184051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:22.184051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:22.185150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:22.185150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:22.185150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:22.185150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:22.185150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:22.185150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:22.185150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 09:21:22.185150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 09:21:22.185150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 09:21:22.185150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 09:21:22.185150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:22.185150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:22.185150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:22.185150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:22.185150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:22.185150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:22.186051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:22.186051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:22.186051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:22.186051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:22.186051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:22.186051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:22.186051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:22.186051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:22.186051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:22.186051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:22.186051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 09:21:22.186051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:22.186051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 09:21:22.186051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:22.187728 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 444/893] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 12 09:21:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:22.198071 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de0f49-22c3-47dd-9e01-83cf49398580 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:22.272446 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ed8bf-7f14-4043-bb17-5e856e471ddd None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:22.311989 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee715dcd-319a-4194-8ee6-d0d2abe4225b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:22.312797 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee715dcd-319a-4194-8ee6-d0d2abe4225b None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:22.313076 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee715dcd-319a-4194-8ee6-d0d2abe4225b None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:22.313349 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee715dcd-319a-4194-8ee6-d0d2abe4225b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:22.327657 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de0f49-22c3-47dd-9e01-83cf49398580 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:22.328188 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee715dcd-319a-4194-8ee6-d0d2abe4225b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:22.329871 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee715dcd-319a-4194-8ee6-d0d2abe4225b None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:22.350228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-ee715dcd-319a-4194-8ee6-d0d2abe4225b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:22.350228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:22.350228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:22.350228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:22.350228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:22.350228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:22.350228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:22.350228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:22.350228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:22.350228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:22.350228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:22.350228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:22.350228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:21:22.350228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:21:22.350228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:21:22.351334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:21:22.351334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:22.351334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:22.351334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:22.351334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:22.351334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:22.351334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:22.351334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:22.351334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:22.351334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:22.351334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:22.351334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:22.351334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:22.351334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:22.351334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:22.351334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:22.351334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:22.352355 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:21:22.352355 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:21:22.352355 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:22.352355 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:22.352355 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 450/894] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:22.358875 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee715dcd-319a-4194-8ee6-d0d2abe4225b None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:22.365211 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8fb93-9210-4c9a-82af-1ff26d85e86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:22.365885 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8fb93-9210-4c9a-82af-1ff26d85e86e None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:22.366194 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8fb93-9210-4c9a-82af-1ff26d85e86e None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:22.366468 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8fb93-9210-4c9a-82af-1ff26d85e86e None admin] PATH_INFO: `/v3/services` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:22.367174 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8fb93-9210-4c9a-82af-1ff26d85e86e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:22.367479 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8fb93-9210-4c9a-82af-1ff26d85e86e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:22.368843 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8fb93-9210-4c9a-82af-1ff26d85e86e None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:22.376469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 445/895] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 12 09:21:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:22.383147 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8fb93-9210-4c9a-82af-1ff26d85e86e None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:22.478508 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee715dcd-319a-4194-8ee6-d0d2abe4225b None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:22.494122 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8fb93-9210-4c9a-82af-1ff26d85e86e None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:22.513630 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c89980-0c5b-4a68-ab7b-e6a49ffb247c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:22.514491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c89980-0c5b-4a68-ab7b-e6a49ffb247c None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:22.514875 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c89980-0c5b-4a68-ab7b-e6a49ffb247c None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:22.515252 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c89980-0c5b-4a68-ab7b-e6a49ffb247c None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:22.516076 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c89980-0c5b-4a68-ab7b-e6a49ffb247c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:22.516494 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c89980-0c5b-4a68-ab7b-e6a49ffb247c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:22.517993 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c89980-0c5b-4a68-ab7b-e6a49ffb247c None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:22.528341 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3821ee-c092-4eb2-a876-069318a37328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:22.529006 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3821ee-c092-4eb2-a876-069318a37328 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:22.529285 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3821ee-c092-4eb2-a876-069318a37328 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:22.529555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3821ee-c092-4eb2-a876-069318a37328 None admin] PATH_INFO: `/v3/services` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:22.530278 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3821ee-c092-4eb2-a876-069318a37328 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:22.530638 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 451/896] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:22.530764 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3821ee-c092-4eb2-a876-069318a37328 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:22.532122 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3821ee-c092-4eb2-a876-069318a37328 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:22.536252 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c89980-0c5b-4a68-ab7b-e6a49ffb247c None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:22.542543 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 446/897] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 12 09:21:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:22.543702 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3821ee-c092-4eb2-a876-069318a37328 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:22.645069 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3821ee-c092-4eb2-a876-069318a37328 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:22.655750 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c89980-0c5b-4a68-ab7b-e6a49ffb247c None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:22.680756 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee1688-198a-473b-ab7b-39d05fccb0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:22.681420 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee1688-198a-473b-ab7b-39d05fccb0c8 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:22.681698 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee1688-198a-473b-ab7b-39d05fccb0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:22.682181 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee1688-198a-473b-ab7b-39d05fccb0c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:22.684520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee1688-198a-473b-ab7b-39d05fccb0c8 None admin] RBAC: Adding query filter params (interface=public, service_id=595fc7a422d74b79b62122574efec675, region_id=RegionOne) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:22.684520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee1688-198a-473b-ab7b-39d05fccb0c8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:22.685036 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee1688-198a-473b-ab7b-39d05fccb0c8 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:22.694266 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 447/898] 10.222.0.60 () {56 vars in 1251 bytes} [Thu May 12 09:21:22 2022] GET /identity/v3/endpoints?service_id=595fc7a422d74b79b62122574efec675&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:22.695957 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee1688-198a-473b-ab7b-39d05fccb0c8 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:22.697004 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73057cfc-9807-4a57-acf3-c7f80f8a67f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:22.698114 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73057cfc-9807-4a57-acf3-c7f80f8a67f5 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:22.698632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73057cfc-9807-4a57-acf3-c7f80f8a67f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:22.699161 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73057cfc-9807-4a57-acf3-c7f80f8a67f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:22.706403 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73057cfc-9807-4a57-acf3-c7f80f8a67f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:22.708131 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73057cfc-9807-4a57-acf3-c7f80f8a67f5 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:22.723080 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-73057cfc-9807-4a57-acf3-c7f80f8a67f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:22.723080 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:22.723080 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:22.723080 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:22.723080 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:22.723080 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:22.723080 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:22.723080 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:22.723080 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:22.723080 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:22.723080 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:22.723080 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:22.723080 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:21:22.723080 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:21:22.723080 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:21:22.724045 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:21:22.724045 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:22.724045 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:22.724045 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:22.724045 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:22.724045 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:22.724045 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:22.724045 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:22.724045 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:22.724045 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:22.724045 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:22.724045 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:22.724045 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:22.724045 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:22.724045 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:22.724045 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:22.724045 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:22.724961 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:21:22.724961 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:21:22.724961 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:21:22.724961 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:21:22.724961 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:21:22.724961 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:21:22.724961 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:22.724961 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:22.727468 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 452/899] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:21:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:22.733929 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73057cfc-9807-4a57-acf3-c7f80f8a67f5 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:22.796091 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee1688-198a-473b-ab7b-39d05fccb0c8 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:22.830137 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca16a12-f950-4e74-b891-6f05d9a4cb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:22.830808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca16a12-f950-4e74-b891-6f05d9a4cb5a None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:22.831133 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca16a12-f950-4e74-b891-6f05d9a4cb5a None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:22.831414 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca16a12-f950-4e74-b891-6f05d9a4cb5a None admin] PATH_INFO: `/v3/services` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:22.832091 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca16a12-f950-4e74-b891-6f05d9a4cb5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:22.833205 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73057cfc-9807-4a57-acf3-c7f80f8a67f5 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:22.833448 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca16a12-f950-4e74-b891-6f05d9a4cb5a None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:22.846087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 448/900] 10.222.0.60 () {56 vars in 1087 bytes} [Thu May 12 09:21:22 2022] GET /identity/v3/services => generated 1268 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 09:21:22.870854 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2ef3f-68ed-4ba6-9b41-98a31e24fd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:22.871548 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2ef3f-68ed-4ba6-9b41-98a31e24fd69 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:22.871831 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2ef3f-68ed-4ba6-9b41-98a31e24fd69 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:22.872105 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2ef3f-68ed-4ba6-9b41-98a31e24fd69 None admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:22.872906 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2ef3f-68ed-4ba6-9b41-98a31e24fd69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:22.873216 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2ef3f-68ed-4ba6-9b41-98a31e24fd69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:22.874731 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2ef3f-68ed-4ba6-9b41-98a31e24fd69 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:22.888851 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 453/901] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:21:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:22.894797 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca16a12-f950-4e74-b891-6f05d9a4cb5a None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:22.997884 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca16a12-f950-4e74-b891-6f05d9a4cb5a None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:23.033639 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd20d76-610e-45a5-9b9c-e1eea9a066bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:23.034617 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd20d76-610e-45a5-9b9c-e1eea9a066bc None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:23.035063 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd20d76-610e-45a5-9b9c-e1eea9a066bc None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:23.035540 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd20d76-610e-45a5-9b9c-e1eea9a066bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:23.036534 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd20d76-610e-45a5-9b9c-e1eea9a066bc None admin] RBAC: Adding query filter params (role.id=ee3dbb0fb690434ca94adf68e3148ab2, scope.project.id=9cf4f2954dd44516b3e594ed440781cc, user.id=bd41f419750140268f4d4b77456065c2) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:23.037052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd20d76-610e-45a5-9b9c-e1eea9a066bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:23.038681 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd20d76-610e-45a5-9b9c-e1eea9a066bc None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:23.045329 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 449/902] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:21:22 2022] GET /identity/v3/role_assignments?user.id=bd41f419750140268f4d4b77456065c2&scope.project.id=9cf4f2954dd44516b3e594ed440781cc&role.id=ee3dbb0fb690434ca94adf68e3148ab2 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:23.815946 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c618f7-751a-4389-9f1b-e9f235eecead None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:23.816518 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c618f7-751a-4389-9f1b-e9f235eecead None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:23.816518 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c618f7-751a-4389-9f1b-e9f235eecead None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:23.818117 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 454/903] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:23.823710 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8f900-1dbb-4bfb-a73f-65b866bcf446 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:23.824174 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8f900-1dbb-4bfb-a73f-65b866bcf446 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:23.824273 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8f900-1dbb-4bfb-a73f-65b866bcf446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:23.841564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-d3f8f900-1dbb-4bfb-a73f-65b866bcf446 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:23.842785 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-d3f8f900-1dbb-4bfb-a73f-65b866bcf446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:23.912501 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 450/904] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 09:21:23.937709 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c618f7-751a-4389-9f1b-e9f235eecead None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:24.047055 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c618f7-751a-4389-9f1b-e9f235eecead None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:24.080266 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6196bc-7917-4e78-9937-f26b3c1bda7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:24.081006 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6196bc-7917-4e78-9937-f26b3c1bda7f None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:24.081289 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6196bc-7917-4e78-9937-f26b3c1bda7f None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:24.081564 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6196bc-7917-4e78-9937-f26b3c1bda7f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:24.082251 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6196bc-7917-4e78-9937-f26b3c1bda7f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:24.083623 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6196bc-7917-4e78-9937-f26b3c1bda7f None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:24.096143 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-7c6196bc-7917-4e78-9937-f26b3c1bda7f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 09:21:24.096143 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:24.096143 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 09:21:24.096143 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 09:21:24.096143 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 09:21:24.096143 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 09:21:24.096143 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 09:21:24.096143 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:24.096143 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 09:21:24.096143 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:24.096143 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 09:21:24.096143 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:24.096143 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:24.096143 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:24.096143 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:24.096143 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:24.097150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:24.097150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:24.097150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:24.097150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:24.097150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:24.097150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:24.097150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:24.097150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 09:21:24.097150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 09:21:24.097150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 09:21:24.097150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 09:21:24.097150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:24.097150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:24.097150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:24.097150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:24.097150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:24.098035 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:24.098035 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:24.098035 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:24.098035 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:24.098035 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:24.098035 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:24.098035 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:24.098035 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:24.098035 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:24.098035 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:24.098035 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:24.098035 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 09:21:24.098035 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:24.098035 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 09:21:24.098035 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:24.109635 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 455/905] 10.222.0.60 () {56 vars in 1132 bytes} [Thu May 12 09:21:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:24.112455 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8f900-1dbb-4bfb-a73f-65b866bcf446 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:24.212231 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8f900-1dbb-4bfb-a73f-65b866bcf446 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:24.249113 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b0922-a6cb-4ce3-8a81-887484a76b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:24.250243 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b0922-a6cb-4ce3-8a81-887484a76b13 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:24.250728 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b0922-a6cb-4ce3-8a81-887484a76b13 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:24.251222 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b0922-a6cb-4ce3-8a81-887484a76b13 None admin] PATH_INFO: `/v3/services` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:24.252195 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b0922-a6cb-4ce3-8a81-887484a76b13 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:24.252781 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b0922-a6cb-4ce3-8a81-887484a76b13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:24.254510 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b0922-a6cb-4ce3-8a81-887484a76b13 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:24.260757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 451/906] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 12 09:21:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:24.266155 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6196bc-7917-4e78-9937-f26b3c1bda7f None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:24.372627 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6196bc-7917-4e78-9937-f26b3c1bda7f None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:24.406379 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ac2bf-bef3-42e8-b2b6-561a76269182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:24.407051 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ac2bf-bef3-42e8-b2b6-561a76269182 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:24.407335 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ac2bf-bef3-42e8-b2b6-561a76269182 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:24.407607 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ac2bf-bef3-42e8-b2b6-561a76269182 None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:24.408309 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ac2bf-bef3-42e8-b2b6-561a76269182 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:24.408613 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ac2bf-bef3-42e8-b2b6-561a76269182 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:24.409994 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ac2bf-bef3-42e8-b2b6-561a76269182 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:24.415068 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 456/907] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 12 09:21:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:24.420851 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b0922-a6cb-4ce3-8a81-887484a76b13 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:24.422671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10431f34-6e19-4333-8186-976e9feb9d1d None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:24.422962 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10431f34-6e19-4333-8186-976e9feb9d1d None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:24.423236 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10431f34-6e19-4333-8186-976e9feb9d1d None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:24.424622 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 457/908] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:24.429301 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7498349-9eb4-478d-b8fb-30bd24ab0260 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:24.429581 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7498349-9eb4-478d-b8fb-30bd24ab0260 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:24.429855 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7498349-9eb4-478d-b8fb-30bd24ab0260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:24.447170 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-e7498349-9eb4-478d-b8fb-30bd24ab0260 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:24.449195 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-e7498349-9eb4-478d-b8fb-30bd24ab0260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:24.520772 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 458/909] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 09:21:24.543381 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7498349-9eb4-478d-b8fb-30bd24ab0260 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:24.551223 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b0922-a6cb-4ce3-8a81-887484a76b13 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:24.593553 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c650bb-5dbe-44d5-bdae-3ba137730006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:24.595007 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c650bb-5dbe-44d5-bdae-3ba137730006 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:24.595491 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c650bb-5dbe-44d5-bdae-3ba137730006 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:24.596209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c650bb-5dbe-44d5-bdae-3ba137730006 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:24.597182 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c650bb-5dbe-44d5-bdae-3ba137730006 None admin] RBAC: Adding query filter params (interface=public, service_id=fba7af85cc5e49f7b00c4209da8a6ae8, region_id=RegionOne) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:24.597775 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c650bb-5dbe-44d5-bdae-3ba137730006 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:24.599599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c650bb-5dbe-44d5-bdae-3ba137730006 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:24.607132 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 452/910] 10.222.0.60 () {56 vars in 1251 bytes} [Thu May 12 09:21:24 2022] GET /identity/v3/endpoints?service_id=fba7af85cc5e49f7b00c4209da8a6ae8&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:24.611916 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c650bb-5dbe-44d5-bdae-3ba137730006 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:24.649827 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7498349-9eb4-478d-b8fb-30bd24ab0260 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:24.685246 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83334ee3-0cd5-43a4-b702-35aefd8a1a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:24.685950 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83334ee3-0cd5-43a4-b702-35aefd8a1a2d None admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:24.686244 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83334ee3-0cd5-43a4-b702-35aefd8a1a2d None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:24.686524 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83334ee3-0cd5-43a4-b702-35aefd8a1a2d None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:24.687266 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83334ee3-0cd5-43a4-b702-35aefd8a1a2d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:24.689333 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83334ee3-0cd5-43a4-b702-35aefd8a1a2d None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:24.713931 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 459/911] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 12 09:21:24 2022] POST /identity/v3/services => generated 241 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:21:24.728511 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c650bb-5dbe-44d5-bdae-3ba137730006 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:24.774003 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496a02a-8313-4900-9398-5c1cc5174daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:24.774682 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496a02a-8313-4900-9398-5c1cc5174daf None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:24.774970 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496a02a-8313-4900-9398-5c1cc5174daf None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:24.775235 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496a02a-8313-4900-9398-5c1cc5174daf None admin] PATH_INFO: `/v3/services` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:24.776507 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496a02a-8313-4900-9398-5c1cc5174daf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:24.777927 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496a02a-8313-4900-9398-5c1cc5174daf None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:24.785097 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 453/912] 10.222.0.60 () {56 vars in 1087 bytes} [Thu May 12 09:21:24 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:21:25.201719 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2eadb0-50e2-495f-99eb-5d5471f1c5b6 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:25.202298 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2eadb0-50e2-495f-99eb-5d5471f1c5b6 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:25.202380 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2eadb0-50e2-495f-99eb-5d5471f1c5b6 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:25.203833 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 460/913] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:25.209418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c300d3-1c3e-4d1b-8d19-02e5a44d5986 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:25.209847 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c300d3-1c3e-4d1b-8d19-02e5a44d5986 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:25.210045 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c300d3-1c3e-4d1b-8d19-02e5a44d5986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:25.231064 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-f9c300d3-1c3e-4d1b-8d19-02e5a44d5986 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:25.232227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-f9c300d3-1c3e-4d1b-8d19-02e5a44d5986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:25.299101 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 454/914] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:21:25.316445 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d5d2e-adca-43dc-9987-161780bbbd14 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:25.316758 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d5d2e-adca-43dc-9987-161780bbbd14 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:25.317004 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d5d2e-adca-43dc-9987-161780bbbd14 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:25.318634 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 461/915] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:25.323552 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d5d2e-adca-43dc-9987-161780bbbd14 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:25.324041 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7730cc0-2f9d-4866-974f-f1cceff8f413 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:25.324352 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7730cc0-2f9d-4866-974f-f1cceff8f413 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:25.324606 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7730cc0-2f9d-4866-974f-f1cceff8f413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:25.342561 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-b7730cc0-2f9d-4866-974f-f1cceff8f413 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:25.344044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-b7730cc0-2f9d-4866-974f-f1cceff8f413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:25.433630 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d5d2e-adca-43dc-9987-161780bbbd14 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:25.438015 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 455/916] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:21:25.460236 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7730cc0-2f9d-4866-974f-f1cceff8f413 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:25.477914 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e684bc-d069-414d-9fb3-a522456a034f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:25.479394 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e684bc-d069-414d-9fb3-a522456a034f None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:25.479705 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e684bc-d069-414d-9fb3-a522456a034f None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:25.480585 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e684bc-d069-414d-9fb3-a522456a034f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:25.481735 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e684bc-d069-414d-9fb3-a522456a034f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:25.483613 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e684bc-d069-414d-9fb3-a522456a034f None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:25.501885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-a6e684bc-d069-414d-9fb3-a522456a034f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 09:21:25.501885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:25.501885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 09:21:25.501885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 09:21:25.501885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 09:21:25.501885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 09:21:25.501885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 09:21:25.501885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:25.501885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 09:21:25.501885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:25.501885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 09:21:25.501885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:25.501885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:25.501885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:25.501885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:25.501885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:25.501885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:25.502983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:25.502983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:25.502983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:25.502983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:25.502983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:25.502983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:25.502983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 09:21:25.502983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 09:21:25.502983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 09:21:25.502983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 09:21:25.502983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:25.502983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:25.502983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:25.502983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:25.502983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:25.502983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:25.503885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:25.503885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:25.503885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:25.503885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:25.503885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:25.503885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:25.503885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:25.503885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:25.503885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:25.503885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:25.503885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 09:21:25.503885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:25.503885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 09:21:25.503885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:25.508569 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 462/917] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 12 09:21:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:25.510016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e684bc-d069-414d-9fb3-a522456a034f None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:25.576025 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7730cc0-2f9d-4866-974f-f1cceff8f413 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:25.610989 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8da7b-b2fc-4635-8212-698ad2da8ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:25.612172 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8da7b-b2fc-4635-8212-698ad2da8ee5 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:25.612683 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8da7b-b2fc-4635-8212-698ad2da8ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:25.613154 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8da7b-b2fc-4635-8212-698ad2da8ee5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:25.623980 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8da7b-b2fc-4635-8212-698ad2da8ee5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:21:25.625325 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e684bc-d069-414d-9fb3-a522456a034f None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:25.633120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-4cc8da7b-b2fc-4635-8212-698ad2da8ee5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 09:21:25.633120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:25.633120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:25.633120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:25.633120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:25.633120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:25.633120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:25.633120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:25.633120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:25.633120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:25.633120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:25.633120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:25.633120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:21:25.633120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:21:25.633120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:21:25.633120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:21:25.634116 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:21:25.634116 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:21:25.634116 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:21:25.634116 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:21:25.634116 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:25.634116 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:25.634116 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:25.634116 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:25.634116 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:25.634116 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:25.634116 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:25.634116 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:25.634116 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:25.634116 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:25.634116 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:25.634116 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:25.634992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:25.634992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:25.634992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:25.634992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:25.634992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:21:25.634992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:21:25.634992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:21:25.634992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:21:25.634992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:21:25.634992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:21:25.634992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 09:21:25.634992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:25.638318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 456/918] 10.222.0.60 () {56 vars in 1120 bytes} [Thu May 12 09:21:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:25.643551 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8da7b-b2fc-4635-8212-698ad2da8ee5 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:25.664894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc6d08-5a54-4bf9-bbc4-d744c56213b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:25.665559 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc6d08-5a54-4bf9-bbc4-d744c56213b5 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:25.665846 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc6d08-5a54-4bf9-bbc4-d744c56213b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:25.666166 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc6d08-5a54-4bf9-bbc4-d744c56213b5 None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:25.666910 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc6d08-5a54-4bf9-bbc4-d744c56213b5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:25.667221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc6d08-5a54-4bf9-bbc4-d744c56213b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:25.668594 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc6d08-5a54-4bf9-bbc4-d744c56213b5 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:25.678132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 463/919] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 12 09:21:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:25.678982 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc6d08-5a54-4bf9-bbc4-d744c56213b5 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:25.755843 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8da7b-b2fc-4635-8212-698ad2da8ee5 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:25.785282 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc6d08-5a54-4bf9-bbc4-d744c56213b5 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:25.790155 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8633f-6753-4a36-a726-5e67bc6b4340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:25.791081 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8633f-6753-4a36-a726-5e67bc6b4340 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:25.792088 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8633f-6753-4a36-a726-5e67bc6b4340 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:25.792585 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8633f-6753-4a36-a726-5e67bc6b4340 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:25.793596 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8633f-6753-4a36-a726-5e67bc6b4340 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:25.794157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8633f-6753-4a36-a726-5e67bc6b4340 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:25.795718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8633f-6753-4a36-a726-5e67bc6b4340 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:25.804333 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 457/920] 10.222.0.60 () {56 vars in 1115 bytes} [Thu May 12 09:21:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:25.810142 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8633f-6753-4a36-a726-5e67bc6b4340 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:25.824437 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb0c42-dd68-42fb-a332-f56d40a3af32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:25.825103 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb0c42-dd68-42fb-a332-f56d40a3af32 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:25.825388 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb0c42-dd68-42fb-a332-f56d40a3af32 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:25.825670 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb0c42-dd68-42fb-a332-f56d40a3af32 None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:25.826431 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb0c42-dd68-42fb-a332-f56d40a3af32 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:25.826729 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb0c42-dd68-42fb-a332-f56d40a3af32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:25.828104 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb0c42-dd68-42fb-a332-f56d40a3af32 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:25.837651 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 464/921] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 12 09:21:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:25.838577 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb0c42-dd68-42fb-a332-f56d40a3af32 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:25.916167 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8633f-6753-4a36-a726-5e67bc6b4340 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:25.939966 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb0c42-dd68-42fb-a332-f56d40a3af32 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:25.951336 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b2909-2538-4e93-9b23-f0f222e5107e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:25.952438 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b2909-2538-4e93-9b23-f0f222e5107e None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:25.953002 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b2909-2538-4e93-9b23-f0f222e5107e None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:25.953477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b2909-2538-4e93-9b23-f0f222e5107e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:25.965213 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b2909-2538-4e93-9b23-f0f222e5107e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:25.966978 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b2909-2538-4e93-9b23-f0f222e5107e None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:25.974694 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3115173-713f-44a7-a5ae-e2831abbbaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:25.975354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3115173-713f-44a7-a5ae-e2831abbbaee None admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:25.975638 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3115173-713f-44a7-a5ae-e2831abbbaee None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:25.975914 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3115173-713f-44a7-a5ae-e2831abbbaee None admin] PATH_INFO: `/v3/endpoints` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:25.976658 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3115173-713f-44a7-a5ae-e2831abbbaee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:25.978047 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3115173-713f-44a7-a5ae-e2831abbbaee None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:25.988041 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-ef9b2909-2538-4e93-9b23-f0f222e5107e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:25.988041 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:25.988041 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:25.988041 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:25.988041 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:25.988041 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:25.988041 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:25.988041 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:25.988041 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:25.988041 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:25.988041 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:25.988041 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:25.988041 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:21:25.988041 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:21:25.988041 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:21:25.989000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:21:25.989000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:25.989000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:25.989000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:25.989000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:25.989000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:25.989000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:25.989000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:25.989000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:25.989000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:25.989000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:25.989000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:25.989000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:25.989000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:25.989000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:25.989000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:25.989000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:25.990046 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:21:25.990046 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:21:25.990046 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:25.990046 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:25.992623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 458/922] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:25.999095 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b2909-2538-4e93-9b23-f0f222e5107e None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:26.014032 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 465/923] 10.222.0.60 () {60 vars in 1144 bytes} [Thu May 12 09:21:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:21:26.123436 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b2909-2538-4e93-9b23-f0f222e5107e None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:26.166543 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d610e5-6412-4e78-8ac4-e36d5eeac154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:26.167223 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d610e5-6412-4e78-8ac4-e36d5eeac154 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:26.167506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d610e5-6412-4e78-8ac4-e36d5eeac154 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:26.167789 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d610e5-6412-4e78-8ac4-e36d5eeac154 None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:26.168563 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d610e5-6412-4e78-8ac4-e36d5eeac154 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:26.168871 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d610e5-6412-4e78-8ac4-e36d5eeac154 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:26.170364 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d610e5-6412-4e78-8ac4-e36d5eeac154 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:26.184531 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 459/924] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:26.191043 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3115173-713f-44a7-a5ae-e2831abbbaee None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:26.295506 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3115173-713f-44a7-a5ae-e2831abbbaee None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:26.330292 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de3e27-4fe1-49c2-9704-b9e4b92d09a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:26.331154 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de3e27-4fe1-49c2-9704-b9e4b92d09a6 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:26.331435 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de3e27-4fe1-49c2-9704-b9e4b92d09a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:26.331708 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de3e27-4fe1-49c2-9704-b9e4b92d09a6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:26.339859 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de3e27-4fe1-49c2-9704-b9e4b92d09a6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:26.341297 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de3e27-4fe1-49c2-9704-b9e4b92d09a6 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:26.355757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-43de3e27-4fe1-49c2-9704-b9e4b92d09a6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 09:21:26.355757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:26.355757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:26.355757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:26.355757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:26.355757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:26.355757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:26.355757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:26.355757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:26.355757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:26.355757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:26.355757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:26.355757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:21:26.355757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:21:26.355757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:21:26.355757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:21:26.356755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:26.356755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:26.356755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:21:26.356755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:26.356755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:21:26.356755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:26.356755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:26.356755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:26.356755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:26.356755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:26.356755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:26.356755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:26.356755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:26.356755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:26.356755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:26.356755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:26.356755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:26.356755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:26.357737 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:26.357737 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:26.357737 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:21:26.357737 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:21:26.357737 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:21:26.357737 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:21:26.357737 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:21:26.357737 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:21:26.357737 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 09:21:26.357737 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:26.357737 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 466/925] 10.222.0.60 () {56 vars in 1117 bytes} [Thu May 12 09:21:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:26.364680 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d610e5-6412-4e78-8ac4-e36d5eeac154 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:26.464522 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d610e5-6412-4e78-8ac4-e36d5eeac154 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:26.498199 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1545e0-f5d2-4e8f-b102-ad4a3a66f6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:26.499255 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1545e0-f5d2-4e8f-b102-ad4a3a66f6a6 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:26.499753 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1545e0-f5d2-4e8f-b102-ad4a3a66f6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:26.500237 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1545e0-f5d2-4e8f-b102-ad4a3a66f6a6 None admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:26.501287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1545e0-f5d2-4e8f-b102-ad4a3a66f6a6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:26.501794 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1545e0-f5d2-4e8f-b102-ad4a3a66f6a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:26.503426 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1545e0-f5d2-4e8f-b102-ad4a3a66f6a6 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:26.525916 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 460/926] 10.222.0.60 () {56 vars in 1149 bytes} [Thu May 12 09:21:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:26.531272 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de3e27-4fe1-49c2-9704-b9e4b92d09a6 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:26.634012 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de3e27-4fe1-49c2-9704-b9e4b92d09a6 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:26.668977 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87644375-c2bf-4644-8a41-ce89aa22f380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:26.670185 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87644375-c2bf-4644-8a41-ce89aa22f380 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:26.670686 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87644375-c2bf-4644-8a41-ce89aa22f380 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:26.671182 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87644375-c2bf-4644-8a41-ce89aa22f380 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:26.682748 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87644375-c2bf-4644-8a41-ce89aa22f380 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:26.684492 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87644375-c2bf-4644-8a41-ce89aa22f380 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:26.702685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-87644375-c2bf-4644-8a41-ce89aa22f380 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:26.702685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:26.702685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:26.702685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:26.702685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:26.702685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:26.702685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:26.702685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:26.702685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:26.702685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:26.702685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:26.702685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:26.702685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:21:26.702685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:21:26.702685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:21:26.703639 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:21:26.703639 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:26.703639 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:26.703639 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:26.703639 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:26.703639 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:26.703639 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:26.703639 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:26.703639 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:26.703639 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:26.703639 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:26.703639 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:26.703639 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:26.703639 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:26.703639 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:26.703639 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:26.703639 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:26.704538 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:21:26.704538 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:21:26.704538 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:26.704538 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:26.706830 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 467/927] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:26.712510 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1545e0-f5d2-4e8f-b102-ad4a3a66f6a6 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:26.817778 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1545e0-f5d2-4e8f-b102-ad4a3a66f6a6 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:26.854174 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c133b-2b2e-4dd1-9b9f-e45ca61902ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:26.854844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c133b-2b2e-4dd1-9b9f-e45ca61902ba None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:26.855123 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c133b-2b2e-4dd1-9b9f-e45ca61902ba None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:26.855395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c133b-2b2e-4dd1-9b9f-e45ca61902ba None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:26.856201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c133b-2b2e-4dd1-9b9f-e45ca61902ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:26.856510 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c133b-2b2e-4dd1-9b9f-e45ca61902ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:26.857867 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c133b-2b2e-4dd1-9b9f-e45ca61902ba None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:26.870139 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 461/928] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:26.875610 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87644375-c2bf-4644-8a41-ce89aa22f380 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:26.983572 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87644375-c2bf-4644-8a41-ce89aa22f380 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:26.987759 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852d04f-2bdd-4c6b-808b-b71d5545ae65 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:26.988048 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852d04f-2bdd-4c6b-808b-b71d5545ae65 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:26.988318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852d04f-2bdd-4c6b-808b-b71d5545ae65 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:26.989928 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 462/929] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:21:26.995095 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cfa6a-00bb-4885-82e0-a28c35580e98 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:26.995379 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cfa6a-00bb-4885-82e0-a28c35580e98 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:26.995655 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cfa6a-00bb-4885-82e0-a28c35580e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:27.012530 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-243cfa6a-00bb-4885-82e0-a28c35580e98 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:27.013683 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-243cfa6a-00bb-4885-82e0-a28c35580e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:27.022099 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3e2f0-0d99-4bcf-819a-f304a77fc53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:27.023172 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3e2f0-0d99-4bcf-819a-f304a77fc53e None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:27.023658 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3e2f0-0d99-4bcf-819a-f304a77fc53e None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:27.024137 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3e2f0-0d99-4bcf-819a-f304a77fc53e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:27.031425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3e2f0-0d99-4bcf-819a-f304a77fc53e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:27.033191 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3e2f0-0d99-4bcf-819a-f304a77fc53e None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:27.048517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-68e3e2f0-0d99-4bcf-819a-f304a77fc53e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:27.048517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:27.048517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:27.048517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:27.048517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:27.048517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:27.048517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:27.048517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:27.048517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:27.048517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:27.048517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:27.048517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:27.048517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:21:27.048517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:21:27.048517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:21:27.049457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:21:27.049457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:27.049457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:27.049457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:27.049457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:27.049457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:27.049457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:27.049457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:27.049457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:27.049457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:27.049457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:27.049457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:27.049457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:27.049457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:27.049457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:27.049457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:27.049457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:27.050403 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:21:27.050403 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:21:27.050403 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:21:27.050403 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:21:27.050403 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:21:27.050403 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:21:27.050403 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:27.050403 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:27.052789 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 468/930] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:21:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:27.058645 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3e2f0-0d99-4bcf-819a-f304a77fc53e None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:27.085975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 463/931] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 09:21:27.100768 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243cfa6a-00bb-4885-82e0-a28c35580e98 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:27.159418 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3e2f0-0d99-4bcf-819a-f304a77fc53e None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:27.192727 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794edc4-50e3-4b57-8320-a0a69f4a1cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:27.193385 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794edc4-50e3-4b57-8320-a0a69f4a1cf9 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:27.193675 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794edc4-50e3-4b57-8320-a0a69f4a1cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:27.193953 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794edc4-50e3-4b57-8320-a0a69f4a1cf9 None admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:27.194728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5794edc4-50e3-4b57-8320-a0a69f4a1cf9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:27.195039 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5794edc4-50e3-4b57-8320-a0a69f4a1cf9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:27.196467 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5794edc4-50e3-4b57-8320-a0a69f4a1cf9 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:27.202890 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243cfa6a-00bb-4885-82e0-a28c35580e98 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:27.207599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 469/932] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:21:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:27.209051 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9450646-ae1a-4013-8f32-1d5b6ea37a67 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:27.209500 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9450646-ae1a-4013-8f32-1d5b6ea37a67 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:27.209956 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9450646-ae1a-4013-8f32-1d5b6ea37a67 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:27.211311 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 470/933] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:27.213081 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9450646-ae1a-4013-8f32-1d5b6ea37a67 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:27.243269 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6d828-e1e6-4b1a-b1fb-663f2d4eb1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:27.244009 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6d828-e1e6-4b1a-b1fb-663f2d4eb1c4 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:27.245043 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6d828-e1e6-4b1a-b1fb-663f2d4eb1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:27.245154 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6d828-e1e6-4b1a-b1fb-663f2d4eb1c4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:27.246007 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6d828-e1e6-4b1a-b1fb-663f2d4eb1c4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:27.247449 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6d828-e1e6-4b1a-b1fb-663f2d4eb1c4 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:27.259873 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-82a6d828-e1e6-4b1a-b1fb-663f2d4eb1c4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 09:21:27.259873 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:27.259873 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 09:21:27.259873 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 09:21:27.259873 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 09:21:27.259873 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 09:21:27.259873 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 09:21:27.259873 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:27.259873 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 09:21:27.259873 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:27.259873 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 09:21:27.259873 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:27.259873 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:27.259873 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:27.259873 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:27.259873 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:27.259873 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:27.260910 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:27.260910 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:27.260910 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:27.260910 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:27.260910 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:27.260910 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:27.260910 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 09:21:27.260910 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 09:21:27.260910 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 09:21:27.260910 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 09:21:27.260910 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:27.260910 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:27.260910 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:27.260910 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:27.260910 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:27.260910 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:27.261839 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:27.261839 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:27.261839 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:27.261839 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:27.261839 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:27.261839 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:27.261839 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:27.261839 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:27.261839 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:27.261839 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:27.261839 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 09:21:27.261839 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:27.261839 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 09:21:27.261839 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:27.261839 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 464/934] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 12 09:21:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:27.262711 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94d1b5-ab63-481d-9c84-41041371ada0 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:27.262711 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94d1b5-ab63-481d-9c84-41041371ada0 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:27.263362 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94d1b5-ab63-481d-9c84-41041371ada0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:27.279012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-5a94d1b5-ab63-481d-9c84-41041371ada0 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:27.280269 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-5a94d1b5-ab63-481d-9c84-41041371ada0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:27.319391 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9450646-ae1a-4013-8f32-1d5b6ea37a67 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:27.346964 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 465/935] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:21:27.348095 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94d1b5-ab63-481d-9c84-41041371ada0 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:27.366665 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30c88b-f092-4148-9315-f71a05d5f927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:27.367937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30c88b-f092-4148-9315-f71a05d5f927 None admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:27.368399 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30c88b-f092-4148-9315-f71a05d5f927 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:27.368853 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30c88b-f092-4148-9315-f71a05d5f927 None admin] PATH_INFO: `/v3/projects/9cf4f2954dd44516b3e594ed440781cc/users/bd41f419750140268f4d4b77456065c2/roles/ee3dbb0fb690434ca94adf68e3148ab2` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:27.371999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30c88b-f092-4148-9315-f71a05d5f927 None admin] RBAC: Authorizing `identity:create_grant(project_id=9cf4f2954dd44516b3e594ed440781cc, user_id=bd41f419750140268f4d4b77456065c2, role_id=ee3dbb0fb690434ca94adf68e3148ab2)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:27.373705 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30c88b-f092-4148-9315-f71a05d5f927 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:27.389029 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 471/936] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 12 09:21:27 2022] PUT /identity/v3/projects/9cf4f2954dd44516b3e594ed440781cc/users/bd41f419750140268f4d4b77456065c2/roles/ee3dbb0fb690434ca94adf68e3148ab2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:21:27.395023 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30c88b-f092-4148-9315-f71a05d5f927 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:27.472550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94d1b5-ab63-481d-9c84-41041371ada0 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:27.523024 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd5629-2423-47bd-97cc-c1f46b3f2a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:27.523622 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd5629-2423-47bd-97cc-c1f46b3f2a54 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:27.523906 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd5629-2423-47bd-97cc-c1f46b3f2a54 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:27.524181 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd5629-2423-47bd-97cc-c1f46b3f2a54 None admin] PATH_INFO: `/v3/services` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:27.524911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd5629-2423-47bd-97cc-c1f46b3f2a54 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:27.525219 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd5629-2423-47bd-97cc-c1f46b3f2a54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:27.526878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd5629-2423-47bd-97cc-c1f46b3f2a54 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:27.536917 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 466/937] 10.222.0.60 () {56 vars in 1122 bytes} [Thu May 12 09:21:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:27.538188 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd5629-2423-47bd-97cc-c1f46b3f2a54 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:27.550348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30c88b-f092-4148-9315-f71a05d5f927 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:27.588561 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da47b17-ac40-41ea-81c9-065133e9270d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:27.589771 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da47b17-ac40-41ea-81c9-065133e9270d None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:27.590314 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da47b17-ac40-41ea-81c9-065133e9270d None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:27.590783 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da47b17-ac40-41ea-81c9-065133e9270d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:27.591633 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da47b17-ac40-41ea-81c9-065133e9270d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:27.593200 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da47b17-ac40-41ea-81c9-065133e9270d None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:27.606124 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-1da47b17-ac40-41ea-81c9-065133e9270d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 09:21:27.606124 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:27.606124 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 09:21:27.606124 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 09:21:27.606124 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 09:21:27.606124 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 09:21:27.606124 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 09:21:27.606124 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:27.606124 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 09:21:27.606124 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:27.606124 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 09:21:27.606124 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:27.606124 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:27.606124 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:27.606124 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:27.606124 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:27.607148 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:27.607148 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:27.607148 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:27.607148 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:27.607148 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:27.607148 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:27.607148 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:27.607148 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 09:21:27.607148 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 09:21:27.607148 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 09:21:27.607148 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 09:21:27.607148 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:27.607148 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:27.607148 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:27.607148 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:27.607148 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:27.608011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:27.608011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:27.608011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:27.608011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:27.608011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:27.608011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:27.608011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:27.608011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:27.608011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:27.608011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:27.608011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:27.608011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 09:21:27.608011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:27.608011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 09:21:27.608011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:27.608814 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 472/938] 10.222.0.60 () {56 vars in 1132 bytes} [Thu May 12 09:21:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:27.616264 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da47b17-ac40-41ea-81c9-065133e9270d None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:27.689435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd5629-2423-47bd-97cc-c1f46b3f2a54 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:27.740480 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc4feb-a482-4cf6-9ccc-53c0a60efe17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:27.741321 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc4feb-a482-4cf6-9ccc-53c0a60efe17 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:27.741608 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc4feb-a482-4cf6-9ccc-53c0a60efe17 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:27.742145 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc4feb-a482-4cf6-9ccc-53c0a60efe17 None admin] PATH_INFO: `/v3/services` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:27.743110 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc4feb-a482-4cf6-9ccc-53c0a60efe17 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:27.743825 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc4feb-a482-4cf6-9ccc-53c0a60efe17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:27.746893 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc4feb-a482-4cf6-9ccc-53c0a60efe17 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:27.748737 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da47b17-ac40-41ea-81c9-065133e9270d None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:27.753651 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 467/939] 10.222.0.60 () {56 vars in 1122 bytes} [Thu May 12 09:21:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:27.763184 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc4feb-a482-4cf6-9ccc-53c0a60efe17 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:27.789479 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c424cb-e176-4b2b-8d50-4aca4f27dfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:27.792322 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c424cb-e176-4b2b-8d50-4aca4f27dfb5 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:27.793024 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c424cb-e176-4b2b-8d50-4aca4f27dfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:27.794157 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c424cb-e176-4b2b-8d50-4aca4f27dfb5 None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:27.795579 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c424cb-e176-4b2b-8d50-4aca4f27dfb5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:27.796636 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c424cb-e176-4b2b-8d50-4aca4f27dfb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:27.798756 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c424cb-e176-4b2b-8d50-4aca4f27dfb5 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:27.810731 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 473/940] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 12 09:21:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:27.816233 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c424cb-e176-4b2b-8d50-4aca4f27dfb5 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:27.888108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc4feb-a482-4cf6-9ccc-53c0a60efe17 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:27.936351 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c424cb-e176-4b2b-8d50-4aca4f27dfb5 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:27.942266 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbd47b-7654-4558-b202-7d17e4363ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:27.943180 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbd47b-7654-4558-b202-7d17e4363ac9 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:27.943637 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbd47b-7654-4558-b202-7d17e4363ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:27.944507 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbd47b-7654-4558-b202-7d17e4363ac9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:27.945473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbd47b-7654-4558-b202-7d17e4363ac9 None admin] RBAC: Adding query filter params (interface=public, service_id=135ed03a480c481aba97206d3fe5d817, region_id=RegionOne) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:27.946006 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbd47b-7654-4558-b202-7d17e4363ac9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:27.948145 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbd47b-7654-4558-b202-7d17e4363ac9 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:27.960438 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 468/941] 10.222.0.60 () {56 vars in 1251 bytes} [Thu May 12 09:21:27 2022] GET /identity/v3/endpoints?service_id=135ed03a480c481aba97206d3fe5d817&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:27.962350 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbd47b-7654-4558-b202-7d17e4363ac9 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:27.979925 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d27dc-9358-4948-afba-fc7b9e721f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:27.980753 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d27dc-9358-4948-afba-fc7b9e721f88 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:27.980983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d27dc-9358-4948-afba-fc7b9e721f88 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:27.981276 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d27dc-9358-4948-afba-fc7b9e721f88 None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:27.982209 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d27dc-9358-4948-afba-fc7b9e721f88 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:27.982524 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d27dc-9358-4948-afba-fc7b9e721f88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:27.983970 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d27dc-9358-4948-afba-fc7b9e721f88 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:27.994054 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 474/942] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 12 09:21:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:27.996349 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d27dc-9358-4948-afba-fc7b9e721f88 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:28.106099 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbd47b-7654-4558-b202-7d17e4363ac9 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:28.106974 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d27dc-9358-4948-afba-fc7b9e721f88 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:28.141775 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e12ac5-8f54-45f8-b475-081d21678a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:28.143042 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e12ac5-8f54-45f8-b475-081d21678a25 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:28.143520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e12ac5-8f54-45f8-b475-081d21678a25 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:28.143981 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35356919-45a0-4ddc-867e-af2b41ecda1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:28.144219 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e12ac5-8f54-45f8-b475-081d21678a25 None admin] PATH_INFO: `/v3/services` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:28.144642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35356919-45a0-4ddc-867e-af2b41ecda1c None admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:28.144926 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35356919-45a0-4ddc-867e-af2b41ecda1c None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:28.145202 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35356919-45a0-4ddc-867e-af2b41ecda1c None admin] PATH_INFO: `/v3/endpoints` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:28.145728 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e12ac5-8f54-45f8-b475-081d21678a25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:28.146046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35356919-45a0-4ddc-867e-af2b41ecda1c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:28.147487 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35356919-45a0-4ddc-867e-af2b41ecda1c None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:28.147678 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e12ac5-8f54-45f8-b475-081d21678a25 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:28.158319 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 469/943] 10.222.0.60 () {56 vars in 1087 bytes} [Thu May 12 09:21:27 2022] GET /identity/v3/services => generated 1497 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 09:21:28.177416 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 475/944] 10.222.0.60 () {60 vars in 1144 bytes} [Thu May 12 09:21:27 2022] POST /identity/v3/endpoints => generated 347 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:21:28.694764 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67ba15-a58f-4a19-aaef-68d7275b766e None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:28.695293 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67ba15-a58f-4a19-aaef-68d7275b766e None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:28.695293 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67ba15-a58f-4a19-aaef-68d7275b766e None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:28.696923 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 470/945] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:28.703123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb87ba7-084e-4201-bd82-848bd3351848 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:28.703562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb87ba7-084e-4201-bd82-848bd3351848 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:28.703720 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb87ba7-084e-4201-bd82-848bd3351848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:28.721456 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-2fb87ba7-084e-4201-bd82-848bd3351848 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:28.722663 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-2fb87ba7-084e-4201-bd82-848bd3351848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:28.811606 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 476/946] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 09:21:28.848162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67ba15-a58f-4a19-aaef-68d7275b766e None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:28.970472 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67ba15-a58f-4a19-aaef-68d7275b766e None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:29.006397 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323369a1-d044-4a71-b196-de4fc45296ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:29.007388 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323369a1-d044-4a71-b196-de4fc45296ac None admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:29.007843 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323369a1-d044-4a71-b196-de4fc45296ac None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:29.008312 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323369a1-d044-4a71-b196-de4fc45296ac None admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:29.009184 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323369a1-d044-4a71-b196-de4fc45296ac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:29.010835 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323369a1-d044-4a71-b196-de4fc45296ac None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:29.012366 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: WARNING keystone.server.flask.common [None req-323369a1-d044-4a71-b196-de4fc45296ac None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 12 09:21:29.030993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.sql.core [None req-323369a1-d044-4a71-b196-de4fc45296ac None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 09:21:29.030993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 12 09:21:29.030993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [parameters: {'id': '8db1215e5b944939b4781d038ddce32a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 12 09:21:29.030993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79816) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 12 09:21:29.050190 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-323369a1-d044-4a71-b196-de4fc45296ac None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8db1215e5b944939b4781d038ddce32a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8db1215e5b944939b4781d038ddce32a. May 12 09:21:29.050190 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:29.050190 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 09:21:29.050190 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 09:21:29.050190 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 09:21:29.050190 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 09:21:29.050190 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 09:21:29.050190 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application result = self._query(query) May 12 09:21:29.050190 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 09:21:29.050190 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application conn.query(q) May 12 09:21:29.050190 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 09:21:29.050190 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 09:21:29.050190 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 09:21:29.051094 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application result.read() May 12 09:21:29.051094 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 09:21:29.051094 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 09:21:29.051094 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 09:21:29.051094 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 09:21:29.051094 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 09:21:29.051094 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 09:21:29.051094 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 09:21:29.051094 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 09:21:29.051094 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 09:21:29.051094 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:29.051094 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 12 09:21:29.051094 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:29.051094 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:29.051094 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 12 09:21:29.051094 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 12 09:21:29.051094 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 12 09:21:29.051094 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return project_ref.to_dict() May 12 09:21:29.052175 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 09:21:29.052175 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application next(self.gen) May 12 09:21:29.052175 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 12 09:21:29.052175 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application yield resource May 12 09:21:29.052175 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 09:21:29.052175 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application next(self.gen) May 12 09:21:29.052175 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 12 09:21:29.052175 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self.session.rollback() May 12 09:21:29.052175 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 09:21:29.052175 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self.force_reraise() May 12 09:21:29.052175 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 09:21:29.052175 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise self.value May 12 09:21:29.052175 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 12 09:21:29.052175 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 12 09:21:29.052175 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 12 09:21:29.052175 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application session.commit() May 12 09:21:29.052175 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 12 09:21:29.053071 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 12 09:21:29.053071 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 12 09:21:29.053071 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self._prepare_impl() May 12 09:21:29.053071 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 12 09:21:29.053071 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self.session.flush() May 12 09:21:29.053071 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 12 09:21:29.053071 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self._flush(objects) May 12 09:21:29.053071 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 12 09:21:29.053071 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 12 09:21:29.053071 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 12 09:21:29.053071 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application compat.raise_( May 12 09:21:29.053071 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 09:21:29.053071 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception May 12 09:21:29.053071 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 12 09:21:29.053071 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application flush_context.execute() May 12 09:21:29.053071 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 12 09:21:29.053071 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rec.execute(self) May 12 09:21:29.054127 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 12 09:21:29.054127 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 12 09:21:29.054127 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 12 09:21:29.054127 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application _emit_insert_statements( May 12 09:21:29.054127 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 12 09:21:29.054127 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application c = connection._execute_20( May 12 09:21:29.054127 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 12 09:21:29.054127 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 12 09:21:29.054127 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 12 09:21:29.054127 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 12 09:21:29.054127 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 12 09:21:29.054127 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ret = self._execute_context( May 12 09:21:29.054127 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 12 09:21:29.054127 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 12 09:21:29.054127 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 12 09:21:29.054957 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 12 09:21:29.054957 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 09:21:29.054957 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception May 12 09:21:29.054957 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 09:21:29.054957 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 09:21:29.054957 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 09:21:29.054957 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 09:21:29.054957 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 09:21:29.054957 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application result = self._query(query) May 12 09:21:29.054957 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 09:21:29.054957 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application conn.query(q) May 12 09:21:29.054957 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 09:21:29.054957 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 09:21:29.054957 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 09:21:29.054957 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application result.read() May 12 09:21:29.054957 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 09:21:29.054957 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 09:21:29.055878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 09:21:29.055878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 09:21:29.055878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 09:21:29.055878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 09:21:29.055878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 09:21:29.055878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 09:21:29.055878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 09:21:29.055878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 12 09:21:29.055878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [parameters: {'id': '8db1215e5b944939b4781d038ddce32a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 12 09:21:29.055878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 12 09:21:29.055878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:29.055878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 09:21:29.055878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:29.055878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:29.055878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 12 09:21:29.056771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 12 09:21:29.056771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 12 09:21:29.056771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 12 09:21:29.056771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 12 09:21:29.056771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:29.056771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 09:21:29.056771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:29.056771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:29.056771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:29.056771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:29.056771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:29.056771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:29.056771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:29.056771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:29.056771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:29.056771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:29.056771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:29.057743 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:29.057743 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 12 09:21:29.057743 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 12 09:21:29.057743 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:29.057743 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:29.057743 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 12 09:21:29.057743 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.Conflict( May 12 09:21:29.057743 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8db1215e5b944939b4781d038ddce32a. May 12 09:21:29.057743 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:29.060341 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 471/947] 10.222.0.60 () {60 vars in 1140 bytes} [Thu May 12 09:21:28 2022] POST /identity/v3/projects => generated 262 bytes in 213 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:29.066582 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb87ba7-084e-4201-bd82-848bd3351848 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:29.183971 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb87ba7-084e-4201-bd82-848bd3351848 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:29.217774 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8923ec-475b-495c-9b46-399db5645a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:29.218878 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8923ec-475b-495c-9b46-399db5645a5b None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:29.219334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8923ec-475b-495c-9b46-399db5645a5b None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:29.219800 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8923ec-475b-495c-9b46-399db5645a5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:29.226965 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8923ec-475b-495c-9b46-399db5645a5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:29.228645 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8923ec-475b-495c-9b46-399db5645a5b None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:29.244280 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-4b8923ec-475b-495c-9b46-399db5645a5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:29.244280 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:29.244280 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:29.244280 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:29.244280 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:29.244280 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:29.244280 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:29.244280 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:29.244280 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:29.244280 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:29.244280 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:29.244280 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:29.244280 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:21:29.244280 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:21:29.244280 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:21:29.245275 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:21:29.245275 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:29.245275 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:29.245275 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:29.245275 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:29.245275 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:29.245275 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:29.245275 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:29.245275 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:29.245275 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:29.245275 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:29.245275 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:29.245275 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:29.245275 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:29.245275 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:29.245275 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:29.245275 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:29.246200 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:21:29.246200 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:21:29.246200 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:21:29.246200 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:21:29.246200 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:21:29.246200 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:21:29.246200 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:29.246200 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:29.248431 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 477/948] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:21:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:29.255714 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323369a1-d044-4a71-b196-de4fc45296ac None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:29.360551 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323369a1-d044-4a71-b196-de4fc45296ac None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:29.398808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3aab4-098d-4d1d-a30c-22b48d76e037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:29.399497 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3aab4-098d-4d1d-a30c-22b48d76e037 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:29.399780 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3aab4-098d-4d1d-a30c-22b48d76e037 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:29.400107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3aab4-098d-4d1d-a30c-22b48d76e037 None admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:29.400995 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3aab4-098d-4d1d-a30c-22b48d76e037 None admin] RBAC: Adding query filter params (name=service) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:29.401305 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3aab4-098d-4d1d-a30c-22b48d76e037 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:29.403038 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3aab4-098d-4d1d-a30c-22b48d76e037 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:29.430018 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 472/949] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 12 09:21:29 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:29.894667 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeae8d8-770b-4dd3-95cf-b1b1b6c881c8 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:29.895230 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeae8d8-770b-4dd3-95cf-b1b1b6c881c8 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:29.895230 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeae8d8-770b-4dd3-95cf-b1b1b6c881c8 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:29.896781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 478/950] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:29.902817 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f73234-ebcd-43f9-973e-15f926d66b5d None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:29.903250 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f73234-ebcd-43f9-973e-15f926d66b5d None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:29.903350 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f73234-ebcd-43f9-973e-15f926d66b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:29.920945 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-c3f73234-ebcd-43f9-973e-15f926d66b5d None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:29.922444 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-c3f73234-ebcd-43f9-973e-15f926d66b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:29.991959 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 473/951] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:21:30.015313 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeae8d8-770b-4dd3-95cf-b1b1b6c881c8 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:30.137114 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeae8d8-770b-4dd3-95cf-b1b1b6c881c8 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:30.171246 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a823a-8048-4e26-bbe9-5859d7926ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:30.172296 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a823a-8048-4e26-bbe9-5859d7926ae6 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:30.172742 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a823a-8048-4e26-bbe9-5859d7926ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:30.173163 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a823a-8048-4e26-bbe9-5859d7926ae6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:30.184097 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a823a-8048-4e26-bbe9-5859d7926ae6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:21:30.192327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-918a823a-8048-4e26-bbe9-5859d7926ae6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 09:21:30.192327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:30.192327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:30.192327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:30.192327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:30.192327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:30.192327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:30.192327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:30.192327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:30.192327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:30.192327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:30.192327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:30.192327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:21:30.192327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:21:30.192327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:21:30.192327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:21:30.193457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:21:30.193457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:21:30.193457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:21:30.193457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:21:30.193457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:30.193457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:30.193457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:30.193457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:30.193457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:30.193457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:30.193457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:30.193457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:30.193457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:30.193457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:30.193457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:30.193457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:30.194519 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:30.194519 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:30.194519 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:30.194519 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:30.194519 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:21:30.194519 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:21:30.194519 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:21:30.194519 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:21:30.194519 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:21:30.194519 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:21:30.194519 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 09:21:30.194519 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:30.196866 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 479/952] 10.222.0.60 () {56 vars in 1120 bytes} [Thu May 12 09:21:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:30.206912 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f73234-ebcd-43f9-973e-15f926d66b5d None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:30.300683 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f73234-ebcd-43f9-973e-15f926d66b5d None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:30.337587 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d87b8-dd73-4ff2-94ce-f1aec48e8033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:30.338436 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d87b8-dd73-4ff2-94ce-f1aec48e8033 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:30.338706 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d87b8-dd73-4ff2-94ce-f1aec48e8033 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:30.338979 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d87b8-dd73-4ff2-94ce-f1aec48e8033 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:30.339742 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d87b8-dd73-4ff2-94ce-f1aec48e8033 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:30.340046 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d87b8-dd73-4ff2-94ce-f1aec48e8033 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:30.341457 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d87b8-dd73-4ff2-94ce-f1aec48e8033 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:30.352179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 474/953] 10.222.0.60 () {56 vars in 1115 bytes} [Thu May 12 09:21:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:30.356273 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a823a-8048-4e26-bbe9-5859d7926ae6 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:30.458814 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a823a-8048-4e26-bbe9-5859d7926ae6 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:30.499575 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed53cf-1bfe-46d1-b1a9-f44cd13b05fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:30.500373 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed53cf-1bfe-46d1-b1a9-f44cd13b05fa None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:30.500651 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed53cf-1bfe-46d1-b1a9-f44cd13b05fa None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:30.500920 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed53cf-1bfe-46d1-b1a9-f44cd13b05fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:30.511497 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00d2b2-6ee7-4c92-adb7-7b07bc961234 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:30.511783 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00d2b2-6ee7-4c92-adb7-7b07bc961234 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:30.512062 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00d2b2-6ee7-4c92-adb7-7b07bc961234 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:30.512363 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed53cf-1bfe-46d1-b1a9-f44cd13b05fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:30.513649 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 475/954] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:21:30.513842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed53cf-1bfe-46d1-b1a9-f44cd13b05fa None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:30.518464 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b20f2-8e0b-4cd5-968e-73d5ca88f89b None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:30.518746 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b20f2-8e0b-4cd5-968e-73d5ca88f89b None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:30.519019 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b20f2-8e0b-4cd5-968e-73d5ca88f89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:30.531484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-fbed53cf-1bfe-46d1-b1a9-f44cd13b05fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:30.531484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:30.531484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:30.531484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:30.531484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:30.531484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:30.531484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:30.531484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:30.531484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:30.531484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:30.531484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:30.531484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:30.531484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:21:30.531484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:21:30.531484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:21:30.532425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:21:30.532425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:30.532425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:30.532425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:30.532425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:30.532425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:30.532425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:30.532425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:30.532425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:30.532425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:30.532425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:30.532425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:30.532425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:30.532425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:30.532425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:30.532425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:30.532425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:30.533334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:21:30.533334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:21:30.533334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:30.533334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:30.533334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 480/955] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:30.537860 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-415b20f2-8e0b-4cd5-968e-73d5ca88f89b None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:30.538546 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed53cf-1bfe-46d1-b1a9-f44cd13b05fa None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:30.539497 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-415b20f2-8e0b-4cd5-968e-73d5ca88f89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:30.611891 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 476/956] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 09:21:30.613194 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe8213-b73d-4820-bcbe-825e5d452411 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:30.613519 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe8213-b73d-4820-bcbe-825e5d452411 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:30.613760 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe8213-b73d-4820-bcbe-825e5d452411 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:30.615317 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 477/957] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:30.622233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec995e-8261-4090-bd62-ba56f985ef99 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:30.622629 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec995e-8261-4090-bd62-ba56f985ef99 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:30.623007 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec995e-8261-4090-bd62-ba56f985ef99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:30.641366 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-48ec995e-8261-4090-bd62-ba56f985ef99 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:30.642636 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-48ec995e-8261-4090-bd62-ba56f985ef99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:30.660989 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed53cf-1bfe-46d1-b1a9-f44cd13b05fa None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:30.695209 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a2d7f-39b3-4bf4-9939-0f4232aa602d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:30.695872 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a2d7f-39b3-4bf4-9939-0f4232aa602d None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:30.696154 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a2d7f-39b3-4bf4-9939-0f4232aa602d None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:30.696429 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a2d7f-39b3-4bf4-9939-0f4232aa602d None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:30.697156 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a2d7f-39b3-4bf4-9939-0f4232aa602d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:30.698005 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a2d7f-39b3-4bf4-9939-0f4232aa602d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:30.699373 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a2d7f-39b3-4bf4-9939-0f4232aa602d None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:30.714664 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 481/958] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:30.715458 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a2d7f-39b3-4bf4-9939-0f4232aa602d None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:30.719804 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 478/959] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:21:30.720625 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec995e-8261-4090-bd62-ba56f985ef99 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:30.817963 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec995e-8261-4090-bd62-ba56f985ef99 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:30.830492 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a2d7f-39b3-4bf4-9939-0f4232aa602d None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:30.850749 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db13d9-6d03-4d49-9063-f06a393457b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:30.851870 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db13d9-6d03-4d49-9063-f06a393457b5 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:30.852352 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db13d9-6d03-4d49-9063-f06a393457b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:30.852826 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db13d9-6d03-4d49-9063-f06a393457b5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:30.861453 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db13d9-6d03-4d49-9063-f06a393457b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:30.863534 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db13d9-6d03-4d49-9063-f06a393457b5 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:30.863657 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7039b3a-6d49-41ba-8bdd-383b86f3e89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:30.864327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7039b3a-6d49-41ba-8bdd-383b86f3e89e None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:30.864603 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7039b3a-6d49-41ba-8bdd-383b86f3e89e None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:30.864882 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7039b3a-6d49-41ba-8bdd-383b86f3e89e None admin] PATH_INFO: `/v3/services/compute` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:30.865508 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7039b3a-6d49-41ba-8bdd-383b86f3e89e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:30.867237 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7039b3a-6d49-41ba-8bdd-383b86f3e89e None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:30.880934 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-e7039b3a-6d49-41ba-8bdd-383b86f3e89e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 09:21:30.880934 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:30.880934 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 09:21:30.880934 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 09:21:30.880934 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 09:21:30.880934 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 09:21:30.880934 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 09:21:30.880934 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:30.880934 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 09:21:30.880934 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:30.880934 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 09:21:30.880934 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:30.880934 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:30.880934 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:30.880934 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:30.880934 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:30.880934 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:30.882178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:30.882178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:30.882178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:30.882178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:30.882178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:30.882178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:30.882178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 09:21:30.882178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 09:21:30.882178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 09:21:30.882178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 09:21:30.882178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:30.882178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:30.882178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:30.882178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:30.882178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:30.882178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:30.884169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:30.884169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:30.884169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:30.884169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:30.884169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:30.884169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:30.884169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:30.884169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:30.884169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:30.884169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:30.884169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 09:21:30.884169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:30.884169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 09:21:30.884169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:30.885445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-21db13d9-6d03-4d49-9063-f06a393457b5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 09:21:30.885445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:30.885445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:30.885445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:30.885445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:30.885445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:30.885445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:30.885445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:30.885445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:30.885445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:30.885445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:30.885445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:30.885445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:21:30.885445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:21:30.885445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:21:30.885445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:21:30.888266 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:30.888266 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:30.888266 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:21:30.888266 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:30.888266 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:21:30.888266 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:30.888266 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:30.888266 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:30.888266 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:30.888266 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:30.888266 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:30.888266 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:30.888266 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:30.888266 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:30.888266 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:30.888266 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:30.888266 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:30.888266 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:30.890897 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:30.890897 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:30.890897 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:21:30.890897 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:21:30.890897 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:21:30.890897 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:21:30.890897 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:21:30.890897 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:21:30.890897 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 09:21:30.890897 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:30.892283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 482/960] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:21:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:30.892283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7039b3a-6d49-41ba-8bdd-383b86f3e89e None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:30.892562 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 479/961] 10.222.0.60 () {56 vars in 1117 bytes} [Thu May 12 09:21:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:30.892562 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db13d9-6d03-4d49-9063-f06a393457b5 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:30.988576 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7039b3a-6d49-41ba-8bdd-383b86f3e89e None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:30.989108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db13d9-6d03-4d49-9063-f06a393457b5 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:31.021582 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c96ad-2b33-412f-9942-6709c91152cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:31.022415 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c96ad-2b33-412f-9942-6709c91152cc None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:31.022690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c96ad-2b33-412f-9942-6709c91152cc None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:31.022959 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c96ad-2b33-412f-9942-6709c91152cc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:31.023598 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c96ad-2b33-412f-9942-6709c91152cc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:31.024982 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c96ad-2b33-412f-9942-6709c91152cc None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:31.026091 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2cd30-3969-47b2-9ae5-729365514119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:31.026927 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2cd30-3969-47b2-9ae5-729365514119 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:31.027466 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2cd30-3969-47b2-9ae5-729365514119 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:31.027771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2cd30-3969-47b2-9ae5-729365514119 None admin] PATH_INFO: `/v3/services` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:31.028754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2cd30-3969-47b2-9ae5-729365514119 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:31.029061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2cd30-3969-47b2-9ae5-729365514119 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:31.030436 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2cd30-3969-47b2-9ae5-729365514119 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:31.039690 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 480/962] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 12 09:21:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:31.039690 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2cd30-3969-47b2-9ae5-729365514119 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:31.039912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-ff5c96ad-2b33-412f-9942-6709c91152cc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 09:21:31.039912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:31.039912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 09:21:31.039912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 09:21:31.039912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 09:21:31.039912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 09:21:31.039912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 09:21:31.039912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:31.039912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 09:21:31.039912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:31.039912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 09:21:31.039912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:31.039912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:31.039912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:31.039912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:31.039912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:31.039912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:31.040840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:31.040840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:31.040840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:31.040840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:31.040840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:31.040840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:31.040840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 09:21:31.040840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 09:21:31.040840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 09:21:31.040840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 09:21:31.040840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:31.040840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:31.040840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:31.040840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:31.040840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:31.040840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:31.042271 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:31.042271 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:31.042271 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:31.042271 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:31.042271 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:31.042271 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:31.042271 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:31.042271 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:31.042271 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:31.042271 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:31.042271 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 09:21:31.042271 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:31.042271 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 09:21:31.042271 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:31.042271 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 483/963] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 12 09:21:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:31.043076 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c96ad-2b33-412f-9942-6709c91152cc None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:31.142579 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c96ad-2b33-412f-9942-6709c91152cc None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:31.147660 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2cd30-3969-47b2-9ae5-729365514119 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:31.175308 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f6c9e-6e53-4418-8182-1a1ffd4dfd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:31.176265 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f6c9e-6e53-4418-8182-1a1ffd4dfd7f None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:31.176545 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f6c9e-6e53-4418-8182-1a1ffd4dfd7f None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:31.176871 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f6c9e-6e53-4418-8182-1a1ffd4dfd7f None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:31.177571 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f6c9e-6e53-4418-8182-1a1ffd4dfd7f None admin] RBAC: Adding query filter params (type=compute) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:31.177968 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f6c9e-6e53-4418-8182-1a1ffd4dfd7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:31.179267 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f6c9e-6e53-4418-8182-1a1ffd4dfd7f None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:31.180958 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed7a86-f73e-4df0-9401-23e3c7ad6e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:31.181623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed7a86-f73e-4df0-9401-23e3c7ad6e7c None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:31.182468 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed7a86-f73e-4df0-9401-23e3c7ad6e7c None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:31.182744 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed7a86-f73e-4df0-9401-23e3c7ad6e7c None admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:31.183565 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed7a86-f73e-4df0-9401-23e3c7ad6e7c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:31.183867 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed7a86-f73e-4df0-9401-23e3c7ad6e7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:31.194292 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 484/964] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 12 09:21:31 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:31.194504 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed7a86-f73e-4df0-9401-23e3c7ad6e7c None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:31.194602 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f6c9e-6e53-4418-8182-1a1ffd4dfd7f None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:31.204295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 481/965] 10.222.0.60 () {56 vars in 1149 bytes} [Thu May 12 09:21:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:31.211008 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed7a86-f73e-4df0-9401-23e3c7ad6e7c None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:31.320796 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed7a86-f73e-4df0-9401-23e3c7ad6e7c None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:31.329831 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f6c9e-6e53-4418-8182-1a1ffd4dfd7f None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:31.357389 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17151a6c-ea3f-4b2b-84a1-770d568ef5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:31.358245 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17151a6c-ea3f-4b2b-84a1-770d568ef5a8 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:31.358621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17151a6c-ea3f-4b2b-84a1-770d568ef5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:31.359093 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17151a6c-ea3f-4b2b-84a1-770d568ef5a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:31.368754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3b7b7-4ae6-4e58-8d2e-9ca3dde094d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:31.370292 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3b7b7-4ae6-4e58-8d2e-9ca3dde094d2 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:31.370750 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3b7b7-4ae6-4e58-8d2e-9ca3dde094d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:31.371175 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3b7b7-4ae6-4e58-8d2e-9ca3dde094d2 None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:31.372045 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3b7b7-4ae6-4e58-8d2e-9ca3dde094d2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:31.372508 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3b7b7-4ae6-4e58-8d2e-9ca3dde094d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:31.374196 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3b7b7-4ae6-4e58-8d2e-9ca3dde094d2 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:31.380145 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 485/966] 10.222.0.60 () {56 vars in 1122 bytes} [Thu May 12 09:21:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:31.389398 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3b7b7-4ae6-4e58-8d2e-9ca3dde094d2 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:31.440568 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17151a6c-ea3f-4b2b-84a1-770d568ef5a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:31.442336 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17151a6c-ea3f-4b2b-84a1-770d568ef5a8 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:31.498718 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3b7b7-4ae6-4e58-8d2e-9ca3dde094d2 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:31.533942 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df2e23-6377-44fa-b800-3c7032b919f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:31.534521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df2e23-6377-44fa-b800-3c7032b919f0 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:31.534804 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df2e23-6377-44fa-b800-3c7032b919f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:31.535139 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df2e23-6377-44fa-b800-3c7032b919f0 None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:31.535834 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df2e23-6377-44fa-b800-3c7032b919f0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:31.536142 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df2e23-6377-44fa-b800-3c7032b919f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:31.537505 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df2e23-6377-44fa-b800-3c7032b919f0 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:31.551095 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 486/968] 10.222.0.60 () {56 vars in 1122 bytes} [Thu May 12 09:21:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:31.551271 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 482/968] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:21:31 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 09:21:31.552661 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df2e23-6377-44fa-b800-3c7032b919f0 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:31.553931 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17151a6c-ea3f-4b2b-84a1-770d568ef5a8 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:31.664670 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17151a6c-ea3f-4b2b-84a1-770d568ef5a8 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:31.689369 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df2e23-6377-44fa-b800-3c7032b919f0 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:31.707315 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516ea3d-e378-428d-828b-97a0a22cb37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:31.708463 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516ea3d-e378-428d-828b-97a0a22cb37f None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:31.709397 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516ea3d-e378-428d-828b-97a0a22cb37f None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:31.709891 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516ea3d-e378-428d-828b-97a0a22cb37f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:31.723311 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be883f7d-02f5-4b40-bcfa-1b5709d58dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:31.723987 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be883f7d-02f5-4b40-bcfa-1b5709d58dae None admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:31.724265 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be883f7d-02f5-4b40-bcfa-1b5709d58dae None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:31.724592 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be883f7d-02f5-4b40-bcfa-1b5709d58dae None admin] PATH_INFO: `/v3/endpoints` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:31.725037 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516ea3d-e378-428d-828b-97a0a22cb37f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:31.725386 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be883f7d-02f5-4b40-bcfa-1b5709d58dae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:31.726802 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be883f7d-02f5-4b40-bcfa-1b5709d58dae None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:31.727174 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516ea3d-e378-428d-828b-97a0a22cb37f None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:31.752605 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-8516ea3d-e378-428d-828b-97a0a22cb37f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:31.752605 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:31.752605 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:31.752605 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:31.752605 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:31.752605 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:31.752605 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:31.752605 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:31.752605 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:31.752605 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:31.752605 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:31.752605 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:31.752605 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:21:31.752605 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:21:31.752605 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:21:31.753911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:21:31.753911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:31.753911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:31.753911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:31.753911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:31.753911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:31.753911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:31.753911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:31.753911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:31.753911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:31.753911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:31.753911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:31.753911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:31.753911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:31.753911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:31.753911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:31.753911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:31.754910 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:21:31.754910 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:21:31.754910 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:31.754910 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:31.755138 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 487/969] 10.222.0.60 () {60 vars in 1144 bytes} [Thu May 12 09:21:31 2022] POST /identity/v3/endpoints => generated 349 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:21:31.762799 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 483/970] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:31.765800 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be883f7d-02f5-4b40-bcfa-1b5709d58dae None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:31.794763 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab898597-30ef-4a53-88c1-b8207928c187 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:31.795086 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab898597-30ef-4a53-88c1-b8207928c187 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:31.795323 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab898597-30ef-4a53-88c1-b8207928c187 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:31.796992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 484/971] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:21:31.802466 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf50f9-1974-4bd7-888d-01ce7b081b1e None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:31.802793 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf50f9-1974-4bd7-888d-01ce7b081b1e None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:31.803032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf50f9-1974-4bd7-888d-01ce7b081b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:31.824943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-42bf50f9-1974-4bd7-888d-01ce7b081b1e None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:31.826915 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-42bf50f9-1974-4bd7-888d-01ce7b081b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:31.891927 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be883f7d-02f5-4b40-bcfa-1b5709d58dae None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:31.922778 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 485/972] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:21:31.930008 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ee668-4d54-4bbb-b08a-847f869ec456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:31.930687 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ee668-4d54-4bbb-b08a-847f869ec456 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:31.930972 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ee668-4d54-4bbb-b08a-847f869ec456 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:31.931250 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ee668-4d54-4bbb-b08a-847f869ec456 None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:31.932020 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ee668-4d54-4bbb-b08a-847f869ec456 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:31.932329 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ee668-4d54-4bbb-b08a-847f869ec456 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:31.933782 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ee668-4d54-4bbb-b08a-847f869ec456 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:31.947884 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf50f9-1974-4bd7-888d-01ce7b081b1e None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:31.955465 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 488/973] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:31.961124 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ee668-4d54-4bbb-b08a-847f869ec456 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:32.056525 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf50f9-1974-4bd7-888d-01ce7b081b1e None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:32.087052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ee668-4d54-4bbb-b08a-847f869ec456 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:32.093290 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2ba97-1170-4afd-87d3-8c585aaaac14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:32.094157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2ba97-1170-4afd-87d3-8c585aaaac14 None admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:32.094539 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2ba97-1170-4afd-87d3-8c585aaaac14 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:32.094918 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2ba97-1170-4afd-87d3-8c585aaaac14 None admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:32.095731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2ba97-1170-4afd-87d3-8c585aaaac14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:32.097246 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2ba97-1170-4afd-87d3-8c585aaaac14 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:32.111908 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.sql.core [None req-2ac2ba97-1170-4afd-87d3-8c585aaaac14 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 09:21:32.111908 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 12 09:21:32.111908 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [parameters: {'user_id': '85039958a5104b5fa29f279654e92629', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 12 09:21:32.111908 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79816) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 12 09:21:32.123665 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-2ac2ba97-1170-4afd-87d3-8c585aaaac14 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 12 09:21:32.123665 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:32.123665 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 09:21:32.123665 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 09:21:32.123665 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 09:21:32.123665 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 09:21:32.123665 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 09:21:32.123665 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application result = self._query(query) May 12 09:21:32.123665 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 09:21:32.123665 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application conn.query(q) May 12 09:21:32.123665 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 09:21:32.123665 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 09:21:32.123665 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 09:21:32.123665 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application result.read() May 12 09:21:32.123665 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 09:21:32.124647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 09:21:32.124647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 09:21:32.124647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 09:21:32.124647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 09:21:32.124647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 09:21:32.124647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 09:21:32.124647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 09:21:32.124647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 09:21:32.124647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:32.124647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 12 09:21:32.124647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:32.124647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:32.124647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 12 09:21:32.124647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 12 09:21:32.124647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 12 09:21:32.124647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 12 09:21:32.124647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 09:21:32.124647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application next(self.gen) May 12 09:21:32.125648 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 12 09:21:32.125648 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application yield resource May 12 09:21:32.125648 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 09:21:32.125648 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application next(self.gen) May 12 09:21:32.125648 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 12 09:21:32.125648 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self.session.rollback() May 12 09:21:32.125648 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 09:21:32.125648 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self.force_reraise() May 12 09:21:32.125648 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 09:21:32.125648 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise self.value May 12 09:21:32.125648 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 12 09:21:32.125648 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 12 09:21:32.125648 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 12 09:21:32.125648 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application session.commit() May 12 09:21:32.125648 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 12 09:21:32.125648 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 12 09:21:32.125648 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 12 09:21:32.126689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self._prepare_impl() May 12 09:21:32.126689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 12 09:21:32.126689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self.session.flush() May 12 09:21:32.126689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 12 09:21:32.126689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self._flush(objects) May 12 09:21:32.126689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 12 09:21:32.126689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 12 09:21:32.126689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 12 09:21:32.126689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application compat.raise_( May 12 09:21:32.126689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 09:21:32.126689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception May 12 09:21:32.126689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 12 09:21:32.126689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application flush_context.execute() May 12 09:21:32.126689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 12 09:21:32.126689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rec.execute(self) May 12 09:21:32.126689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 12 09:21:32.126689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 12 09:21:32.133801 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 12 09:21:32.133801 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application _emit_insert_statements( May 12 09:21:32.133801 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 12 09:21:32.133801 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application result = connection._execute_20( May 12 09:21:32.133801 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 12 09:21:32.133801 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 12 09:21:32.133801 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 12 09:21:32.133801 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 12 09:21:32.133801 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 12 09:21:32.133801 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ret = self._execute_context( May 12 09:21:32.133801 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 12 09:21:32.133801 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 12 09:21:32.133801 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 12 09:21:32.133801 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 12 09:21:32.133801 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 09:21:32.133801 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception May 12 09:21:32.135993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 09:21:32.135993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 09:21:32.135993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 09:21:32.135993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 09:21:32.135993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 09:21:32.135993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application result = self._query(query) May 12 09:21:32.135993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 09:21:32.135993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application conn.query(q) May 12 09:21:32.135993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 09:21:32.135993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 09:21:32.135993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 09:21:32.135993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application result.read() May 12 09:21:32.135993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 09:21:32.135993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 09:21:32.135993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 09:21:32.135993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 09:21:32.138234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 09:21:32.138234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 09:21:32.138234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 09:21:32.138234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 09:21:32.138234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 09:21:32.138234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 12 09:21:32.138234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [parameters: {'user_id': '85039958a5104b5fa29f279654e92629', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 12 09:21:32.138234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 12 09:21:32.138234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:32.138234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 09:21:32.138234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:32.138234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:32.138234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:32.138234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:32.138234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:32.140421 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:32.140421 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:32.140421 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:32.140421 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:32.140421 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:32.140421 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:32.140421 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:32.140421 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 12 09:21:32.140421 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 12 09:21:32.140421 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:32.140421 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:32.140421 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:21:32.140421 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:32.140421 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:21:32.140421 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:32.140421 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 12 09:21:32.140421 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 12 09:21:32.142674 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 12 09:21:32.142674 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 12 09:21:32.142674 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 12 09:21:32.142674 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 12 09:21:32.142674 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 12 09:21:32.142674 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:32.142674 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 486/974] 10.222.0.60 () {60 vars in 1131 bytes} [Thu May 12 09:21:31 2022] POST /identity/v3/users => generated 160 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:32.142674 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2ba97-1170-4afd-87d3-8c585aaaac14 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:32.143742 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1793749-bb91-4dea-9fb1-4bc5e119e76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:32.143742 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1793749-bb91-4dea-9fb1-4bc5e119e76b None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:32.143742 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1793749-bb91-4dea-9fb1-4bc5e119e76b None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:32.143742 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1793749-bb91-4dea-9fb1-4bc5e119e76b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:32.153335 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1793749-bb91-4dea-9fb1-4bc5e119e76b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:32.155389 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1793749-bb91-4dea-9fb1-4bc5e119e76b None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:32.170238 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-d1793749-bb91-4dea-9fb1-4bc5e119e76b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:32.170238 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:32.170238 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:32.170238 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:32.170238 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:32.170238 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:32.170238 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:32.170238 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:32.170238 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:32.170238 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:32.170238 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:32.170238 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:32.170238 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:21:32.170238 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:21:32.170238 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:21:32.171187 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:21:32.171187 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:32.171187 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:32.171187 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:32.171187 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:32.171187 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:32.171187 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:32.171187 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:32.171187 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:32.171187 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:32.171187 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:32.171187 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:32.171187 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:32.171187 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:32.171187 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:32.171187 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:32.171187 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:32.172183 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:21:32.172183 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:21:32.172183 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:21:32.172183 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:21:32.172183 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:21:32.172183 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:21:32.172183 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:32.172183 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:32.174773 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 489/975] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:21:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:32.180821 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1793749-bb91-4dea-9fb1-4bc5e119e76b None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:32.259274 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2ba97-1170-4afd-87d3-8c585aaaac14 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:32.300789 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1793749-bb91-4dea-9fb1-4bc5e119e76b None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:32.302028 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b206a-2a0e-40c3-9a0e-d044760a8b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:32.302837 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b206a-2a0e-40c3-9a0e-d044760a8b27 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:32.303120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b206a-2a0e-40c3-9a0e-d044760a8b27 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:32.303397 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b206a-2a0e-40c3-9a0e-d044760a8b27 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:32.313040 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b206a-2a0e-40c3-9a0e-d044760a8b27 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:32.315408 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b206a-2a0e-40c3-9a0e-d044760a8b27 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:32.334674 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-115b206a-2a0e-40c3-9a0e-d044760a8b27 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 09:21:32.334674 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:32.334674 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:32.334674 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:32.334674 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:32.334674 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:32.334674 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:32.334674 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:32.334674 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:32.334674 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:32.334674 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:32.334674 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:32.334674 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:21:32.334674 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:21:32.334674 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:21:32.334674 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:21:32.335682 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:32.335682 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:32.335682 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:21:32.335682 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:32.335682 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:21:32.335682 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:32.335682 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:32.335682 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:32.335682 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:32.335682 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:32.335682 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:32.335682 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:32.335682 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:32.335682 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:32.335682 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:32.335682 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:32.335682 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:32.335682 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:32.336671 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:32.336671 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:32.336671 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:21:32.336671 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:21:32.336671 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:21:32.336671 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:21:32.336671 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:21:32.336671 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:21:32.336671 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 09:21:32.336671 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:32.340897 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 487/976] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:21:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:32.341730 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b206a-2a0e-40c3-9a0e-d044760a8b27 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:32.346421 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9500a2-6a6b-4ded-b853-d7d9e8700bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:32.347368 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9500a2-6a6b-4ded-b853-d7d9e8700bfb None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:32.347863 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9500a2-6a6b-4ded-b853-d7d9e8700bfb None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:32.348335 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9500a2-6a6b-4ded-b853-d7d9e8700bfb None admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:32.349382 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9500a2-6a6b-4ded-b853-d7d9e8700bfb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:32.349924 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9500a2-6a6b-4ded-b853-d7d9e8700bfb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:32.352197 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9500a2-6a6b-4ded-b853-d7d9e8700bfb None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:32.375732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 490/977] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:21:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:32.377825 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9500a2-6a6b-4ded-b853-d7d9e8700bfb None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:32.518450 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9500a2-6a6b-4ded-b853-d7d9e8700bfb None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:32.529971 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b206a-2a0e-40c3-9a0e-d044760a8b27 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:32.593144 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737427dd-5585-4140-b6d9-5069faf02986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:32.594872 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737427dd-5585-4140-b6d9-5069faf02986 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:32.596052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737427dd-5585-4140-b6d9-5069faf02986 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:32.596876 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8681ab4-61ff-4537-9a44-0c547e5ee377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:32.597415 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737427dd-5585-4140-b6d9-5069faf02986 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:32.598472 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737427dd-5585-4140-b6d9-5069faf02986 None admin] RBAC: Adding query filter params (role.id=ee3dbb0fb690434ca94adf68e3148ab2, scope.project.id=9cf4f2954dd44516b3e594ed440781cc, user.id=bd41f419750140268f4d4b77456065c2) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:32.599448 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8681ab4-61ff-4537-9a44-0c547e5ee377 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:32.599957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737427dd-5585-4140-b6d9-5069faf02986 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:32.600436 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8681ab4-61ff-4537-9a44-0c547e5ee377 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:32.601100 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8681ab4-61ff-4537-9a44-0c547e5ee377 None admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:32.602648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737427dd-5585-4140-b6d9-5069faf02986 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:32.603685 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8681ab4-61ff-4537-9a44-0c547e5ee377 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:32.604187 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8681ab4-61ff-4537-9a44-0c547e5ee377 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:32.605801 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8681ab4-61ff-4537-9a44-0c547e5ee377 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:32.630570 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 491/978] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:21:32 2022] GET /identity/v3/role_assignments?user.id=bd41f419750140268f4d4b77456065c2&scope.project.id=9cf4f2954dd44516b3e594ed440781cc&role.id=ee3dbb0fb690434ca94adf68e3148ab2 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:32.670988 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 488/979] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 12 09:21:32 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:33.502606 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb85a80-d0af-45c0-b2ab-deffc50a59d0 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:33.503162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb85a80-d0af-45c0-b2ab-deffc50a59d0 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:33.503162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb85a80-d0af-45c0-b2ab-deffc50a59d0 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:33.504631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 492/980] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:33.510686 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51120b-987d-488b-a6d9-9e0a55ff5ae4 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:33.511084 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51120b-987d-488b-a6d9-9e0a55ff5ae4 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:33.511264 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51120b-987d-488b-a6d9-9e0a55ff5ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:33.527691 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-ea51120b-987d-488b-a6d9-9e0a55ff5ae4 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:33.529164 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-ea51120b-987d-488b-a6d9-9e0a55ff5ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:33.601959 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 489/981] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:21:33.626717 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb85a80-d0af-45c0-b2ab-deffc50a59d0 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:33.722705 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb85a80-d0af-45c0-b2ab-deffc50a59d0 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:33.753783 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72eaa9-2ca9-4922-ad70-c9597094cca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:33.754403 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72eaa9-2ca9-4922-ad70-c9597094cca2 None admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:33.754689 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72eaa9-2ca9-4922-ad70-c9597094cca2 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:33.754963 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72eaa9-2ca9-4922-ad70-c9597094cca2 None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:33.755946 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72eaa9-2ca9-4922-ad70-c9597094cca2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:33.757302 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72eaa9-2ca9-4922-ad70-c9597094cca2 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:33.777937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 493/982] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 12 09:21:33 2022] POST /identity/v3/services => generated 242 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:21:34.063056 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fe9d5-e0bb-4fbd-aade-c98fe56e9d24 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:34.063416 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fe9d5-e0bb-4fbd-aade-c98fe56e9d24 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:34.063594 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fe9d5-e0bb-4fbd-aade-c98fe56e9d24 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:34.065049 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 490/983] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:34.070234 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aedf2d-3315-4ce4-9dd8-b27181ed62d0 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:34.070531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aedf2d-3315-4ce4-9dd8-b27181ed62d0 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:34.070814 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aedf2d-3315-4ce4-9dd8-b27181ed62d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:34.089215 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-c4aedf2d-3315-4ce4-9dd8-b27181ed62d0 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:34.090414 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-c4aedf2d-3315-4ce4-9dd8-b27181ed62d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:34.165271 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 494/984] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:21:34.187775 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fe9d5-e0bb-4fbd-aade-c98fe56e9d24 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:34.283980 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fe9d5-e0bb-4fbd-aade-c98fe56e9d24 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:34.318087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4818a-171b-441d-9a35-4327251fb358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:34.318817 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4818a-171b-441d-9a35-4327251fb358 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:34.319097 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4818a-171b-441d-9a35-4327251fb358 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:34.319369 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4818a-171b-441d-9a35-4327251fb358 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:34.320012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4818a-171b-441d-9a35-4327251fb358 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:34.321390 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4818a-171b-441d-9a35-4327251fb358 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:34.333766 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-e1d4818a-171b-441d-9a35-4327251fb358 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 09:21:34.333766 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:34.333766 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 09:21:34.333766 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 09:21:34.333766 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 09:21:34.333766 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 09:21:34.333766 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 09:21:34.333766 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:34.333766 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 09:21:34.333766 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:34.333766 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 09:21:34.333766 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:34.333766 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:34.333766 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:34.333766 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:34.333766 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:34.333766 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:34.334814 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:34.334814 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:34.334814 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:34.334814 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:34.334814 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:34.334814 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:34.334814 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 09:21:34.334814 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 09:21:34.334814 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 09:21:34.334814 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 09:21:34.334814 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:34.334814 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:34.334814 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:34.334814 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:34.334814 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:34.334814 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:34.335689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:34.335689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:34.335689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:34.335689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:34.335689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:34.335689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:34.335689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:34.335689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:34.335689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:34.335689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:34.335689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 09:21:34.335689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:34.335689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 09:21:34.335689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:34.338336 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 491/985] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 12 09:21:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:34.340957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aedf2d-3315-4ce4-9dd8-b27181ed62d0 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:34.442719 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aedf2d-3315-4ce4-9dd8-b27181ed62d0 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:34.475365 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d717d-4b14-465c-9d00-8a58e2dcfecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:34.476030 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d717d-4b14-465c-9d00-8a58e2dcfecb None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:34.476308 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d717d-4b14-465c-9d00-8a58e2dcfecb None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:34.476624 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d717d-4b14-465c-9d00-8a58e2dcfecb None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:34.477319 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d717d-4b14-465c-9d00-8a58e2dcfecb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:34.477620 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d717d-4b14-465c-9d00-8a58e2dcfecb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:34.479541 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d717d-4b14-465c-9d00-8a58e2dcfecb None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:34.488726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 495/986] 10.222.0.60 () {56 vars in 1122 bytes} [Thu May 12 09:21:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:34.489868 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4818a-171b-441d-9a35-4327251fb358 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:34.585590 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4818a-171b-441d-9a35-4327251fb358 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:34.618177 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca45645-b56e-4d1f-9478-827ea591139f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:34.618889 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca45645-b56e-4d1f-9478-827ea591139f None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:34.619192 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca45645-b56e-4d1f-9478-827ea591139f None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:34.620040 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca45645-b56e-4d1f-9478-827ea591139f None admin] PATH_INFO: `/v3/services` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:34.620789 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca45645-b56e-4d1f-9478-827ea591139f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:34.621093 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca45645-b56e-4d1f-9478-827ea591139f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:34.622489 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca45645-b56e-4d1f-9478-827ea591139f None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:34.634086 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 492/987] 10.222.0.60 () {56 vars in 1122 bytes} [Thu May 12 09:21:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:34.634275 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d717d-4b14-465c-9d00-8a58e2dcfecb None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:34.725523 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d717d-4b14-465c-9d00-8a58e2dcfecb None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:34.758042 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea9e61-1834-42c0-988f-3a727c82df6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:34.758689 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea9e61-1834-42c0-988f-3a727c82df6a None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:34.759086 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea9e61-1834-42c0-988f-3a727c82df6a None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:34.759364 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea9e61-1834-42c0-988f-3a727c82df6a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:34.760173 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea9e61-1834-42c0-988f-3a727c82df6a None admin] RBAC: Adding query filter params (interface=admin, service_id=135ed03a480c481aba97206d3fe5d817, region_id=RegionOne) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:34.760475 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea9e61-1834-42c0-988f-3a727c82df6a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:34.761821 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea9e61-1834-42c0-988f-3a727c82df6a None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:34.772807 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 496/988] 10.222.0.60 () {56 vars in 1249 bytes} [Thu May 12 09:21:34 2022] GET /identity/v3/endpoints?service_id=135ed03a480c481aba97206d3fe5d817&interface=admin®ion_id=RegionOne => generated 193 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:34.773026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca45645-b56e-4d1f-9478-827ea591139f None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:34.872899 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca45645-b56e-4d1f-9478-827ea591139f None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:34.904575 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeeaec0-583f-4163-bc6b-f4c6f8a6003a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:34.905246 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeeaec0-583f-4163-bc6b-f4c6f8a6003a None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:34.905527 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeeaec0-583f-4163-bc6b-f4c6f8a6003a None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:34.905799 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeeaec0-583f-4163-bc6b-f4c6f8a6003a None admin] PATH_INFO: `/v3/services` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:34.906510 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeeaec0-583f-4163-bc6b-f4c6f8a6003a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:34.907908 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeeaec0-583f-4163-bc6b-f4c6f8a6003a None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:34.914923 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 493/989] 10.222.0.60 () {56 vars in 1087 bytes} [Thu May 12 09:21:34 2022] GET /identity/v3/services => generated 1727 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 09:21:34.972422 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95364f6d-58ab-4015-8880-d9f0c90bb918 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:34.972782 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95364f6d-58ab-4015-8880-d9f0c90bb918 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:34.972997 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95364f6d-58ab-4015-8880-d9f0c90bb918 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:34.974650 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 497/990] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:34.980836 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eeb2d7-a827-40d8-b666-d3a541166e71 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:34.981144 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eeb2d7-a827-40d8-b666-d3a541166e71 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:34.981395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eeb2d7-a827-40d8-b666-d3a541166e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:34.998733 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-79eeb2d7-a827-40d8-b666-d3a541166e71 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:34.999961 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-79eeb2d7-a827-40d8-b666-d3a541166e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:35.069664 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 494/991] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:21:35.091714 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95364f6d-58ab-4015-8880-d9f0c90bb918 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:35.198253 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95364f6d-58ab-4015-8880-d9f0c90bb918 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:35.230914 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18e56a-d392-40ca-93b6-e5624345a4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:35.231701 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18e56a-d392-40ca-93b6-e5624345a4e0 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:35.231985 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18e56a-d392-40ca-93b6-e5624345a4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:35.232256 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18e56a-d392-40ca-93b6-e5624345a4e0 None admin] PATH_INFO: `/v3/services/image` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:35.232967 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18e56a-d392-40ca-93b6-e5624345a4e0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:35.234430 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18e56a-d392-40ca-93b6-e5624345a4e0 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:35.246010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-1d18e56a-d392-40ca-93b6-e5624345a4e0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 09:21:35.246010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:35.246010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 09:21:35.246010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 09:21:35.246010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 09:21:35.246010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 09:21:35.246010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 09:21:35.246010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:35.246010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 09:21:35.246010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:35.246010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 09:21:35.246010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:35.246010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:35.246010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:35.246010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:35.246010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:35.246010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:35.247013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:35.247013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:35.247013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:35.247013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:35.247013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:35.247013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:35.247013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 09:21:35.247013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 09:21:35.247013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 09:21:35.247013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 09:21:35.247013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:35.247013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:35.247013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:35.247013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:35.247013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:35.247013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:35.248259 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:35.248259 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:35.248259 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:35.248259 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:35.248259 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:35.248259 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:35.248259 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:35.248259 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:35.248259 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:35.248259 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:35.248259 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 09:21:35.248259 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:35.248259 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 09:21:35.248259 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:35.249976 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 498/992] 10.222.0.60 () {56 vars in 1105 bytes} [Thu May 12 09:21:35 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:35.253352 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eeb2d7-a827-40d8-b666-d3a541166e71 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:35.348537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eeb2d7-a827-40d8-b666-d3a541166e71 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:35.381114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052b966-fd39-4f63-ad4e-6624cbdd5254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:35.381788 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052b966-fd39-4f63-ad4e-6624cbdd5254 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:35.382099 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052b966-fd39-4f63-ad4e-6624cbdd5254 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:35.382386 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052b966-fd39-4f63-ad4e-6624cbdd5254 None admin] PATH_INFO: `/v3/services` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:35.383086 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052b966-fd39-4f63-ad4e-6624cbdd5254 None admin] RBAC: Adding query filter params (name=image) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:35.383391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052b966-fd39-4f63-ad4e-6624cbdd5254 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:35.384757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d052b966-fd39-4f63-ad4e-6624cbdd5254 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:35.394358 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 495/993] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:35.395820 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18e56a-d392-40ca-93b6-e5624345a4e0 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:35.491296 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18e56a-d392-40ca-93b6-e5624345a4e0 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:35.523604 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bc662-4c7d-4d51-9522-fc904583df57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:35.524296 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bc662-4c7d-4d51-9522-fc904583df57 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:35.524582 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bc662-4c7d-4d51-9522-fc904583df57 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:35.524858 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bc662-4c7d-4d51-9522-fc904583df57 None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:35.525620 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8bc662-4c7d-4d51-9522-fc904583df57 None admin] RBAC: Adding query filter params (type=image) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:35.525952 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8bc662-4c7d-4d51-9522-fc904583df57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:35.527333 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8bc662-4c7d-4d51-9522-fc904583df57 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:35.531802 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 499/994] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:35 2022] GET /identity/v3/services?type=image => generated 122 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:36.027382 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd271125-e012-4a05-be20-142ff9942524 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:36.027941 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd271125-e012-4a05-be20-142ff9942524 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:36.027941 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd271125-e012-4a05-be20-142ff9942524 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:36.029261 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 496/995] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:36.034413 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4220f-f64b-4061-b6d5-cdffd97989fd None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:36.034821 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4220f-f64b-4061-b6d5-cdffd97989fd None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:36.034959 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4220f-f64b-4061-b6d5-cdffd97989fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:36.052880 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-ada4220f-f64b-4061-b6d5-cdffd97989fd None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:36.054119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-ada4220f-f64b-4061-b6d5-cdffd97989fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:36.125129 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 500/996] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:36 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:21:36.147146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd271125-e012-4a05-be20-142ff9942524 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:36.242720 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd271125-e012-4a05-be20-142ff9942524 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:36.274950 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62fcb7e-afd6-4f60-8e88-64d850ded1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:36.275821 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fcb7e-afd6-4f60-8e88-64d850ded1a1 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:36.276099 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fcb7e-afd6-4f60-8e88-64d850ded1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:36.276366 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fcb7e-afd6-4f60-8e88-64d850ded1a1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:36.277008 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62fcb7e-afd6-4f60-8e88-64d850ded1a1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:36.278452 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62fcb7e-afd6-4f60-8e88-64d850ded1a1 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:36.289626 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-b62fcb7e-afd6-4f60-8e88-64d850ded1a1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 09:21:36.289626 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:36.289626 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 09:21:36.289626 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 09:21:36.289626 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 09:21:36.289626 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 09:21:36.289626 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 09:21:36.289626 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:36.289626 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 09:21:36.289626 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:36.289626 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 09:21:36.289626 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:36.289626 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:36.289626 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:36.289626 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:36.289626 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:36.289626 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:36.290848 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:36.290848 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:36.290848 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:36.290848 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:36.290848 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:36.290848 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:36.290848 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 09:21:36.290848 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 09:21:36.290848 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 09:21:36.290848 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 09:21:36.290848 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:36.290848 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:36.290848 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:36.290848 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:36.290848 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:36.290848 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:36.292506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:36.292506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:36.292506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:36.292506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:36.292506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:36.292506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:36.292506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:36.292506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:36.292506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:36.292506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:36.292506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 09:21:36.292506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:36.292506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 09:21:36.292506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:36.297218 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4220f-f64b-4061-b6d5-cdffd97989fd None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:36.299167 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 497/997] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:21:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:36.391435 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4220f-f64b-4061-b6d5-cdffd97989fd None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:36.425532 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3457295-cb42-4934-a3ba-cd610fd6015d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:36.426218 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3457295-cb42-4934-a3ba-cd610fd6015d None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:36.426502 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3457295-cb42-4934-a3ba-cd610fd6015d None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:36.426778 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3457295-cb42-4934-a3ba-cd610fd6015d None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:36.427476 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3457295-cb42-4934-a3ba-cd610fd6015d None admin] RBAC: Adding query filter params (name=compute) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:36.427781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3457295-cb42-4934-a3ba-cd610fd6015d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:36.429152 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3457295-cb42-4934-a3ba-cd610fd6015d None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:36.437991 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 501/998] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 12 09:21:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:36.439525 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62fcb7e-afd6-4f60-8e88-64d850ded1a1 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:36.533588 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62fcb7e-afd6-4f60-8e88-64d850ded1a1 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:36.565706 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a4274-ce09-4a97-9e1c-b8741b191072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:36.566701 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a4274-ce09-4a97-9e1c-b8741b191072 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:36.567211 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a4274-ce09-4a97-9e1c-b8741b191072 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:36.567687 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a4274-ce09-4a97-9e1c-b8741b191072 None admin] PATH_INFO: `/v3/services` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:36.568588 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a4274-ce09-4a97-9e1c-b8741b191072 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:36.569092 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a4274-ce09-4a97-9e1c-b8741b191072 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:36.570711 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a4274-ce09-4a97-9e1c-b8741b191072 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:36.575883 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 498/999] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 12 09:21:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:36.581319 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3457295-cb42-4934-a3ba-cd610fd6015d None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:36.680256 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3457295-cb42-4934-a3ba-cd610fd6015d None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:36.713436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b46f0-33bc-490d-b244-c3c53a40ebdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:36.714146 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b46f0-33bc-490d-b244-c3c53a40ebdc None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:36.714429 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b46f0-33bc-490d-b244-c3c53a40ebdc None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:36.714702 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b46f0-33bc-490d-b244-c3c53a40ebdc None admin] PATH_INFO: `/v3/endpoints` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:36.715488 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b46f0-33bc-490d-b244-c3c53a40ebdc None admin] RBAC: Adding query filter params (interface=public, service_id=755c6058652440de96b0be0f3429dccf, region_id=RegionOne) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:36.715798 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b46f0-33bc-490d-b244-c3c53a40ebdc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:36.717162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b46f0-33bc-490d-b244-c3c53a40ebdc None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:36.722183 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 502/1000] 10.222.0.60 () {56 vars in 1251 bytes} [Thu May 12 09:21:36 2022] GET /identity/v3/endpoints?service_id=755c6058652440de96b0be0f3429dccf&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:36.727733 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a4274-ce09-4a97-9e1c-b8741b191072 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:36.824578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a4274-ce09-4a97-9e1c-b8741b191072 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:36.856370 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c012a04-25ba-4360-b1aa-ded0cdf410f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:36.857028 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c012a04-25ba-4360-b1aa-ded0cdf410f2 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:36.857307 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c012a04-25ba-4360-b1aa-ded0cdf410f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:36.857575 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c012a04-25ba-4360-b1aa-ded0cdf410f2 None admin] PATH_INFO: `/v3/services` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:36.858275 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c012a04-25ba-4360-b1aa-ded0cdf410f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:36.859631 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c012a04-25ba-4360-b1aa-ded0cdf410f2 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:36.873874 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 499/1001] 10.222.0.60 () {56 vars in 1087 bytes} [Thu May 12 09:21:36 2022] GET /identity/v3/services => generated 1727 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:21:37.162029 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95513bb9-aa9e-4e44-8142-d8dbe5dda57d None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:37.162559 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95513bb9-aa9e-4e44-8142-d8dbe5dda57d None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:37.162559 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95513bb9-aa9e-4e44-8142-d8dbe5dda57d None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:37.164051 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 503/1002] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:37.169171 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102b0a2-3fad-4346-881c-6369d41a1d00 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:37.169585 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102b0a2-3fad-4346-881c-6369d41a1d00 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:37.169749 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102b0a2-3fad-4346-881c-6369d41a1d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:37.186650 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-2102b0a2-3fad-4346-881c-6369d41a1d00 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:37.187817 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-2102b0a2-3fad-4346-881c-6369d41a1d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:37.252185 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 500/1003] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:21:37.274684 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95513bb9-aa9e-4e44-8142-d8dbe5dda57d None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:37.374722 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95513bb9-aa9e-4e44-8142-d8dbe5dda57d None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:37.408215 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987417e3-03f0-4867-9bdb-7974d57c3268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:37.409016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987417e3-03f0-4867-9bdb-7974d57c3268 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:37.409294 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987417e3-03f0-4867-9bdb-7974d57c3268 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:37.409565 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987417e3-03f0-4867-9bdb-7974d57c3268 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:37.410237 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987417e3-03f0-4867-9bdb-7974d57c3268 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:37.411598 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987417e3-03f0-4867-9bdb-7974d57c3268 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:37.423574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-987417e3-03f0-4867-9bdb-7974d57c3268 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 09:21:37.423574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:37.423574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 09:21:37.423574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 09:21:37.423574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 09:21:37.423574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 09:21:37.423574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 09:21:37.423574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:37.423574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 09:21:37.423574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:37.423574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 09:21:37.423574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:37.423574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:37.423574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:37.423574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:37.423574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:37.423574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:37.424581 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:37.424581 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:37.424581 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:37.424581 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:37.424581 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:37.424581 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:37.424581 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 09:21:37.424581 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 09:21:37.424581 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 09:21:37.424581 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 09:21:37.424581 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:37.424581 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:37.424581 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:37.424581 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:37.424581 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:37.424581 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:37.425442 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:37.425442 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:37.425442 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:37.425442 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:37.425442 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:37.425442 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:37.425442 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:37.425442 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:37.425442 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:37.425442 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:37.425442 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 09:21:37.425442 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:37.425442 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 09:21:37.425442 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:37.429751 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 504/1004] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 12 09:21:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:37.431152 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102b0a2-3fad-4346-881c-6369d41a1d00 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:37.524336 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102b0a2-3fad-4346-881c-6369d41a1d00 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:37.557053 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750acf36-df0e-4181-aec0-68a9d0771596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:37.557752 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750acf36-df0e-4181-aec0-68a9d0771596 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:37.558097 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750acf36-df0e-4181-aec0-68a9d0771596 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:37.558376 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750acf36-df0e-4181-aec0-68a9d0771596 None admin] PATH_INFO: `/v3/services` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:37.559104 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750acf36-df0e-4181-aec0-68a9d0771596 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:37.559414 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750acf36-df0e-4181-aec0-68a9d0771596 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:37.560842 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750acf36-df0e-4181-aec0-68a9d0771596 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:37.571037 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 501/1005] 10.222.0.60 () {56 vars in 1122 bytes} [Thu May 12 09:21:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:37.573346 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987417e3-03f0-4867-9bdb-7974d57c3268 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:37.676862 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987417e3-03f0-4867-9bdb-7974d57c3268 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:37.708938 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e297239-b5b7-45a8-ac1d-d0aafd5007c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:37.709616 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e297239-b5b7-45a8-ac1d-d0aafd5007c1 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:37.709886 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e297239-b5b7-45a8-ac1d-d0aafd5007c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:37.710191 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e297239-b5b7-45a8-ac1d-d0aafd5007c1 None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:37.710887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e297239-b5b7-45a8-ac1d-d0aafd5007c1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:37.711191 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e297239-b5b7-45a8-ac1d-d0aafd5007c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:37.712549 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e297239-b5b7-45a8-ac1d-d0aafd5007c1 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:37.722495 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 505/1006] 10.222.0.60 () {56 vars in 1122 bytes} [Thu May 12 09:21:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:37.724009 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750acf36-df0e-4181-aec0-68a9d0771596 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:37.755737 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c0833-6eb6-41c7-b3b8-89dc50d6f18d None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:37.756029 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c0833-6eb6-41c7-b3b8-89dc50d6f18d None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:37.756470 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c0833-6eb6-41c7-b3b8-89dc50d6f18d None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:37.758764 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 506/1007] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:21:37.764043 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b10963-8c0e-40a2-958b-94b7073937f0 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:37.764329 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b10963-8c0e-40a2-958b-94b7073937f0 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:37.764610 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b10963-8c0e-40a2-958b-94b7073937f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:37.785568 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-e0b10963-8c0e-40a2-958b-94b7073937f0 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:37.786876 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-e0b10963-8c0e-40a2-958b-94b7073937f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:37.823137 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750acf36-df0e-4181-aec0-68a9d0771596 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:37.855473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bccf6b-5f28-477d-a0ad-41774c43ccf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:37.856094 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bccf6b-5f28-477d-a0ad-41774c43ccf1 None admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:37.856208 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 507/1008] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 09:21:37.856424 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bccf6b-5f28-477d-a0ad-41774c43ccf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:37.856689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bccf6b-5f28-477d-a0ad-41774c43ccf1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:37.857415 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bccf6b-5f28-477d-a0ad-41774c43ccf1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:37.858790 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bccf6b-5f28-477d-a0ad-41774c43ccf1 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:37.873943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 502/1009] 10.222.0.60 () {60 vars in 1144 bytes} [Thu May 12 09:21:37 2022] POST /identity/v3/endpoints => generated 325 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:21:37.878371 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b10963-8c0e-40a2-958b-94b7073937f0 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:37.983437 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b10963-8c0e-40a2-958b-94b7073937f0 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:38.028074 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a4e03-777f-40fa-a94b-82963cc6c22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:38.028749 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a4e03-777f-40fa-a94b-82963cc6c22e None admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:38.029030 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a4e03-777f-40fa-a94b-82963cc6c22e None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:38.029303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a4e03-777f-40fa-a94b-82963cc6c22e None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:38.030068 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a4e03-777f-40fa-a94b-82963cc6c22e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:38.031485 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a4e03-777f-40fa-a94b-82963cc6c22e None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:38.049324 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 508/1010] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 12 09:21:37 2022] POST /identity/v3/services => generated 242 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:21:39.111422 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058e962-7ec4-4028-a547-f907d7a45b00 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:39.111863 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058e962-7ec4-4028-a547-f907d7a45b00 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:39.111959 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058e962-7ec4-4028-a547-f907d7a45b00 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:39.113365 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 503/1011] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:39.118472 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7203d6a-3d37-465f-83e2-41e350702f45 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:39.118865 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7203d6a-3d37-465f-83e2-41e350702f45 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:39.119074 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7203d6a-3d37-465f-83e2-41e350702f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:39.136843 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-e7203d6a-3d37-465f-83e2-41e350702f45 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:39.138036 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-e7203d6a-3d37-465f-83e2-41e350702f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:39.209625 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 509/1012] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:39 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:21:39.232595 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058e962-7ec4-4028-a547-f907d7a45b00 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:39.329753 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058e962-7ec4-4028-a547-f907d7a45b00 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:39.361804 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ef12f-1295-4a4f-9ecc-6b55b31cd623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:39.362556 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ef12f-1295-4a4f-9ecc-6b55b31cd623 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:39.362836 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ef12f-1295-4a4f-9ecc-6b55b31cd623 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:39.363104 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ef12f-1295-4a4f-9ecc-6b55b31cd623 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:39.363742 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ef12f-1295-4a4f-9ecc-6b55b31cd623 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:39.365090 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ef12f-1295-4a4f-9ecc-6b55b31cd623 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:39.376731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-080ef12f-1295-4a4f-9ecc-6b55b31cd623 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 09:21:39.376731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:39.376731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 09:21:39.376731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 09:21:39.376731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 09:21:39.376731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 09:21:39.376731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 09:21:39.376731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:39.376731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 09:21:39.376731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:39.376731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 09:21:39.376731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:39.376731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:39.376731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:39.376731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:39.376731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:39.376731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:39.377751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:39.377751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:39.377751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:39.377751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:39.377751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:39.377751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:39.377751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 09:21:39.377751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 09:21:39.377751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 09:21:39.377751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 09:21:39.377751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:39.377751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:39.377751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:39.377751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:39.377751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:39.377751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:39.379067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:39.379067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:39.379067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:39.379067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:39.379067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:39.379067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:39.379067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:39.379067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:39.379067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:39.379067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:39.379067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 09:21:39.379067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:39.379067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 09:21:39.379067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:39.380595 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 504/1013] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:21:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:39.384102 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7203d6a-3d37-465f-83e2-41e350702f45 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:39.480119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7203d6a-3d37-465f-83e2-41e350702f45 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:39.512658 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1ec6f-b75d-4c16-94ed-0fd8ba113e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:39.513318 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1ec6f-b75d-4c16-94ed-0fd8ba113e91 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:39.513599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1ec6f-b75d-4c16-94ed-0fd8ba113e91 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:39.513872 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1ec6f-b75d-4c16-94ed-0fd8ba113e91 None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:39.514592 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1ec6f-b75d-4c16-94ed-0fd8ba113e91 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:39.514894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1ec6f-b75d-4c16-94ed-0fd8ba113e91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:39.516250 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1ec6f-b75d-4c16-94ed-0fd8ba113e91 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:39.525816 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 510/1014] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 12 09:21:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:39.527025 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ef12f-1295-4a4f-9ecc-6b55b31cd623 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:39.621759 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ef12f-1295-4a4f-9ecc-6b55b31cd623 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:39.664641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6234c-83e7-4a87-af0f-468ffdf7fe55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:39.665589 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6234c-83e7-4a87-af0f-468ffdf7fe55 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:39.666684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6234c-83e7-4a87-af0f-468ffdf7fe55 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:39.667154 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6234c-83e7-4a87-af0f-468ffdf7fe55 None admin] PATH_INFO: `/v3/services` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:39.668000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6234c-83e7-4a87-af0f-468ffdf7fe55 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:39.668446 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6234c-83e7-4a87-af0f-468ffdf7fe55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:39.669979 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6234c-83e7-4a87-af0f-468ffdf7fe55 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:39.679364 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 505/1015] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 12 09:21:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:39.680943 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1ec6f-b75d-4c16-94ed-0fd8ba113e91 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:39.781504 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1ec6f-b75d-4c16-94ed-0fd8ba113e91 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:39.813695 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca356f3a-5a9e-45e1-a369-bf6e1d7bbefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:39.814385 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca356f3a-5a9e-45e1-a369-bf6e1d7bbefb None admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:39.814692 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca356f3a-5a9e-45e1-a369-bf6e1d7bbefb None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:39.814953 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca356f3a-5a9e-45e1-a369-bf6e1d7bbefb None admin] PATH_INFO: `/v3/endpoints` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:39.815690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca356f3a-5a9e-45e1-a369-bf6e1d7bbefb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:39.817054 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca356f3a-5a9e-45e1-a369-bf6e1d7bbefb None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:39.841932 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 511/1016] 10.222.0.60 () {60 vars in 1144 bytes} [Thu May 12 09:21:39 2022] POST /identity/v3/endpoints => generated 334 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:21:40.162669 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfe980-12a7-424e-99e0-228d66e4d939 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:40.163212 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfe980-12a7-424e-99e0-228d66e4d939 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:40.163212 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfe980-12a7-424e-99e0-228d66e4d939 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:40.165324 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 506/1017] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:40.172826 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d4ab5-a2bd-4b2e-8ca5-a3c8eb6905db None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:40.173298 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d4ab5-a2bd-4b2e-8ca5-a3c8eb6905db None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:40.173576 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d4ab5-a2bd-4b2e-8ca5-a3c8eb6905db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:40.190699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-2a6d4ab5-a2bd-4b2e-8ca5-a3c8eb6905db None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:40.191878 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-2a6d4ab5-a2bd-4b2e-8ca5-a3c8eb6905db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:40.261703 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 512/1018] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:21:40.277086 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc45df4-202a-4dbf-aaff-f8f5d3e9fdd5 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:40.277376 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc45df4-202a-4dbf-aaff-f8f5d3e9fdd5 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:40.277654 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc45df4-202a-4dbf-aaff-f8f5d3e9fdd5 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:40.279159 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 507/1019] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:40.284205 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e5149-8c51-4229-83ab-1de41190cb55 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:40.284497 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e5149-8c51-4229-83ab-1de41190cb55 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:40.284724 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc45df4-202a-4dbf-aaff-f8f5d3e9fdd5 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:40.284828 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e5149-8c51-4229-83ab-1de41190cb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:40.302060 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-e74e5149-8c51-4229-83ab-1de41190cb55 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:40.303230 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-e74e5149-8c51-4229-83ab-1de41190cb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:40.373701 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 513/1020] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:21:40.385410 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc45df4-202a-4dbf-aaff-f8f5d3e9fdd5 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:40.395822 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e5149-8c51-4229-83ab-1de41190cb55 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:40.418617 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c913b4-247c-4661-9f0d-a1212fe3f524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:40.419413 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c913b4-247c-4661-9f0d-a1212fe3f524 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:40.419697 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c913b4-247c-4661-9f0d-a1212fe3f524 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:40.419970 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c913b4-247c-4661-9f0d-a1212fe3f524 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:40.421140 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c913b4-247c-4661-9f0d-a1212fe3f524 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:40.422601 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c913b4-247c-4661-9f0d-a1212fe3f524 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:40.428753 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 508/1021] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:40.429874 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c913b4-247c-4661-9f0d-a1212fe3f524 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:40.496654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e5149-8c51-4229-83ab-1de41190cb55 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:40.527716 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c913b4-247c-4661-9f0d-a1212fe3f524 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:40.538760 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf5d58-4cfd-44ff-a755-7e1b71452592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:40.539546 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf5d58-4cfd-44ff-a755-7e1b71452592 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:40.539824 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf5d58-4cfd-44ff-a755-7e1b71452592 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:40.540091 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf5d58-4cfd-44ff-a755-7e1b71452592 None admin] PATH_INFO: `/v3/services/image` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:40.540746 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf5d58-4cfd-44ff-a755-7e1b71452592 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:40.542127 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf5d58-4cfd-44ff-a755-7e1b71452592 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:40.553437 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-b8cf5d58-4cfd-44ff-a755-7e1b71452592 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 09:21:40.553437 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:40.553437 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 09:21:40.553437 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 09:21:40.553437 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 09:21:40.553437 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 09:21:40.553437 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 09:21:40.553437 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:40.553437 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 09:21:40.553437 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:40.553437 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 09:21:40.553437 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:40.553437 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:40.553437 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:40.553437 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:40.553437 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:40.553437 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:40.554488 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:40.554488 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:40.554488 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:40.554488 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:40.554488 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:40.554488 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:40.554488 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 09:21:40.554488 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 09:21:40.554488 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 09:21:40.554488 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 09:21:40.554488 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:40.554488 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:40.554488 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:40.554488 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:40.554488 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:40.554488 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:40.555365 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:40.555365 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:40.555365 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:40.555365 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:40.555365 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:40.555365 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:40.555365 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:40.555365 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:40.555365 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:40.555365 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:40.555365 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 09:21:40.555365 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:40.555365 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 09:21:40.555365 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:40.555365 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 514/1022] 10.222.0.60 () {56 vars in 1105 bytes} [Thu May 12 09:21:40 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:40.561010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf5d58-4cfd-44ff-a755-7e1b71452592 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:40.563702 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be02be-f4bd-451b-afe7-4f2380b6ef22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:40.564362 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be02be-f4bd-451b-afe7-4f2380b6ef22 None admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:40.564641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be02be-f4bd-451b-afe7-4f2380b6ef22 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:40.564912 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be02be-f4bd-451b-afe7-4f2380b6ef22 None admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:40.565600 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be02be-f4bd-451b-afe7-4f2380b6ef22 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:40.567024 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be02be-f4bd-451b-afe7-4f2380b6ef22 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:40.600928 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 509/1023] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 12 09:21:40 2022] POST /identity/v3/projects => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:21:40.666045 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf5d58-4cfd-44ff-a755-7e1b71452592 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:40.701635 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e081da9-1e17-44ff-bca9-af426c754617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:40.702333 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e081da9-1e17-44ff-bca9-af426c754617 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:40.702612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e081da9-1e17-44ff-bca9-af426c754617 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:40.702883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e081da9-1e17-44ff-bca9-af426c754617 None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:40.703592 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e081da9-1e17-44ff-bca9-af426c754617 None admin] RBAC: Adding query filter params (name=image) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:40.703894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e081da9-1e17-44ff-bca9-af426c754617 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:40.705284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e081da9-1e17-44ff-bca9-af426c754617 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:40.715227 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 515/1024] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:40.717972 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be02be-f4bd-451b-afe7-4f2380b6ef22 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:40.818663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be02be-f4bd-451b-afe7-4f2380b6ef22 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:40.851074 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25299a57-fa8a-4df0-acf2-006e2e9eea67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:40.851735 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25299a57-fa8a-4df0-acf2-006e2e9eea67 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:40.852064 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25299a57-fa8a-4df0-acf2-006e2e9eea67 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:40.852337 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25299a57-fa8a-4df0-acf2-006e2e9eea67 None admin] PATH_INFO: `/v3/services` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:40.853091 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25299a57-fa8a-4df0-acf2-006e2e9eea67 None admin] RBAC: Adding query filter params (type=image) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:40.853419 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25299a57-fa8a-4df0-acf2-006e2e9eea67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:40.854828 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25299a57-fa8a-4df0-acf2-006e2e9eea67 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:40.859620 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 510/1025] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:40.865613 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e081da9-1e17-44ff-bca9-af426c754617 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:40.958994 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e081da9-1e17-44ff-bca9-af426c754617 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:40.990224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f8387-e078-456e-8c30-4b17578671c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:40.990876 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f8387-e078-456e-8c30-4b17578671c1 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:40.991155 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f8387-e078-456e-8c30-4b17578671c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:40.991432 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f8387-e078-456e-8c30-4b17578671c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:40.992231 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f8387-e078-456e-8c30-4b17578671c1 None admin] RBAC: Adding query filter params (interface=public, service_id=4f301dc57130408f915f5c0ae9282455, region_id=RegionOne) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:40.992542 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f8387-e078-456e-8c30-4b17578671c1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:40.993891 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f8387-e078-456e-8c30-4b17578671c1 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:41.003216 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 516/1026] 10.222.0.60 () {56 vars in 1251 bytes} [Thu May 12 09:21:40 2022] GET /identity/v3/endpoints?service_id=4f301dc57130408f915f5c0ae9282455&interface=public®ion_id=RegionOne => generated 194 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:41.004738 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25299a57-fa8a-4df0-acf2-006e2e9eea67 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:41.103238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25299a57-fa8a-4df0-acf2-006e2e9eea67 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:41.136959 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33025343-bd8a-4920-a6ba-5b4e75b55d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:41.137625 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33025343-bd8a-4920-a6ba-5b4e75b55d75 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:41.137933 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33025343-bd8a-4920-a6ba-5b4e75b55d75 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:41.138211 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33025343-bd8a-4920-a6ba-5b4e75b55d75 None admin] PATH_INFO: `/v3/services` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:41.138894 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33025343-bd8a-4920-a6ba-5b4e75b55d75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:41.140265 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33025343-bd8a-4920-a6ba-5b4e75b55d75 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:41.146911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 511/1027] 10.222.0.60 () {56 vars in 1087 bytes} [Thu May 12 09:21:41 2022] GET /identity/v3/services => generated 1957 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:21:42.163799 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f94d1e-d694-4fc0-987e-f6c5b2b46d33 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:42.164317 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f94d1e-d694-4fc0-987e-f6c5b2b46d33 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:42.164317 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f94d1e-d694-4fc0-987e-f6c5b2b46d33 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:42.165847 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 517/1028] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:42.170850 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0211a-e370-4600-855a-4529c82f489e None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:42.171239 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0211a-e370-4600-855a-4529c82f489e None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:42.171401 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0211a-e370-4600-855a-4529c82f489e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:42.188113 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-c3b0211a-e370-4600-855a-4529c82f489e None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:42.189292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-c3b0211a-e370-4600-855a-4529c82f489e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:42.253949 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 512/1029] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:21:42.277755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f94d1e-d694-4fc0-987e-f6c5b2b46d33 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:42.374713 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f94d1e-d694-4fc0-987e-f6c5b2b46d33 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:42.406775 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad75719-7483-476f-82f1-e5beb12db904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:42.407582 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad75719-7483-476f-82f1-e5beb12db904 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:42.407872 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad75719-7483-476f-82f1-e5beb12db904 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:42.408125 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad75719-7483-476f-82f1-e5beb12db904 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:42.418721 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad75719-7483-476f-82f1-e5beb12db904 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:21:42.426694 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-bad75719-7483-476f-82f1-e5beb12db904 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 09:21:42.426694 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:42.426694 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:42.426694 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:42.426694 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:42.426694 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:42.426694 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:42.426694 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:42.426694 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:42.426694 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:42.426694 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:42.426694 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:42.426694 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:21:42.426694 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:21:42.426694 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:21:42.426694 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:21:42.427677 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:21:42.427677 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:21:42.427677 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:21:42.427677 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:21:42.427677 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:42.427677 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:42.427677 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:42.427677 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:42.427677 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:42.427677 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:42.427677 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:42.427677 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:42.427677 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:42.427677 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:42.427677 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:42.427677 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:42.429127 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:42.429127 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:42.429127 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:42.429127 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:42.429127 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:21:42.429127 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:21:42.429127 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:21:42.429127 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:21:42.429127 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:21:42.429127 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:21:42.429127 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 09:21:42.429127 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:42.429127 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 518/1030] 10.222.0.60 () {56 vars in 1120 bytes} [Thu May 12 09:21:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:42.433786 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0211a-e370-4600-855a-4529c82f489e None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:42.528461 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0211a-e370-4600-855a-4529c82f489e None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:42.559967 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd198ae5-34ef-4558-8969-c2e967a4e3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:42.560624 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd198ae5-34ef-4558-8969-c2e967a4e3f5 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:42.560900 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd198ae5-34ef-4558-8969-c2e967a4e3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:42.561168 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd198ae5-34ef-4558-8969-c2e967a4e3f5 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:42.561888 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd198ae5-34ef-4558-8969-c2e967a4e3f5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:42.562212 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd198ae5-34ef-4558-8969-c2e967a4e3f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:42.563579 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd198ae5-34ef-4558-8969-c2e967a4e3f5 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:42.571487 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 513/1031] 10.222.0.60 () {56 vars in 1115 bytes} [Thu May 12 09:21:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:42.577341 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad75719-7483-476f-82f1-e5beb12db904 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:42.672995 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad75719-7483-476f-82f1-e5beb12db904 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:42.708443 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c0d2c-bbf7-42d7-b56c-5c8620bbc688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:42.709228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c0d2c-bbf7-42d7-b56c-5c8620bbc688 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:42.709509 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c0d2c-bbf7-42d7-b56c-5c8620bbc688 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:42.709773 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c0d2c-bbf7-42d7-b56c-5c8620bbc688 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:42.719561 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c0d2c-bbf7-42d7-b56c-5c8620bbc688 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:42.721006 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c0d2c-bbf7-42d7-b56c-5c8620bbc688 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:42.738225 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-ff9c0d2c-bbf7-42d7-b56c-5c8620bbc688 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:42.738225 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:42.738225 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:42.738225 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:42.738225 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:42.738225 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:42.738225 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:42.738225 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:42.738225 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:42.738225 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:42.738225 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:42.738225 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:42.738225 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:21:42.738225 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:21:42.738225 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:21:42.739162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:21:42.739162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:42.739162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:42.739162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:42.739162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:42.739162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:42.739162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:42.739162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:42.739162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:42.739162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:42.739162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:42.739162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:42.739162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:42.739162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:42.739162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:42.739162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:42.739162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:42.740142 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:21:42.740142 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:21:42.740142 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:42.740142 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:42.741111 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 519/1032] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:42.746061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd198ae5-34ef-4558-8969-c2e967a4e3f5 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:42.840306 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd198ae5-34ef-4558-8969-c2e967a4e3f5 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:42.858433 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284baa42-0323-4df1-8bd1-87481e7457b6 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:42.858713 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284baa42-0323-4df1-8bd1-87481e7457b6 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:42.859035 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284baa42-0323-4df1-8bd1-87481e7457b6 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:42.860450 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 520/1033] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:21:42.865198 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da308c18-ea34-402b-b528-11c7d8168131 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:42.865479 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da308c18-ea34-402b-b528-11c7d8168131 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:42.865751 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da308c18-ea34-402b-b528-11c7d8168131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:42.872542 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375463c2-7e7d-4a57-a0d5-89be7c9da83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:42.873200 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375463c2-7e7d-4a57-a0d5-89be7c9da83b None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:42.873477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375463c2-7e7d-4a57-a0d5-89be7c9da83b None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:42.873768 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375463c2-7e7d-4a57-a0d5-89be7c9da83b None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:42.874506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375463c2-7e7d-4a57-a0d5-89be7c9da83b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:42.874808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375463c2-7e7d-4a57-a0d5-89be7c9da83b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:42.876161 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375463c2-7e7d-4a57-a0d5-89be7c9da83b None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:42.883275 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-da308c18-ea34-402b-b528-11c7d8168131 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:42.884531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-da308c18-ea34-402b-b528-11c7d8168131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:42.888868 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 514/1034] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:42.894061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375463c2-7e7d-4a57-a0d5-89be7c9da83b None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:42.949849 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 521/1035] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 09:21:42.974011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da308c18-ea34-402b-b528-11c7d8168131 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:42.989366 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375463c2-7e7d-4a57-a0d5-89be7c9da83b None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:43.021733 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65891911-fd9c-418a-9eeb-b903f2c6cd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:43.022563 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65891911-fd9c-418a-9eeb-b903f2c6cd3c None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:43.022848 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65891911-fd9c-418a-9eeb-b903f2c6cd3c None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:43.023129 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65891911-fd9c-418a-9eeb-b903f2c6cd3c None admin] PATH_INFO: `/v3/users/nova` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:43.030638 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65891911-fd9c-418a-9eeb-b903f2c6cd3c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:43.032068 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65891911-fd9c-418a-9eeb-b903f2c6cd3c None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:43.046808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-65891911-fd9c-418a-9eeb-b903f2c6cd3c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 09:21:43.046808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:43.046808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:43.046808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:43.046808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:43.046808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:43.046808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:43.046808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:43.046808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:43.046808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:43.046808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:43.046808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:43.046808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:21:43.046808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:21:43.046808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:21:43.046808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:21:43.047806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:43.047806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:43.047806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:21:43.047806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:43.047806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:21:43.047806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:43.047806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:43.047806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:43.047806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:43.047806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:43.047806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:43.047806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:43.047806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:43.047806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:43.047806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:43.047806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:43.047806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:43.047806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:43.048757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:43.048757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:43.048757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:21:43.048757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:21:43.048757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:21:43.048757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:21:43.048757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:21:43.048757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:21:43.048757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 09:21:43.048757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:43.052783 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 515/1036] 10.222.0.60 () {56 vars in 1093 bytes} [Thu May 12 09:21:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:43.053400 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65891911-fd9c-418a-9eeb-b903f2c6cd3c None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:43.071947 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da308c18-ea34-402b-b528-11c7d8168131 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:43.106887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9da2a-dec0-4177-b9a2-7dbff86b798d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:43.107687 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9da2a-dec0-4177-b9a2-7dbff86b798d None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:43.107966 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9da2a-dec0-4177-b9a2-7dbff86b798d None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:43.108233 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9da2a-dec0-4177-b9a2-7dbff86b798d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:43.109405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9da2a-dec0-4177-b9a2-7dbff86b798d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:43.110874 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9da2a-dec0-4177-b9a2-7dbff86b798d None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:43.117067 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 522/1037] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:43.117802 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9da2a-dec0-4177-b9a2-7dbff86b798d None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:43.148728 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65891911-fd9c-418a-9eeb-b903f2c6cd3c None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:43.184197 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145413be-49e4-449a-9351-ebb1570ca1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:43.185014 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145413be-49e4-449a-9351-ebb1570ca1cc None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:43.185258 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145413be-49e4-449a-9351-ebb1570ca1cc None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:43.185529 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145413be-49e4-449a-9351-ebb1570ca1cc None admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:43.186413 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145413be-49e4-449a-9351-ebb1570ca1cc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:43.186718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145413be-49e4-449a-9351-ebb1570ca1cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:43.188176 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145413be-49e4-449a-9351-ebb1570ca1cc None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:43.212016 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 516/1038] 10.222.0.60 () {56 vars in 1133 bytes} [Thu May 12 09:21:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:43.212910 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145413be-49e4-449a-9351-ebb1570ca1cc None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:43.217331 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9da2a-dec0-4177-b9a2-7dbff86b798d None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:43.250237 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085d2a4-fe2e-4b43-8f8a-5484cdf7e1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:43.250911 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085d2a4-fe2e-4b43-8f8a-5484cdf7e1b0 None admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:43.251198 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085d2a4-fe2e-4b43-8f8a-5484cdf7e1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:43.251474 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085d2a4-fe2e-4b43-8f8a-5484cdf7e1b0 None admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:43.252178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085d2a4-fe2e-4b43-8f8a-5484cdf7e1b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:43.253600 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085d2a4-fe2e-4b43-8f8a-5484cdf7e1b0 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:43.275082 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 523/1039] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 12 09:21:43 2022] POST /identity/v3/users => generated 285 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:21:43.317663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145413be-49e4-449a-9351-ebb1570ca1cc None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:43.354288 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b771b6-5043-4c25-9ab1-74037153cf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:43.354960 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b771b6-5043-4c25-9ab1-74037153cf05 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:43.355244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b771b6-5043-4c25-9ab1-74037153cf05 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:43.355520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b771b6-5043-4c25-9ab1-74037153cf05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:43.367698 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b78f1-f1bb-4bdd-8fb0-f55e2e49851c None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:43.368059 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b78f1-f1bb-4bdd-8fb0-f55e2e49851c None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:43.368270 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b78f1-f1bb-4bdd-8fb0-f55e2e49851c None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:43.370291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 524/1040] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:21:43.376092 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d645df7-a3e8-45e8-aed0-b9b03856c944 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:43.376427 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d645df7-a3e8-45e8-aed0-b9b03856c944 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:43.376657 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d645df7-a3e8-45e8-aed0-b9b03856c944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:43.394255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-5d645df7-a3e8-45e8-aed0-b9b03856c944 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:43.395590 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-5d645df7-a3e8-45e8-aed0-b9b03856c944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:43.430814 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b771b6-5043-4c25-9ab1-74037153cf05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:43.433223 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b771b6-5043-4c25-9ab1-74037153cf05 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:43.466303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 525/1041] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 09:21:43.488551 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d645df7-a3e8-45e8-aed0-b9b03856c944 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:43.533991 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 517/1042] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:21:43 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 09:21:43.538784 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b771b6-5043-4c25-9ab1-74037153cf05 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:43.590186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d645df7-a3e8-45e8-aed0-b9b03856c944 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:43.629276 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a689566-f1bd-438e-b1f2-8221fd0b5044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:43.630114 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a689566-f1bd-438e-b1f2-8221fd0b5044 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:43.630657 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a689566-f1bd-438e-b1f2-8221fd0b5044 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:43.630931 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a689566-f1bd-438e-b1f2-8221fd0b5044 None admin] PATH_INFO: `/v3/services/image` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:43.631589 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a689566-f1bd-438e-b1f2-8221fd0b5044 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:43.632975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a689566-f1bd-438e-b1f2-8221fd0b5044 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:43.633465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b771b6-5043-4c25-9ab1-74037153cf05 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:43.645392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-8a689566-f1bd-438e-b1f2-8221fd0b5044 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 09:21:43.645392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:43.645392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 09:21:43.645392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 09:21:43.645392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 09:21:43.645392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 09:21:43.645392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 09:21:43.645392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:43.645392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 09:21:43.645392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:43.645392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 09:21:43.645392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:43.645392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:43.645392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:43.645392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:43.645392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:43.645392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:43.646642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:43.646642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:43.646642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:43.646642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:43.646642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:43.646642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:43.646642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 09:21:43.646642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 09:21:43.646642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 09:21:43.646642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 09:21:43.646642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:43.646642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:43.646642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:43.646642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:43.646642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:43.646642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:43.647510 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:43.647510 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:43.647510 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:43.647510 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:43.647510 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:43.647510 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:43.647510 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:43.647510 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:43.647510 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:43.647510 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:43.647510 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 09:21:43.647510 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:21:43.647510 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 09:21:43.647510 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:43.647510 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 526/1043] 10.222.0.60 () {56 vars in 1105 bytes} [Thu May 12 09:21:43 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:43.652969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a689566-f1bd-438e-b1f2-8221fd0b5044 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:43.670856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6312e5-d1a3-4eb7-87a5-539af20c4f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:43.671653 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6312e5-d1a3-4eb7-87a5-539af20c4f3a None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:43.671937 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6312e5-d1a3-4eb7-87a5-539af20c4f3a None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:43.672216 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6312e5-d1a3-4eb7-87a5-539af20c4f3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:43.682727 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6312e5-d1a3-4eb7-87a5-539af20c4f3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:43.684919 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6312e5-d1a3-4eb7-87a5-539af20c4f3a None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:43.703844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-4e6312e5-d1a3-4eb7-87a5-539af20c4f3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:43.703844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:43.703844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:43.703844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:43.703844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:43.703844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:43.703844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:43.703844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:43.703844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:43.703844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:43.703844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:43.703844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:43.703844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:21:43.703844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:21:43.703844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:21:43.704838 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:21:43.704838 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:43.704838 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:43.704838 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:43.704838 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:43.704838 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:43.704838 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:43.704838 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:43.704838 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:43.704838 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:43.704838 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:43.704838 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:43.704838 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:43.704838 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:43.704838 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:43.704838 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:43.704838 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:43.705785 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:21:43.705785 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:21:43.705785 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:43.705785 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:43.705785 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 518/1044] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:43.710572 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6312e5-d1a3-4eb7-87a5-539af20c4f3a None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:43.753355 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a689566-f1bd-438e-b1f2-8221fd0b5044 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:43.787149 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79377738-c0b3-4642-8e0c-2660da45a9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:43.787816 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79377738-c0b3-4642-8e0c-2660da45a9d6 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:43.788102 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79377738-c0b3-4642-8e0c-2660da45a9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:43.788385 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79377738-c0b3-4642-8e0c-2660da45a9d6 None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:43.789091 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79377738-c0b3-4642-8e0c-2660da45a9d6 None admin] RBAC: Adding query filter params (name=image) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:43.789430 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79377738-c0b3-4642-8e0c-2660da45a9d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:43.790861 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79377738-c0b3-4642-8e0c-2660da45a9d6 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:43.800817 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 527/1045] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:43.801701 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79377738-c0b3-4642-8e0c-2660da45a9d6 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:43.812453 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6312e5-d1a3-4eb7-87a5-539af20c4f3a None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:43.844927 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c17a1f-937d-4189-ba10-d8d063f2f9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:43.845879 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c17a1f-937d-4189-ba10-d8d063f2f9d6 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:43.846186 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c17a1f-937d-4189-ba10-d8d063f2f9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:43.846459 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c17a1f-937d-4189-ba10-d8d063f2f9d6 None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:43.847172 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c17a1f-937d-4189-ba10-d8d063f2f9d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:43.847474 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c17a1f-937d-4189-ba10-d8d063f2f9d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:43.848824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c17a1f-937d-4189-ba10-d8d063f2f9d6 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:43.864648 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 519/1046] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:43.866045 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c17a1f-937d-4189-ba10-d8d063f2f9d6 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:43.898881 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79377738-c0b3-4642-8e0c-2660da45a9d6 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:43.932840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2dd9fb-fce8-4a24-b38e-b4b1c9a8c7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:43.933504 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dd9fb-fce8-4a24-b38e-b4b1c9a8c7b3 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:43.933787 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dd9fb-fce8-4a24-b38e-b4b1c9a8c7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:43.934106 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dd9fb-fce8-4a24-b38e-b4b1c9a8c7b3 None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:43.934789 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2dd9fb-fce8-4a24-b38e-b4b1c9a8c7b3 None admin] RBAC: Adding query filter params (type=image) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:43.935101 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2dd9fb-fce8-4a24-b38e-b4b1c9a8c7b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:43.936461 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2dd9fb-fce8-4a24-b38e-b4b1c9a8c7b3 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:43.945953 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 528/1047] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:43.946685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2dd9fb-fce8-4a24-b38e-b4b1c9a8c7b3 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:43.963666 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c17a1f-937d-4189-ba10-d8d063f2f9d6 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:44.000116 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64467b-4383-42bc-ab0d-998cf0a1bf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:44.000914 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64467b-4383-42bc-ab0d-998cf0a1bf3f None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:44.001192 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64467b-4383-42bc-ab0d-998cf0a1bf3f None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:44.001538 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64467b-4383-42bc-ab0d-998cf0a1bf3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:44.008251 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f64467b-4383-42bc-ab0d-998cf0a1bf3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:44.009628 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f64467b-4383-42bc-ab0d-998cf0a1bf3f None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:44.023494 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-7f64467b-4383-42bc-ab0d-998cf0a1bf3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:44.023494 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:44.023494 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:44.023494 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:44.023494 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:44.023494 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:44.023494 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:44.023494 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:44.023494 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:44.023494 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:44.023494 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:44.023494 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:44.023494 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:21:44.023494 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:21:44.023494 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:21:44.024418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:21:44.024418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:44.024418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:44.024418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:44.024418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:44.024418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:44.024418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:44.024418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:44.024418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:44.024418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:44.024418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:44.024418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:44.024418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:44.024418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:44.024418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:44.024418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:44.024418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:44.025371 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:21:44.025371 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:21:44.025371 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:21:44.025371 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:21:44.025371 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:21:44.025371 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:21:44.025371 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:44.025371 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:44.025371 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 520/1048] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:21:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:44.030540 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64467b-4383-42bc-ab0d-998cf0a1bf3f None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:44.046252 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2dd9fb-fce8-4a24-b38e-b4b1c9a8c7b3 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:44.079208 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1754f-af82-4564-aa83-d06e883d7fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:44.080000 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1754f-af82-4564-aa83-d06e883d7fb0 None admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:44.080404 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1754f-af82-4564-aa83-d06e883d7fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:44.080780 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1754f-af82-4564-aa83-d06e883d7fb0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:44.081616 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1754f-af82-4564-aa83-d06e883d7fb0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:44.083119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1754f-af82-4564-aa83-d06e883d7fb0 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:44.118187 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 529/1049] 10.222.0.60 () {60 vars in 1144 bytes} [Thu May 12 09:21:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:21:44.130477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64467b-4383-42bc-ab0d-998cf0a1bf3f None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:44.175947 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7264b-e4b6-47e5-903a-8ca8f3314dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:44.176637 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7264b-e4b6-47e5-903a-8ca8f3314dcb None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:44.176919 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7264b-e4b6-47e5-903a-8ca8f3314dcb None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:44.177192 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7264b-e4b6-47e5-903a-8ca8f3314dcb None admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:44.178039 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7264b-e4b6-47e5-903a-8ca8f3314dcb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:44.178353 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7264b-e4b6-47e5-903a-8ca8f3314dcb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:44.179801 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7264b-e4b6-47e5-903a-8ca8f3314dcb None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:44.198276 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 521/1050] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:21:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:44.199520 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1754f-af82-4564-aa83-d06e883d7fb0 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:44.305794 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1754f-af82-4564-aa83-d06e883d7fb0 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:44.339029 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b592f5-73d3-4148-907a-53f157d57d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:44.339678 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b592f5-73d3-4148-907a-53f157d57d3d None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:44.339958 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b592f5-73d3-4148-907a-53f157d57d3d None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:44.340219 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b592f5-73d3-4148-907a-53f157d57d3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:44.341034 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b592f5-73d3-4148-907a-53f157d57d3d None admin] RBAC: Adding query filter params (role.id=ee3dbb0fb690434ca94adf68e3148ab2, scope.project.id=9cf4f2954dd44516b3e594ed440781cc, user.id=2915babd40aa42e8bf7cc85c5a97daa6) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:44.341339 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b592f5-73d3-4148-907a-53f157d57d3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:44.342801 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b592f5-73d3-4148-907a-53f157d57d3d None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:44.348306 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 530/1051] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:21:44 2022] GET /identity/v3/role_assignments?user.id=2915babd40aa42e8bf7cc85c5a97daa6&scope.project.id=9cf4f2954dd44516b3e594ed440781cc&role.id=ee3dbb0fb690434ca94adf68e3148ab2 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:45.555064 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944369c-fd58-46d2-bf00-ead0d2d8559d None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:45.555594 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944369c-fd58-46d2-bf00-ead0d2d8559d None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:45.555594 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944369c-fd58-46d2-bf00-ead0d2d8559d None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:45.557053 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 522/1052] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:45.562476 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5898f0b-61d4-4e32-8dbd-ec922576b45e None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:45.562878 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5898f0b-61d4-4e32-8dbd-ec922576b45e None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:45.563059 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5898f0b-61d4-4e32-8dbd-ec922576b45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:45.579768 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-b5898f0b-61d4-4e32-8dbd-ec922576b45e None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:45.580919 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-b5898f0b-61d4-4e32-8dbd-ec922576b45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:45.644673 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 531/1053] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:21:45.667311 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944369c-fd58-46d2-bf00-ead0d2d8559d None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:45.771452 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944369c-fd58-46d2-bf00-ead0d2d8559d None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:45.805865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85e5eb-62f1-4eb1-b12e-a4fb5d66af95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:45.806705 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85e5eb-62f1-4eb1-b12e-a4fb5d66af95 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:45.806979 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85e5eb-62f1-4eb1-b12e-a4fb5d66af95 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:45.807246 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85e5eb-62f1-4eb1-b12e-a4fb5d66af95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:45.816774 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85e5eb-62f1-4eb1-b12e-a4fb5d66af95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:21:45.824362 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-ff85e5eb-62f1-4eb1-b12e-a4fb5d66af95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:21:45.824362 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:45.824362 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:45.824362 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:45.824362 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:45.824362 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:45.824362 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:45.824362 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:45.824362 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:45.824362 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:45.824362 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:45.824362 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:45.824362 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:21:45.824362 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:21:45.824362 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:21:45.824362 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:21:45.825292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:21:45.825292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:21:45.825292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:21:45.825292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:21:45.825292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:45.825292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:45.825292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:45.825292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:45.825292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:45.825292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:45.825292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:45.825292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:45.825292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:45.825292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:45.825292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:45.825292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:45.826193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:45.826193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:45.826193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:45.826193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:45.826193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:21:45.826193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:21:45.826193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:21:45.826193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:21:45.826193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:21:45.826193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:21:45.826193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:21:45.826193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:45.826193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 523/1054] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:21:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:45.832935 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5898f0b-61d4-4e32-8dbd-ec922576b45e None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:45.925685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5898f0b-61d4-4e32-8dbd-ec922576b45e None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:45.958536 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43fc7e-2bc4-45e5-a94c-e164b38696f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:45.959198 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43fc7e-2bc4-45e5-a94c-e164b38696f3 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:45.959476 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43fc7e-2bc4-45e5-a94c-e164b38696f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:45.959748 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43fc7e-2bc4-45e5-a94c-e164b38696f3 None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:45.960485 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43fc7e-2bc4-45e5-a94c-e164b38696f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:45.960787 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43fc7e-2bc4-45e5-a94c-e164b38696f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:45.962174 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43fc7e-2bc4-45e5-a94c-e164b38696f3 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:45.974810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 532/1055] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:21:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:45.976037 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85e5eb-62f1-4eb1-b12e-a4fb5d66af95 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:46.071940 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85e5eb-62f1-4eb1-b12e-a4fb5d66af95 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:46.105612 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12a95d-3f4c-4152-be0f-9fd5601d5e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:46.106515 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12a95d-3f4c-4152-be0f-9fd5601d5e12 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:46.106793 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12a95d-3f4c-4152-be0f-9fd5601d5e12 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:46.107062 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12a95d-3f4c-4152-be0f-9fd5601d5e12 None admin] PATH_INFO: `/v3/users/721924137592405eb0a1e908ea65998b` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:46.120952 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12a95d-3f4c-4152-be0f-9fd5601d5e12 None admin] RBAC: Authorizing `identity:get_user(user_id=721924137592405eb0a1e908ea65998b)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:46.122428 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12a95d-3f4c-4152-be0f-9fd5601d5e12 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:46.128613 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 524/1056] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:21:45 2022] GET /identity/v3/users/721924137592405eb0a1e908ea65998b => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:46.129834 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43fc7e-2bc4-45e5-a94c-e164b38696f3 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:46.229733 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43fc7e-2bc4-45e5-a94c-e164b38696f3 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:46.261661 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88556019-17e3-4862-a712-c27c2a611e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:46.262328 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88556019-17e3-4862-a712-c27c2a611e13 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:46.262605 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88556019-17e3-4862-a712-c27c2a611e13 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:46.262875 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88556019-17e3-4862-a712-c27c2a611e13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:46.326674 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88556019-17e3-4862-a712-c27c2a611e13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:46.328034 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88556019-17e3-4862-a712-c27c2a611e13 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:46.373655 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3bdf2-f1bd-4180-9eeb-2b3b01ed0864 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:46.373969 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3bdf2-f1bd-4180-9eeb-2b3b01ed0864 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:46.374419 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3bdf2-f1bd-4180-9eeb-2b3b01ed0864 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:46.375953 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 525/1057] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:21:46.382240 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501d45f-1ed6-4c3c-a885-6c218310fa9f None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:46.382577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501d45f-1ed6-4c3c-a885-6c218310fa9f None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:46.382807 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501d45f-1ed6-4c3c-a885-6c218310fa9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:46.400961 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-d501d45f-1ed6-4c3c-a885-6c218310fa9f None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:46.402209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-d501d45f-1ed6-4c3c-a885-6c218310fa9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:46.429295 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 533/1058] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:21:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 09:21:46.435056 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88556019-17e3-4862-a712-c27c2a611e13 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:46.473454 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 526/1059] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 09:21:46.498017 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501d45f-1ed6-4c3c-a885-6c218310fa9f None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:46.530358 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88556019-17e3-4862-a712-c27c2a611e13 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:46.564411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72777328-78ab-4b6a-ab02-66070b8ae831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:46.565266 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72777328-78ab-4b6a-ab02-66070b8ae831 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:46.565577 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72777328-78ab-4b6a-ab02-66070b8ae831 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:46.565852 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72777328-78ab-4b6a-ab02-66070b8ae831 None admin] PATH_INFO: `/v3/projects/35571df3fe6a4f099786e6475bcd5ce8` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:46.567091 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72777328-78ab-4b6a-ab02-66070b8ae831 None admin] RBAC: Authorizing `identity:get_project(project_id=35571df3fe6a4f099786e6475bcd5ce8)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:46.568515 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72777328-78ab-4b6a-ab02-66070b8ae831 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:46.575546 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 534/1060] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:21:46 2022] GET /identity/v3/projects/35571df3fe6a4f099786e6475bcd5ce8 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:46.575546 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c59cb3-dca3-4163-9db9-f612a944d8cb None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:46.575546 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c59cb3-dca3-4163-9db9-f612a944d8cb None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:46.575546 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c59cb3-dca3-4163-9db9-f612a944d8cb None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:46.575546 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 535/1061] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:46.577258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c59cb3-dca3-4163-9db9-f612a944d8cb None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:46.599898 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501d45f-1ed6-4c3c-a885-6c218310fa9f None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:46.632639 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83ad25-a9a7-4c19-905d-498f2eff37c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:46.633282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83ad25-a9a7-4c19-905d-498f2eff37c1 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:46.633561 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83ad25-a9a7-4c19-905d-498f2eff37c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:46.633834 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83ad25-a9a7-4c19-905d-498f2eff37c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:46.673292 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c59cb3-dca3-4163-9db9-f612a944d8cb None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:46.696259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83ad25-a9a7-4c19-905d-498f2eff37c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:46.698289 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83ad25-a9a7-4c19-905d-498f2eff37c1 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:46.706182 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66d37b-c36a-453c-aad4-8fe781b5b998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:46.707032 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66d37b-c36a-453c-aad4-8fe781b5b998 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:46.707311 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66d37b-c36a-453c-aad4-8fe781b5b998 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:46.707585 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66d37b-c36a-453c-aad4-8fe781b5b998 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:46.708402 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66d37b-c36a-453c-aad4-8fe781b5b998 None admin] RBAC: Adding query filter params (role.id=8f01c4c38fa44034a54c1f8cd2d2db1a, scope.project.id=35571df3fe6a4f099786e6475bcd5ce8, user.id=721924137592405eb0a1e908ea65998b) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:46.708712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66d37b-c36a-453c-aad4-8fe781b5b998 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:46.710160 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66d37b-c36a-453c-aad4-8fe781b5b998 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:46.715386 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 536/1062] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:21:46 2022] GET /identity/v3/role_assignments?user.id=721924137592405eb0a1e908ea65998b&scope.project.id=35571df3fe6a4f099786e6475bcd5ce8&role.id=8f01c4c38fa44034a54c1f8cd2d2db1a => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:46.716530 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a3e82-78e9-42e3-8a20-809f25c315de None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:46.716814 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a3e82-78e9-42e3-8a20-809f25c315de None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:46.717088 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a3e82-78e9-42e3-8a20-809f25c315de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:46.734539 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-749a3e82-78e9-42e3-8a20-809f25c315de None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:46.735762 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-749a3e82-78e9-42e3-8a20-809f25c315de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:46.809977 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 537/1063] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:21:46.813940 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 527/1064] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:21:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 09:21:46.817498 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a3e82-78e9-42e3-8a20-809f25c315de None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:46.831524 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83ad25-a9a7-4c19-905d-498f2eff37c1 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:46.918789 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a3e82-78e9-42e3-8a20-809f25c315de None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:46.930977 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83ad25-a9a7-4c19-905d-498f2eff37c1 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:46.951681 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ecb84-e44c-46db-a6d4-f1599eaeb3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:46.952472 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ecb84-e44c-46db-a6d4-f1599eaeb3ce None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:46.952756 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ecb84-e44c-46db-a6d4-f1599eaeb3ce None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:46.953028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ecb84-e44c-46db-a6d4-f1599eaeb3ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:46.963515 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ecb84-e44c-46db-a6d4-f1599eaeb3ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:46.964972 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ecb84-e44c-46db-a6d4-f1599eaeb3ce None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:46.965864 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd28ea-1d49-49de-8216-e0b9945c2686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:46.966704 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd28ea-1d49-49de-8216-e0b9945c2686 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:46.966988 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd28ea-1d49-49de-8216-e0b9945c2686 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:46.967327 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd28ea-1d49-49de-8216-e0b9945c2686 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:46.977772 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bd28ea-1d49-49de-8216-e0b9945c2686 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:21:46.982123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-2d6ecb84-e44c-46db-a6d4-f1599eaeb3ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:46.982123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:46.982123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:46.982123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:46.982123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:46.982123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:46.982123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:46.982123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:46.982123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:46.982123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:46.982123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:46.982123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:46.982123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:21:46.982123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:21:46.982123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:21:46.983028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:21:46.983028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:46.983028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:46.983028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:46.983028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:46.983028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:46.983028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:46.983028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:46.983028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:46.983028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:46.983028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:46.983028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:46.983028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:46.983028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:46.983028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:46.983028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:46.983028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:46.984491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:21:46.984491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:21:46.984491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:46.984491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:46.984491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 538/1065] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:46.987992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-c8bd28ea-1d49-49de-8216-e0b9945c2686 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 09:21:46.987992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:46.987992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:46.987992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:46.987992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:46.987992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:46.987992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:46.987992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:46.987992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:46.987992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:46.987992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:46.987992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:46.987992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:21:46.987992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:21:46.987992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:21:46.987992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:21:46.988940 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:21:46.988940 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:21:46.988940 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:21:46.988940 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:21:46.988940 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:46.988940 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:46.988940 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:46.988940 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:46.988940 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:46.988940 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:46.988940 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:46.988940 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:46.988940 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:46.988940 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:46.988940 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:46.988940 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:46.989775 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:46.989775 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:46.989775 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:46.989775 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:46.989775 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:21:46.989775 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:21:46.989775 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:21:46.989775 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:21:46.989775 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:21:46.989775 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:21:46.989775 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 09:21:46.989775 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:46.989775 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 528/1066] 10.222.0.60 () {56 vars in 1120 bytes} [Thu May 12 09:21:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:46.993358 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ecb84-e44c-46db-a6d4-f1599eaeb3ce None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:46.994020 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd28ea-1d49-49de-8216-e0b9945c2686 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:47.094447 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ecb84-e44c-46db-a6d4-f1599eaeb3ce None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:47.094885 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd28ea-1d49-49de-8216-e0b9945c2686 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:47.127628 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f5ea4-77d2-4991-94d4-94ff3f8bab0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:47.127811 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421e1a4-013d-406d-b7db-08de0b42faa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:47.128310 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f5ea4-77d2-4991-94d4-94ff3f8bab0f None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:47.128418 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421e1a4-013d-406d-b7db-08de0b42faa2 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:47.128599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f5ea4-77d2-4991-94d4-94ff3f8bab0f None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:47.128699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421e1a4-013d-406d-b7db-08de0b42faa2 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:47.128865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f5ea4-77d2-4991-94d4-94ff3f8bab0f None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:47.128975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421e1a4-013d-406d-b7db-08de0b42faa2 None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:47.129605 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f5ea4-77d2-4991-94d4-94ff3f8bab0f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:47.129716 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421e1a4-013d-406d-b7db-08de0b42faa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:47.129929 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f5ea4-77d2-4991-94d4-94ff3f8bab0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:47.130030 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421e1a4-013d-406d-b7db-08de0b42faa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:47.131542 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421e1a4-013d-406d-b7db-08de0b42faa2 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:47.131642 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f5ea4-77d2-4991-94d4-94ff3f8bab0f None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:47.140065 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 529/1067] 10.222.0.60 () {56 vars in 1115 bytes} [Thu May 12 09:21:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:47.154276 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 539/1068] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:47.154488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f5ea4-77d2-4991-94d4-94ff3f8bab0f None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:47.257388 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f5ea4-77d2-4991-94d4-94ff3f8bab0f None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:47.292296 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb041a9-c98d-42bd-848f-a65207a0e3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:47.293118 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb041a9-c98d-42bd-848f-a65207a0e3a5 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:47.293403 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb041a9-c98d-42bd-848f-a65207a0e3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:47.293681 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb041a9-c98d-42bd-848f-a65207a0e3a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:47.305039 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb041a9-c98d-42bd-848f-a65207a0e3a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:47.307076 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb041a9-c98d-42bd-848f-a65207a0e3a5 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:47.324863 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-2eb041a9-c98d-42bd-848f-a65207a0e3a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:47.324863 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:47.324863 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:47.324863 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:47.324863 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:47.324863 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:47.324863 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:47.324863 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:47.324863 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:47.324863 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:47.324863 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:47.324863 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:47.324863 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:21:47.324863 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:21:47.324863 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:21:47.325842 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:21:47.325842 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:47.325842 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:47.325842 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:47.325842 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:47.325842 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:47.325842 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:47.325842 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:47.325842 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:47.325842 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:47.325842 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:47.325842 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:47.325842 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:47.325842 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:47.325842 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:47.325842 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:47.325842 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:47.327003 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:21:47.327003 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:21:47.327003 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:47.327003 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:47.329775 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 530/1069] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:47.332139 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421e1a4-013d-406d-b7db-08de0b42faa2 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:47.436497 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421e1a4-013d-406d-b7db-08de0b42faa2 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:47.470518 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7125450-2d1b-48d3-9b44-a2b5ae8a33ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:47.471169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7125450-2d1b-48d3-9b44-a2b5ae8a33ef None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:47.471446 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7125450-2d1b-48d3-9b44-a2b5ae8a33ef None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:47.471715 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7125450-2d1b-48d3-9b44-a2b5ae8a33ef None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:47.472420 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7125450-2d1b-48d3-9b44-a2b5ae8a33ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:47.472719 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7125450-2d1b-48d3-9b44-a2b5ae8a33ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:47.474093 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7125450-2d1b-48d3-9b44-a2b5ae8a33ef None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:47.485915 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 540/1070] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:47.491477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb041a9-c98d-42bd-848f-a65207a0e3a5 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:47.584773 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb041a9-c98d-42bd-848f-a65207a0e3a5 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:47.616666 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731f90a-89bf-4293-8462-5c779159400f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:47.617460 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731f90a-89bf-4293-8462-5c779159400f None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:47.617743 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731f90a-89bf-4293-8462-5c779159400f None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:47.618051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731f90a-89bf-4293-8462-5c779159400f None admin] PATH_INFO: `/v3/users/nova` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:47.625233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731f90a-89bf-4293-8462-5c779159400f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:47.626703 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731f90a-89bf-4293-8462-5c779159400f None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:47.641102 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-6731f90a-89bf-4293-8462-5c779159400f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 09:21:47.641102 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:47.641102 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:47.641102 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:47.641102 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:47.641102 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:47.641102 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:47.641102 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:47.641102 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:47.641102 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:47.641102 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:47.641102 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:47.641102 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:21:47.641102 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:21:47.641102 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:21:47.641102 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:21:47.642114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:47.642114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:47.642114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:21:47.642114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:47.642114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:21:47.642114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:47.642114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:47.642114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:47.642114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:47.642114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:47.642114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:47.642114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:47.642114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:47.642114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:47.642114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:47.642114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:47.642114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:47.642114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:47.643392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:47.643392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:47.643392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:21:47.643392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:21:47.643392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:21:47.643392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:21:47.643392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:21:47.643392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:21:47.643392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 09:21:47.643392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:47.643392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 531/1071] 10.222.0.60 () {56 vars in 1093 bytes} [Thu May 12 09:21:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:47.648014 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7125450-2d1b-48d3-9b44-a2b5ae8a33ef None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:47.743281 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7125450-2d1b-48d3-9b44-a2b5ae8a33ef None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:47.776735 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d78124-5795-4520-88b8-36a47966e141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:47.777394 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d78124-5795-4520-88b8-36a47966e141 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:47.777676 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d78124-5795-4520-88b8-36a47966e141 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:47.777983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d78124-5795-4520-88b8-36a47966e141 None admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:47.778808 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d78124-5795-4520-88b8-36a47966e141 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:47.779117 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d78124-5795-4520-88b8-36a47966e141 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:47.780530 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d78124-5795-4520-88b8-36a47966e141 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:47.796830 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 541/1072] 10.222.0.60 () {56 vars in 1133 bytes} [Thu May 12 09:21:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:47.802360 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731f90a-89bf-4293-8462-5c779159400f None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:47.898962 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731f90a-89bf-4293-8462-5c779159400f None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:47.930695 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430531e1-fdf4-427d-b585-06560182a671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:47.931516 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430531e1-fdf4-427d-b585-06560182a671 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:47.931796 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430531e1-fdf4-427d-b585-06560182a671 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:47.932068 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430531e1-fdf4-427d-b585-06560182a671 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:47.942138 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430531e1-fdf4-427d-b585-06560182a671 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:47.943583 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430531e1-fdf4-427d-b585-06560182a671 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:47.960317 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-430531e1-fdf4-427d-b585-06560182a671 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:47.960317 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:47.960317 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:47.960317 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:47.960317 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:47.960317 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:47.960317 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:47.960317 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:47.960317 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:47.960317 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:47.960317 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:47.960317 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:47.960317 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:21:47.960317 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:21:47.960317 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:21:47.961381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:21:47.961381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:47.961381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:47.961381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:47.961381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:47.961381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:47.961381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:47.961381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:47.961381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:47.961381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:47.961381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:47.961381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:47.961381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:47.961381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:47.961381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:47.961381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:47.961381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:47.962833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:21:47.962833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:21:47.962833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:47.962833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:47.962833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 532/1073] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:47.967171 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d78124-5795-4520-88b8-36a47966e141 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:48.061348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d78124-5795-4520-88b8-36a47966e141 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:48.093025 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e7690-b899-4f4c-be43-56f1caddd03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:48.093674 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e7690-b899-4f4c-be43-56f1caddd03b None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:48.093985 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e7690-b899-4f4c-be43-56f1caddd03b None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:48.094258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e7690-b899-4f4c-be43-56f1caddd03b None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:48.094978 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e7690-b899-4f4c-be43-56f1caddd03b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:48.095279 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e7690-b899-4f4c-be43-56f1caddd03b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:48.096642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e7690-b899-4f4c-be43-56f1caddd03b None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:48.110041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 542/1074] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:48.115675 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430531e1-fdf4-427d-b585-06560182a671 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:48.208783 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430531e1-fdf4-427d-b585-06560182a671 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:48.240769 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5465e-1f0e-44fc-9497-4b7c34433529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:48.241555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5465e-1f0e-44fc-9497-4b7c34433529 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:48.241836 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5465e-1f0e-44fc-9497-4b7c34433529 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:48.242137 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5465e-1f0e-44fc-9497-4b7c34433529 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:48.248617 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5465e-1f0e-44fc-9497-4b7c34433529 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:48.250069 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5465e-1f0e-44fc-9497-4b7c34433529 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:48.264087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-3fe5465e-1f0e-44fc-9497-4b7c34433529 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:48.264087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:48.264087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:48.264087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:48.264087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:48.264087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:48.264087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:48.264087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:48.264087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:48.264087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:48.264087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:48.264087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:48.264087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:21:48.264087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:21:48.264087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:21:48.265026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:21:48.265026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:48.265026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:48.265026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:48.265026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:48.265026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:48.265026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:48.265026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:48.265026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:48.265026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:48.265026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:48.265026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:48.265026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:48.265026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:48.265026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:48.265026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:48.265026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:48.265964 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:21:48.265964 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:21:48.265964 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:21:48.265964 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:21:48.265964 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:21:48.265964 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:21:48.265964 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:48.265964 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:48.265964 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 533/1075] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:21:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:48.271163 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e7690-b899-4f4c-be43-56f1caddd03b None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:48.365157 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e7690-b899-4f4c-be43-56f1caddd03b None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:48.397395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d97371-9c32-4663-8e86-b32b543c287f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:48.398085 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d97371-9c32-4663-8e86-b32b543c287f None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:48.398372 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d97371-9c32-4663-8e86-b32b543c287f None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:48.398649 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d97371-9c32-4663-8e86-b32b543c287f None admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:48.399428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d97371-9c32-4663-8e86-b32b543c287f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:48.399739 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d97371-9c32-4663-8e86-b32b543c287f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:48.401235 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d97371-9c32-4663-8e86-b32b543c287f None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:48.412889 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 543/1076] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:21:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:48.419335 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5465e-1f0e-44fc-9497-4b7c34433529 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:48.515741 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5465e-1f0e-44fc-9497-4b7c34433529 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:48.548163 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61d77e-1b27-4893-bdd2-4c9c60006afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:48.549054 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61d77e-1b27-4893-bdd2-4c9c60006afe None admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:48.549334 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61d77e-1b27-4893-bdd2-4c9c60006afe None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:48.549608 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61d77e-1b27-4893-bdd2-4c9c60006afe None admin] PATH_INFO: `/v3/projects/9cf4f2954dd44516b3e594ed440781cc/users/2915babd40aa42e8bf7cc85c5a97daa6/roles/ee3dbb0fb690434ca94adf68e3148ab2` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:48.551852 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61d77e-1b27-4893-bdd2-4c9c60006afe None admin] RBAC: Authorizing `identity:create_grant(project_id=9cf4f2954dd44516b3e594ed440781cc, user_id=2915babd40aa42e8bf7cc85c5a97daa6, role_id=ee3dbb0fb690434ca94adf68e3148ab2)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:48.553303 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61d77e-1b27-4893-bdd2-4c9c60006afe None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:48.566348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 534/1077] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 12 09:21:48 2022] PUT /identity/v3/projects/9cf4f2954dd44516b3e594ed440781cc/users/2915babd40aa42e8bf7cc85c5a97daa6/roles/ee3dbb0fb690434ca94adf68e3148ab2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:21:48.929304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f6be4-117e-4e3a-8730-d9a0d0966bd4 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:48.929839 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f6be4-117e-4e3a-8730-d9a0d0966bd4 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:48.929839 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f6be4-117e-4e3a-8730-d9a0d0966bd4 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:48.931743 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 544/1078] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:48.937121 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd37787-4074-4d5a-b957-6881357f048b None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:48.937540 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd37787-4074-4d5a-b957-6881357f048b None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:48.937668 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd37787-4074-4d5a-b957-6881357f048b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:48.954335 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-5cd37787-4074-4d5a-b957-6881357f048b None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:48.955478 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-5cd37787-4074-4d5a-b957-6881357f048b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:49.018567 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 535/1079] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:21:49.040290 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f6be4-117e-4e3a-8730-d9a0d0966bd4 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:49.143014 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f6be4-117e-4e3a-8730-d9a0d0966bd4 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:49.175620 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac624a-e9b2-4efa-832a-056af0ed057a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:49.176412 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac624a-e9b2-4efa-832a-056af0ed057a None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:49.176674 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac624a-e9b2-4efa-832a-056af0ed057a None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:49.176945 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac624a-e9b2-4efa-832a-056af0ed057a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:49.186513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac624a-e9b2-4efa-832a-056af0ed057a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:21:49.193943 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-c7ac624a-e9b2-4efa-832a-056af0ed057a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:21:49.193943 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:49.193943 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:49.193943 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:49.193943 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:49.193943 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:49.193943 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:49.193943 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:49.193943 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:49.193943 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:49.193943 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:49.193943 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:49.193943 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:21:49.193943 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:21:49.193943 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:21:49.193943 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:21:49.195050 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:21:49.195050 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:21:49.195050 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:21:49.195050 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:21:49.195050 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:49.195050 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:49.195050 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:49.195050 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:49.195050 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:49.195050 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:49.195050 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:49.195050 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:49.195050 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:49.195050 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:49.195050 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:49.195050 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:49.196119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:49.196119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:49.196119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:49.196119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:49.196119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:21:49.196119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:21:49.196119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:21:49.196119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:21:49.196119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:21:49.196119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:21:49.196119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:21:49.196119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:49.196119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 545/1080] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:21:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:49.201576 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd37787-4074-4d5a-b957-6881357f048b None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:49.293925 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd37787-4074-4d5a-b957-6881357f048b None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:49.327312 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe33293-083d-49e6-80c4-50ceac340d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:49.327981 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe33293-083d-49e6-80c4-50ceac340d09 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:49.328260 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe33293-083d-49e6-80c4-50ceac340d09 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:49.328741 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe33293-083d-49e6-80c4-50ceac340d09 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:49.329481 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe33293-083d-49e6-80c4-50ceac340d09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:49.329869 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe33293-083d-49e6-80c4-50ceac340d09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:49.332387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe33293-083d-49e6-80c4-50ceac340d09 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:49.343154 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 536/1081] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:21:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:49.348742 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac624a-e9b2-4efa-832a-056af0ed057a None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:49.443950 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac624a-e9b2-4efa-832a-056af0ed057a None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:49.474820 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d4652-14e1-4a30-84af-948838bee352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:49.475677 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d4652-14e1-4a30-84af-948838bee352 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:49.475960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d4652-14e1-4a30-84af-948838bee352 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:49.476231 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d4652-14e1-4a30-84af-948838bee352 None admin] PATH_INFO: `/v3/users/721924137592405eb0a1e908ea65998b` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:49.477410 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d4652-14e1-4a30-84af-948838bee352 None admin] RBAC: Authorizing `identity:get_user(user_id=721924137592405eb0a1e908ea65998b)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:49.479372 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d4652-14e1-4a30-84af-948838bee352 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:49.480962 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 546/1082] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:21:49 2022] GET /identity/v3/users/721924137592405eb0a1e908ea65998b => generated 285 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:49.486634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe33293-083d-49e6-80c4-50ceac340d09 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:49.580011 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe33293-083d-49e6-80c4-50ceac340d09 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:49.610992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce38da3-04d5-4ed6-a990-8c20c9ce2af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:49.611847 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce38da3-04d5-4ed6-a990-8c20c9ce2af3 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:49.612129 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce38da3-04d5-4ed6-a990-8c20c9ce2af3 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:49.612447 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce38da3-04d5-4ed6-a990-8c20c9ce2af3 None admin] PATH_INFO: `/v3/projects/35571df3fe6a4f099786e6475bcd5ce8` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:49.613774 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce38da3-04d5-4ed6-a990-8c20c9ce2af3 None admin] RBAC: Authorizing `identity:get_project(project_id=35571df3fe6a4f099786e6475bcd5ce8)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:49.615227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce38da3-04d5-4ed6-a990-8c20c9ce2af3 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:49.616914 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 537/1083] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:21:49 2022] GET /identity/v3/projects/35571df3fe6a4f099786e6475bcd5ce8 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:49.623212 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d4652-14e1-4a30-84af-948838bee352 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:49.719914 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d4652-14e1-4a30-84af-948838bee352 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:49.757520 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba101e-f86f-4600-84fa-3c08af883174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:49.758432 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba101e-f86f-4600-84fa-3c08af883174 None admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:49.758710 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba101e-f86f-4600-84fa-3c08af883174 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:49.758984 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba101e-f86f-4600-84fa-3c08af883174 None admin] PATH_INFO: `/v3/projects/35571df3fe6a4f099786e6475bcd5ce8/users/721924137592405eb0a1e908ea65998b/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:49.760965 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba101e-f86f-4600-84fa-3c08af883174 None admin] RBAC: Authorizing `identity:create_grant(project_id=35571df3fe6a4f099786e6475bcd5ce8, user_id=721924137592405eb0a1e908ea65998b, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:49.762424 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba101e-f86f-4600-84fa-3c08af883174 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:49.776726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 547/1084] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 12 09:21:49 2022] PUT /identity/v3/projects/35571df3fe6a4f099786e6475bcd5ce8/users/721924137592405eb0a1e908ea65998b/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:21:50.765210 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71efa8dd-01a8-4e38-8ce2-a272d84b7220 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:50.765748 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71efa8dd-01a8-4e38-8ce2-a272d84b7220 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:50.765748 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71efa8dd-01a8-4e38-8ce2-a272d84b7220 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:50.767294 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 538/1085] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:50.772218 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c81e5-e8c2-4e32-9814-d040d7b65fdb None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:50.772670 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c81e5-e8c2-4e32-9814-d040d7b65fdb None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:50.772763 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c81e5-e8c2-4e32-9814-d040d7b65fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:50.789528 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-ff3c81e5-e8c2-4e32-9814-d040d7b65fdb None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:50.790715 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-ff3c81e5-e8c2-4e32-9814-d040d7b65fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:50.852503 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 548/1086] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:21:50.875786 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71efa8dd-01a8-4e38-8ce2-a272d84b7220 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:50.973337 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71efa8dd-01a8-4e38-8ce2-a272d84b7220 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:51.005391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3a0a9-f717-42a2-b209-03aab53485fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:51.006240 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3a0a9-f717-42a2-b209-03aab53485fb None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:51.006524 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3a0a9-f717-42a2-b209-03aab53485fb None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:51.006798 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3a0a9-f717-42a2-b209-03aab53485fb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:51.016486 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e3a0a9-f717-42a2-b209-03aab53485fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:21:51.024614 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-f0e3a0a9-f717-42a2-b209-03aab53485fb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 09:21:51.024614 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:51.024614 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:51.024614 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:51.024614 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:51.024614 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:51.024614 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:51.024614 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:51.024614 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:51.024614 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:51.024614 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:51.024614 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:51.024614 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:21:51.024614 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:21:51.024614 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:21:51.024614 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:21:51.026282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:21:51.026282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:21:51.026282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:21:51.026282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:21:51.026282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:51.026282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:51.026282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:51.026282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:51.026282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:51.026282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:51.026282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:51.026282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:51.026282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:51.026282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:51.026282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:51.026282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:51.027189 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:51.027189 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:51.027189 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:51.027189 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:51.027189 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:21:51.027189 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:21:51.027189 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:21:51.027189 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:21:51.027189 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:21:51.027189 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:21:51.027189 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 09:21:51.027189 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:51.027189 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 539/1087] 10.222.0.60 () {56 vars in 1120 bytes} [Thu May 12 09:21:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:51.032600 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c81e5-e8c2-4e32-9814-d040d7b65fdb None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:51.126180 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c81e5-e8c2-4e32-9814-d040d7b65fdb None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:51.158810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8f0d0-a049-4b05-89cf-699c6264c130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:51.159452 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8f0d0-a049-4b05-89cf-699c6264c130 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:51.159734 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8f0d0-a049-4b05-89cf-699c6264c130 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:51.160008 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8f0d0-a049-4b05-89cf-699c6264c130 None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:51.160748 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8f0d0-a049-4b05-89cf-699c6264c130 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:51.161055 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8f0d0-a049-4b05-89cf-699c6264c130 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:51.162458 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8f0d0-a049-4b05-89cf-699c6264c130 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:51.170557 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 549/1088] 10.222.0.60 () {56 vars in 1115 bytes} [Thu May 12 09:21:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:51.176076 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3a0a9-f717-42a2-b209-03aab53485fb None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:51.269350 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3a0a9-f717-42a2-b209-03aab53485fb None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:51.301741 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e6517-df3b-4087-aab2-107e507f8400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:51.302569 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e6517-df3b-4087-aab2-107e507f8400 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:51.302854 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e6517-df3b-4087-aab2-107e507f8400 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:51.303131 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e6517-df3b-4087-aab2-107e507f8400 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:51.313129 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e6517-df3b-4087-aab2-107e507f8400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:51.314584 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e6517-df3b-4087-aab2-107e507f8400 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:51.330903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-2d8e6517-df3b-4087-aab2-107e507f8400 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:51.330903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:51.330903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:51.330903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:51.330903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:51.330903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:51.330903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:51.330903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:51.330903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:51.330903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:51.330903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:51.330903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:51.330903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:21:51.330903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:21:51.330903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:21:51.331860 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:21:51.331860 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:51.331860 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:51.331860 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:51.331860 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:51.331860 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:51.331860 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:51.331860 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:51.331860 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:51.331860 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:51.331860 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:51.331860 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:51.331860 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:51.331860 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:51.331860 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:51.331860 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:51.331860 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:51.333208 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:21:51.333208 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:21:51.333208 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:51.333208 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:51.333208 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 540/1089] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:51.338251 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8f0d0-a049-4b05-89cf-699c6264c130 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:51.432400 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8f0d0-a049-4b05-89cf-699c6264c130 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:51.464689 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fa2f6-6409-465e-b66e-528f9f8b177f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:51.465345 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fa2f6-6409-465e-b66e-528f9f8b177f None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:51.465628 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fa2f6-6409-465e-b66e-528f9f8b177f None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:51.465923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fa2f6-6409-465e-b66e-528f9f8b177f None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:51.466648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fa2f6-6409-465e-b66e-528f9f8b177f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:51.466955 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fa2f6-6409-465e-b66e-528f9f8b177f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:51.468324 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fa2f6-6409-465e-b66e-528f9f8b177f None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:51.479744 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 550/1090] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:51.485326 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e6517-df3b-4087-aab2-107e507f8400 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:51.579752 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e6517-df3b-4087-aab2-107e507f8400 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:51.611497 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabd45b-1588-414b-833c-986af69ee3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:51.612566 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabd45b-1588-414b-833c-986af69ee3d2 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:51.612903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabd45b-1588-414b-833c-986af69ee3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:51.613239 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabd45b-1588-414b-833c-986af69ee3d2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:51.620988 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edabd45b-1588-414b-833c-986af69ee3d2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:51.622484 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edabd45b-1588-414b-833c-986af69ee3d2 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:51.636844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-edabd45b-1588-414b-833c-986af69ee3d2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 09:21:51.636844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:51.636844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:51.636844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:51.636844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:51.636844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:51.636844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:51.636844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:51.636844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:51.636844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:51.636844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:51.636844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:51.636844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:21:51.636844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:21:51.636844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:21:51.636844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:21:51.637999 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:51.637999 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:51.637999 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:21:51.637999 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:51.637999 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:21:51.637999 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:21:51.637999 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:51.637999 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:51.637999 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:51.637999 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:51.637999 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:51.637999 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:51.637999 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:51.637999 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:51.637999 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:51.637999 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:51.637999 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:51.637999 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:51.638986 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:51.638986 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:51.638986 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:21:51.638986 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:21:51.638986 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:21:51.638986 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:21:51.638986 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:21:51.638986 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:21:51.638986 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 09:21:51.638986 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:51.638986 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 541/1091] 10.222.0.60 () {56 vars in 1093 bytes} [Thu May 12 09:21:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:51.643780 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fa2f6-6409-465e-b66e-528f9f8b177f None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:51.738334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fa2f6-6409-465e-b66e-528f9f8b177f None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:51.772269 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd548a4-9779-4d19-92cf-d8bbc7782c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:51.772948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd548a4-9779-4d19-92cf-d8bbc7782c81 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:51.773222 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd548a4-9779-4d19-92cf-d8bbc7782c81 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:51.773494 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd548a4-9779-4d19-92cf-d8bbc7782c81 None admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:51.774390 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd548a4-9779-4d19-92cf-d8bbc7782c81 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:51.774701 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd548a4-9779-4d19-92cf-d8bbc7782c81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:51.776220 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd548a4-9779-4d19-92cf-d8bbc7782c81 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:51.795390 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 551/1092] 10.222.0.60 () {56 vars in 1133 bytes} [Thu May 12 09:21:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:51.801315 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabd45b-1588-414b-833c-986af69ee3d2 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:51.897128 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabd45b-1588-414b-833c-986af69ee3d2 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:51.928112 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14c4a5-b15e-4e4a-a13f-adfbe4e78a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:51.928760 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14c4a5-b15e-4e4a-a13f-adfbe4e78a02 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:51.929041 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14c4a5-b15e-4e4a-a13f-adfbe4e78a02 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:51.929314 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14c4a5-b15e-4e4a-a13f-adfbe4e78a02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:51.966978 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16df5a0-ec21-495d-8c9b-132f94477f5b None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:51.967265 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16df5a0-ec21-495d-8c9b-132f94477f5b None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:51.967541 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16df5a0-ec21-495d-8c9b-132f94477f5b None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:51.968896 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 552/1093] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:21:51.974042 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47412e02-9a7c-4ed5-9689-60d57b52e2fc None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:51.974326 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47412e02-9a7c-4ed5-9689-60d57b52e2fc None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:51.974601 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47412e02-9a7c-4ed5-9689-60d57b52e2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:51.990480 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-47412e02-9a7c-4ed5-9689-60d57b52e2fc None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:51.991650 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-47412e02-9a7c-4ed5-9689-60d57b52e2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:51.993023 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d14c4a5-b15e-4e4a-a13f-adfbe4e78a02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:51.994984 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d14c4a5-b15e-4e4a-a13f-adfbe4e78a02 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:52.054861 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 553/1094] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 09:21:52.079002 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47412e02-9a7c-4ed5-9689-60d57b52e2fc None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:52.090569 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 542/1095] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:21:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 09:21:52.091541 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14c4a5-b15e-4e4a-a13f-adfbe4e78a02 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:52.172059 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47412e02-9a7c-4ed5-9689-60d57b52e2fc None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:52.183483 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14c4a5-b15e-4e4a-a13f-adfbe4e78a02 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:52.203588 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae52d7f-785c-4a7c-b6ff-39f41f724344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:52.204365 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae52d7f-785c-4a7c-b6ff-39f41f724344 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:52.204643 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae52d7f-785c-4a7c-b6ff-39f41f724344 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:52.204912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae52d7f-785c-4a7c-b6ff-39f41f724344 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:52.214395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae52d7f-785c-4a7c-b6ff-39f41f724344 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:21:52.214870 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6fee62-cf63-4178-b6eb-fbed3870f85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:52.215658 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fee62-cf63-4178-b6eb-fbed3870f85a None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:52.215940 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fee62-cf63-4178-b6eb-fbed3870f85a None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:52.216211 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6fee62-cf63-4178-b6eb-fbed3870f85a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:52.221887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-9ae52d7f-785c-4a7c-b6ff-39f41f724344 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:21:52.221887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:52.221887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:52.221887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:52.221887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:52.221887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:52.221887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:52.221887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:52.221887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:52.221887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:52.221887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:52.221887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:52.221887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:21:52.221887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:21:52.221887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:21:52.221887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:21:52.222829 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:21:52.222829 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:21:52.222829 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:21:52.222829 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:21:52.222829 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:52.222829 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:52.222829 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:52.222829 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:52.222829 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:52.222829 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:52.222829 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:52.222829 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:21:52.222829 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:52.222829 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:52.222829 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:52.222829 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:52.223689 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:52.223689 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:52.223689 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:52.223689 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:52.223689 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:21:52.223689 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:21:52.223689 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:21:52.223689 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:21:52.223689 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:21:52.223689 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:21:52.223689 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:21:52.223689 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:21:52.223689 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 554/1096] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:21:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:52.226004 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6fee62-cf63-4178-b6eb-fbed3870f85a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:52.227438 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6fee62-cf63-4178-b6eb-fbed3870f85a None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:52.229668 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae52d7f-785c-4a7c-b6ff-39f41f724344 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:52.245440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-ff6fee62-cf63-4178-b6eb-fbed3870f85a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:52.245440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:52.245440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:52.245440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:52.245440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:52.245440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:52.245440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:52.245440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:52.245440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:52.245440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:52.245440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:52.245440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:52.245440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:21:52.245440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:21:52.245440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:21:52.246578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:21:52.246578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:52.246578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:52.246578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:52.246578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:52.246578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:52.246578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:52.246578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:52.246578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:52.246578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:52.246578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:52.246578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:52.246578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:52.246578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:52.246578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:52.246578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:52.246578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:52.251200 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:21:52.251200 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:21:52.251200 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:21:52.251200 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:52.251200 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 543/1097] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:21:52.252011 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6fee62-cf63-4178-b6eb-fbed3870f85a None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:52.328167 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae52d7f-785c-4a7c-b6ff-39f41f724344 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:52.343288 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6fee62-cf63-4178-b6eb-fbed3870f85a None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:52.359388 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb72dd5-c303-4130-8593-0e06596623b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:52.360038 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb72dd5-c303-4130-8593-0e06596623b2 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:52.360316 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb72dd5-c303-4130-8593-0e06596623b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:52.360587 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb72dd5-c303-4130-8593-0e06596623b2 None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:52.361317 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb72dd5-c303-4130-8593-0e06596623b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:52.361619 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb72dd5-c303-4130-8593-0e06596623b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:52.363018 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb72dd5-c303-4130-8593-0e06596623b2 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:52.371145 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 555/1098] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:21:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:52.375736 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db72096-fb53-47e6-84ca-19335fcaac66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:52.376600 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db72096-fb53-47e6-84ca-19335fcaac66 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:52.376728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb72dd5-c303-4130-8593-0e06596623b2 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:52.376881 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db72096-fb53-47e6-84ca-19335fcaac66 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:52.377157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db72096-fb53-47e6-84ca-19335fcaac66 None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:52.377864 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db72096-fb53-47e6-84ca-19335fcaac66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:52.378202 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db72096-fb53-47e6-84ca-19335fcaac66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:52.379545 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db72096-fb53-47e6-84ca-19335fcaac66 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:52.395142 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 544/1099] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:52.396066 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db72096-fb53-47e6-84ca-19335fcaac66 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:52.469826 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb72dd5-c303-4130-8593-0e06596623b2 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:52.490021 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db72096-fb53-47e6-84ca-19335fcaac66 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:52.501603 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e47cb-1104-4478-bafe-15cbe2ca662f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:52.502488 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e47cb-1104-4478-bafe-15cbe2ca662f None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:52.502772 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e47cb-1104-4478-bafe-15cbe2ca662f None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:52.503050 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e47cb-1104-4478-bafe-15cbe2ca662f None admin] PATH_INFO: `/v3/users/721924137592405eb0a1e908ea65998b` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:52.504245 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e47cb-1104-4478-bafe-15cbe2ca662f None admin] RBAC: Authorizing `identity:get_user(user_id=721924137592405eb0a1e908ea65998b)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:52.505967 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e47cb-1104-4478-bafe-15cbe2ca662f None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:52.507574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 556/1100] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:21:52 2022] GET /identity/v3/users/721924137592405eb0a1e908ea65998b => generated 285 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:52.513684 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e47cb-1104-4478-bafe-15cbe2ca662f None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:52.522467 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da1093-95ef-47cb-a4ba-4e04a5031cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:52.523258 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da1093-95ef-47cb-a4ba-4e04a5031cf3 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:52.523536 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da1093-95ef-47cb-a4ba-4e04a5031cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:52.523805 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da1093-95ef-47cb-a4ba-4e04a5031cf3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:52.530220 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da1093-95ef-47cb-a4ba-4e04a5031cf3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:52.531660 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da1093-95ef-47cb-a4ba-4e04a5031cf3 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:52.545550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-04da1093-95ef-47cb-a4ba-4e04a5031cf3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:52.545550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:21:52.545550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:21:52.545550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:21:52.545550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:21:52.545550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:21:52.545550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:21:52.545550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:21:52.545550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:21:52.545550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:21:52.545550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:21:52.545550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:21:52.545550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:21:52.545550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:21:52.545550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:21:52.546506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:21:52.546506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:21:52.546506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:21:52.546506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:21:52.546506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:21:52.546506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:21:52.546506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:21:52.546506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:21:52.546506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:21:52.546506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:21:52.546506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:21:52.546506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:21:52.546506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:21:52.546506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:21:52.546506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:21:52.546506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:21:52.546506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:21:52.547426 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:21:52.547426 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:21:52.547426 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:21:52.547426 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:21:52.547426 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:21:52.547426 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:21:52.547426 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:21:52.547426 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:21:52.547426 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 545/1101] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:21:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:21:52.552441 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da1093-95ef-47cb-a4ba-4e04a5031cf3 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:52.614347 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e47cb-1104-4478-bafe-15cbe2ca662f None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:52.645556 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da1093-95ef-47cb-a4ba-4e04a5031cf3 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:52.646153 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074450f0-3af2-4757-a1aa-9d6b81408145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:52.646796 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074450f0-3af2-4757-a1aa-9d6b81408145 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:52.647080 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074450f0-3af2-4757-a1aa-9d6b81408145 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:52.647353 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074450f0-3af2-4757-a1aa-9d6b81408145 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:52.677742 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b0823-05bd-4d1f-baac-b94ffde9824d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:52.678406 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b0823-05bd-4d1f-baac-b94ffde9824d None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:52.678682 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b0823-05bd-4d1f-baac-b94ffde9824d None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:52.678949 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b0823-05bd-4d1f-baac-b94ffde9824d None admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:52.679712 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b0823-05bd-4d1f-baac-b94ffde9824d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:52.680013 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b0823-05bd-4d1f-baac-b94ffde9824d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:52.681952 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b0823-05bd-4d1f-baac-b94ffde9824d None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:52.692693 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 546/1102] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:21:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:52.699069 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b0823-05bd-4d1f-baac-b94ffde9824d None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:52.711586 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074450f0-3af2-4757-a1aa-9d6b81408145 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:52.713549 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074450f0-3af2-4757-a1aa-9d6b81408145 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:52.790094 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b0823-05bd-4d1f-baac-b94ffde9824d None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:52.805358 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 557/1103] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:21:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 09:21:52.811707 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074450f0-3af2-4757-a1aa-9d6b81408145 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:52.822370 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad21c6-097d-4261-86ae-710fe1946269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:52.823026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad21c6-097d-4261-86ae-710fe1946269 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:52.823315 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad21c6-097d-4261-86ae-710fe1946269 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:52.823569 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad21c6-097d-4261-86ae-710fe1946269 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:52.824385 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad21c6-097d-4261-86ae-710fe1946269 None admin] RBAC: Adding query filter params (role.id=ee3dbb0fb690434ca94adf68e3148ab2, scope.project.id=9cf4f2954dd44516b3e594ed440781cc, user.id=2915babd40aa42e8bf7cc85c5a97daa6) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:52.824678 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad21c6-097d-4261-86ae-710fe1946269 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:52.826108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad21c6-097d-4261-86ae-710fe1946269 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:52.831599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 547/1104] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:21:52 2022] GET /identity/v3/role_assignments?user.id=2915babd40aa42e8bf7cc85c5a97daa6&scope.project.id=9cf4f2954dd44516b3e594ed440781cc&role.id=ee3dbb0fb690434ca94adf68e3148ab2 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:52.910960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074450f0-3af2-4757-a1aa-9d6b81408145 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:52.945645 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ef4da-ec95-4f6b-b31e-c10a95871dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:52.946539 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ef4da-ec95-4f6b-b31e-c10a95871dda None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:52.946879 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ef4da-ec95-4f6b-b31e-c10a95871dda None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:52.947150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ef4da-ec95-4f6b-b31e-c10a95871dda None admin] PATH_INFO: `/v3/projects/35571df3fe6a4f099786e6475bcd5ce8` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:52.948349 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ef4da-ec95-4f6b-b31e-c10a95871dda None admin] RBAC: Authorizing `identity:get_project(project_id=35571df3fe6a4f099786e6475bcd5ce8)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:52.949794 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ef4da-ec95-4f6b-b31e-c10a95871dda None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:52.951525 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 558/1105] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:21:52 2022] GET /identity/v3/projects/35571df3fe6a4f099786e6475bcd5ce8 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:21:52.958739 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad21c6-097d-4261-86ae-710fe1946269 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:53.062764 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad21c6-097d-4261-86ae-710fe1946269 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:53.095421 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f60f95-4567-4d4e-b87f-6e2027bc4013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:53.096093 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f60f95-4567-4d4e-b87f-6e2027bc4013 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:53.096379 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f60f95-4567-4d4e-b87f-6e2027bc4013 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:53.096652 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f60f95-4567-4d4e-b87f-6e2027bc4013 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:53.098927 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f60f95-4567-4d4e-b87f-6e2027bc4013 None admin] RBAC: Adding query filter params (role.id=8f01c4c38fa44034a54c1f8cd2d2db1a, scope.project.id=35571df3fe6a4f099786e6475bcd5ce8, user.id=721924137592405eb0a1e908ea65998b) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:53.098927 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f60f95-4567-4d4e-b87f-6e2027bc4013 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:53.099245 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f60f95-4567-4d4e-b87f-6e2027bc4013 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:53.105555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 548/1106] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:21:52 2022] GET /identity/v3/role_assignments?user.id=721924137592405eb0a1e908ea65998b&scope.project.id=35571df3fe6a4f099786e6475bcd5ce8&role.id=8f01c4c38fa44034a54c1f8cd2d2db1a => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:55.355522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73659b-784c-4bf4-8d5b-140fec934f46 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:55.356064 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73659b-784c-4bf4-8d5b-140fec934f46 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:55.356064 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73659b-784c-4bf4-8d5b-140fec934f46 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:55.357326 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 559/1107] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:55.362485 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b356f5-fea8-4c77-ae3f-721af9065c1f None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:55.362936 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b356f5-fea8-4c77-ae3f-721af9065c1f None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:55.363040 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b356f5-fea8-4c77-ae3f-721af9065c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:55.379486 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-66b356f5-fea8-4c77-ae3f-721af9065c1f None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:55.380881 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-66b356f5-fea8-4c77-ae3f-721af9065c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:55.441994 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 549/1108] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:21:55.467176 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73659b-784c-4bf4-8d5b-140fec934f46 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:55.565698 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73659b-784c-4bf4-8d5b-140fec934f46 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:55.597383 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc19fd-f791-4054-ad3a-3d7a369225cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:55.598185 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc19fd-f791-4054-ad3a-3d7a369225cb None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:55.598466 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc19fd-f791-4054-ad3a-3d7a369225cb None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:55.598736 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc19fd-f791-4054-ad3a-3d7a369225cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:55.599895 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc19fd-f791-4054-ad3a-3d7a369225cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:55.601322 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc19fd-f791-4054-ad3a-3d7a369225cb None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:55.602958 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 560/1109] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:21:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:55.608624 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b356f5-fea8-4c77-ae3f-721af9065c1f None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:55.701663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b356f5-fea8-4c77-ae3f-721af9065c1f None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:55.732511 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77955c4d-a95c-4fee-88da-4c8bfd27cc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:55.733163 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77955c4d-a95c-4fee-88da-4c8bfd27cc55 None admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:55.733443 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77955c4d-a95c-4fee-88da-4c8bfd27cc55 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:55.733715 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77955c4d-a95c-4fee-88da-4c8bfd27cc55 None admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:55.734436 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77955c4d-a95c-4fee-88da-4c8bfd27cc55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:55.735840 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77955c4d-a95c-4fee-88da-4c8bfd27cc55 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:55.755610 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 550/1110] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 12 09:21:55 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:21:57.990551 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0967a-3375-42fa-9a7f-217e3f6fbe0d None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:57.991122 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0967a-3375-42fa-9a7f-217e3f6fbe0d None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:57.991122 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0967a-3375-42fa-9a7f-217e3f6fbe0d None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:57.992423 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 561/1111] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:21:57.998329 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cc7ca-6811-443b-a291-adec3e04e25c None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:57.998765 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cc7ca-6811-443b-a291-adec3e04e25c None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:57.998862 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cc7ca-6811-443b-a291-adec3e04e25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:58.015779 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-bb8cc7ca-6811-443b-a291-adec3e04e25c None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:21:58.016933 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-bb8cc7ca-6811-443b-a291-adec3e04e25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:21:58.079027 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 551/1112] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:21:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:21:58.102117 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0967a-3375-42fa-9a7f-217e3f6fbe0d None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:58.196416 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0967a-3375-42fa-9a7f-217e3f6fbe0d None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:58.227609 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdafa52-a024-484c-96e8-00ad6c2d4150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:58.228950 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdafa52-a024-484c-96e8-00ad6c2d4150 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:58.229220 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdafa52-a024-484c-96e8-00ad6c2d4150 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:58.229481 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdafa52-a024-484c-96e8-00ad6c2d4150 None admin] PATH_INFO: `/v3/roles/7d5eb6a968a74fb0a30eb1e80603005c` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:58.230953 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdafa52-a024-484c-96e8-00ad6c2d4150 None admin] RBAC: Authorizing `identity:get_role(role_id=7d5eb6a968a74fb0a30eb1e80603005c)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:58.232299 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdafa52-a024-484c-96e8-00ad6c2d4150 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:58.233612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 562/1113] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:21:58 2022] GET /identity/v3/roles/7d5eb6a968a74fb0a30eb1e80603005c => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:58.239366 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cc7ca-6811-443b-a291-adec3e04e25c None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:58.330201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cc7ca-6811-443b-a291-adec3e04e25c None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:58.361073 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5162c-ef6f-430b-af74-75f7338d332b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:58.361944 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5162c-ef6f-430b-af74-75f7338d332b None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:58.362229 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5162c-ef6f-430b-af74-75f7338d332b None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:58.362499 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5162c-ef6f-430b-af74-75f7338d332b None admin] PATH_INFO: `/v3/users/e49f3d04cae84b298e6f8fdf3345929e` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:58.374680 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5162c-ef6f-430b-af74-75f7338d332b None admin] RBAC: Authorizing `identity:get_user(user_id=e49f3d04cae84b298e6f8fdf3345929e)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:58.376107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5162c-ef6f-430b-af74-75f7338d332b None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:58.377694 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 552/1114] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:21:58 2022] GET /identity/v3/users/e49f3d04cae84b298e6f8fdf3345929e => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:58.383419 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdafa52-a024-484c-96e8-00ad6c2d4150 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:58.475106 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdafa52-a024-484c-96e8-00ad6c2d4150 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:58.507148 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d87137-ac17-469c-86a4-04f09343651f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:58.508069 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d87137-ac17-469c-86a4-04f09343651f None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:58.508348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d87137-ac17-469c-86a4-04f09343651f None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:58.508618 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d87137-ac17-469c-86a4-04f09343651f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:58.570544 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d87137-ac17-469c-86a4-04f09343651f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:58.571980 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d87137-ac17-469c-86a4-04f09343651f None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:58.667446 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 563/1115] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:21:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 09:21:58.673095 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5162c-ef6f-430b-af74-75f7338d332b None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:58.765131 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5162c-ef6f-430b-af74-75f7338d332b None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:58.795762 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1cdfe-540e-48ea-a207-53803e537dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:58.796597 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1cdfe-540e-48ea-a207-53803e537dbd None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:58.796873 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1cdfe-540e-48ea-a207-53803e537dbd None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:58.797143 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1cdfe-540e-48ea-a207-53803e537dbd None admin] PATH_INFO: `/v3/projects/35571df3fe6a4f099786e6475bcd5ce8` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:58.798372 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1cdfe-540e-48ea-a207-53803e537dbd None admin] RBAC: Authorizing `identity:get_project(project_id=35571df3fe6a4f099786e6475bcd5ce8)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:58.799728 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1cdfe-540e-48ea-a207-53803e537dbd None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:58.801356 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 553/1116] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:21:58 2022] GET /identity/v3/projects/35571df3fe6a4f099786e6475bcd5ce8 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:21:58.807804 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d87137-ac17-469c-86a4-04f09343651f None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:21:58.903888 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d87137-ac17-469c-86a4-04f09343651f None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:21:58.935228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3c3f2-efdf-4aff-a0a2-52e1c5d5d7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:21:58.935799 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3c3f2-efdf-4aff-a0a2-52e1c5d5d7fe None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:21:58.936074 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3c3f2-efdf-4aff-a0a2-52e1c5d5d7fe None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:21:58.936341 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3c3f2-efdf-4aff-a0a2-52e1c5d5d7fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:21:58.937147 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3c3f2-efdf-4aff-a0a2-52e1c5d5d7fe None admin] RBAC: Adding query filter params (role.id=7d5eb6a968a74fb0a30eb1e80603005c, scope.project.id=35571df3fe6a4f099786e6475bcd5ce8, user.id=e49f3d04cae84b298e6f8fdf3345929e) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:21:58.937451 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3c3f2-efdf-4aff-a0a2-52e1c5d5d7fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:21:58.938886 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3c3f2-efdf-4aff-a0a2-52e1c5d5d7fe None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:21:58.943994 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 564/1117] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:21:58 2022] GET /identity/v3/role_assignments?user.id=e49f3d04cae84b298e6f8fdf3345929e&scope.project.id=35571df3fe6a4f099786e6475bcd5ce8&role.id=7d5eb6a968a74fb0a30eb1e80603005c => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:22:01.111979 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c05a6-f3e9-4b9b-adb1-9fb34cc61d82 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:01.112410 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c05a6-f3e9-4b9b-adb1-9fb34cc61d82 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:01.112535 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c05a6-f3e9-4b9b-adb1-9fb34cc61d82 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:01.113921 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 554/1118] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:22:01.119189 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d3682-0f15-4107-a505-206b5e791dbb None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:01.119608 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d3682-0f15-4107-a505-206b5e791dbb None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:01.119718 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d3682-0f15-4107-a505-206b5e791dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:01.136579 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-d38d3682-0f15-4107-a505-206b5e791dbb None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:22:01.137723 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-d38d3682-0f15-4107-a505-206b5e791dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:22:01.198658 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 565/1119] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:22:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:22:01.224343 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c05a6-f3e9-4b9b-adb1-9fb34cc61d82 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:01.319014 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c05a6-f3e9-4b9b-adb1-9fb34cc61d82 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:01.351326 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73a484-eaf0-4ba2-94a1-f8f33f1bccd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:01.352120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73a484-eaf0-4ba2-94a1-f8f33f1bccd4 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:01.352401 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73a484-eaf0-4ba2-94a1-f8f33f1bccd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:01.352803 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73a484-eaf0-4ba2-94a1-f8f33f1bccd4 None admin] PATH_INFO: `/v3/roles/7d5eb6a968a74fb0a30eb1e80603005c` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:01.354484 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73a484-eaf0-4ba2-94a1-f8f33f1bccd4 None admin] RBAC: Authorizing `identity:get_role(role_id=7d5eb6a968a74fb0a30eb1e80603005c)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:01.356755 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73a484-eaf0-4ba2-94a1-f8f33f1bccd4 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:01.359130 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 555/1120] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:22:01 2022] GET /identity/v3/roles/7d5eb6a968a74fb0a30eb1e80603005c => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:22:01.364793 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d3682-0f15-4107-a505-206b5e791dbb None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:01.455381 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d3682-0f15-4107-a505-206b5e791dbb None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:01.486944 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95914909-79b5-4ab0-8241-2801991a04f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:01.487789 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95914909-79b5-4ab0-8241-2801991a04f6 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:01.488065 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95914909-79b5-4ab0-8241-2801991a04f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:01.488336 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95914909-79b5-4ab0-8241-2801991a04f6 None admin] PATH_INFO: `/v3/users/e49f3d04cae84b298e6f8fdf3345929e` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:01.489495 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95914909-79b5-4ab0-8241-2801991a04f6 None admin] RBAC: Authorizing `identity:get_user(user_id=e49f3d04cae84b298e6f8fdf3345929e)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:01.490927 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95914909-79b5-4ab0-8241-2801991a04f6 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:01.492480 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 566/1121] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:22:01 2022] GET /identity/v3/users/e49f3d04cae84b298e6f8fdf3345929e => generated 286 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:22:01.498451 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73a484-eaf0-4ba2-94a1-f8f33f1bccd4 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:01.590924 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73a484-eaf0-4ba2-94a1-f8f33f1bccd4 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:01.622320 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105c889-fdd5-4857-a7ab-872a0b579b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:01.623100 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105c889-fdd5-4857-a7ab-872a0b579b79 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:01.623382 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105c889-fdd5-4857-a7ab-872a0b579b79 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:01.623657 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105c889-fdd5-4857-a7ab-872a0b579b79 None admin] PATH_INFO: `/v3/projects/35571df3fe6a4f099786e6475bcd5ce8` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:01.624817 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105c889-fdd5-4857-a7ab-872a0b579b79 None admin] RBAC: Authorizing `identity:get_project(project_id=35571df3fe6a4f099786e6475bcd5ce8)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:01.626263 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105c889-fdd5-4857-a7ab-872a0b579b79 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:01.627913 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 556/1122] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:22:01 2022] GET /identity/v3/projects/35571df3fe6a4f099786e6475bcd5ce8 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:22:01.634087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95914909-79b5-4ab0-8241-2801991a04f6 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:01.725806 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95914909-79b5-4ab0-8241-2801991a04f6 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:01.757571 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9573e-6478-47c1-9e09-093b3db3e2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:01.758453 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9573e-6478-47c1-9e09-093b3db3e2ec None admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:01.758731 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9573e-6478-47c1-9e09-093b3db3e2ec None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:01.759573 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9573e-6478-47c1-9e09-093b3db3e2ec None admin] PATH_INFO: `/v3/projects/35571df3fe6a4f099786e6475bcd5ce8/users/e49f3d04cae84b298e6f8fdf3345929e/roles/7d5eb6a968a74fb0a30eb1e80603005c` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:01.761726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9573e-6478-47c1-9e09-093b3db3e2ec None admin] RBAC: Authorizing `identity:create_grant(project_id=35571df3fe6a4f099786e6475bcd5ce8, user_id=e49f3d04cae84b298e6f8fdf3345929e, role_id=7d5eb6a968a74fb0a30eb1e80603005c)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:01.763154 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9573e-6478-47c1-9e09-093b3db3e2ec None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:01.775802 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 567/1123] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 12 09:22:01 2022] PUT /identity/v3/projects/35571df3fe6a4f099786e6475bcd5ce8/users/e49f3d04cae84b298e6f8fdf3345929e/roles/7d5eb6a968a74fb0a30eb1e80603005c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:22:03.961123 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65958b-edc1-46c2-a1d4-60a24dd25305 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:03.961664 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65958b-edc1-46c2-a1d4-60a24dd25305 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:03.961664 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65958b-edc1-46c2-a1d4-60a24dd25305 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:03.963580 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 557/1124] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:22:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:22:03.968877 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2141f6-f006-4732-9d93-26052f82ab2e None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:03.969303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2141f6-f006-4732-9d93-26052f82ab2e None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:03.969416 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2141f6-f006-4732-9d93-26052f82ab2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:03.986193 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-1b2141f6-f006-4732-9d93-26052f82ab2e None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:22:03.987362 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-1b2141f6-f006-4732-9d93-26052f82ab2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:22:04.050771 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 568/1125] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:22:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:22:04.073366 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65958b-edc1-46c2-a1d4-60a24dd25305 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:04.167877 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65958b-edc1-46c2-a1d4-60a24dd25305 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:04.199098 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05edc2a1-2286-4d91-9279-023f352e9847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:04.199938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05edc2a1-2286-4d91-9279-023f352e9847 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:04.200214 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05edc2a1-2286-4d91-9279-023f352e9847 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:04.200481 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05edc2a1-2286-4d91-9279-023f352e9847 None admin] PATH_INFO: `/v3/roles/7d5eb6a968a74fb0a30eb1e80603005c` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:04.201938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05edc2a1-2286-4d91-9279-023f352e9847 None admin] RBAC: Authorizing `identity:get_role(role_id=7d5eb6a968a74fb0a30eb1e80603005c)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:04.203300 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05edc2a1-2286-4d91-9279-023f352e9847 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:04.204641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 558/1126] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:22:04 2022] GET /identity/v3/roles/7d5eb6a968a74fb0a30eb1e80603005c => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:22:04.210483 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2141f6-f006-4732-9d93-26052f82ab2e None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:04.302448 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2141f6-f006-4732-9d93-26052f82ab2e None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:04.334157 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df1056-3c36-45d4-b84e-09217c70dada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:04.335003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df1056-3c36-45d4-b84e-09217c70dada None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:04.335284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df1056-3c36-45d4-b84e-09217c70dada None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:04.335556 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df1056-3c36-45d4-b84e-09217c70dada None admin] PATH_INFO: `/v3/users/e49f3d04cae84b298e6f8fdf3345929e` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:04.336742 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df1056-3c36-45d4-b84e-09217c70dada None admin] RBAC: Authorizing `identity:get_user(user_id=e49f3d04cae84b298e6f8fdf3345929e)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:04.338248 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df1056-3c36-45d4-b84e-09217c70dada None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:04.339824 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 569/1127] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:22:04 2022] GET /identity/v3/users/e49f3d04cae84b298e6f8fdf3345929e => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:22:04.345336 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05edc2a1-2286-4d91-9279-023f352e9847 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:04.438571 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05edc2a1-2286-4d91-9279-023f352e9847 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:04.475014 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27cf52b-82ec-4d37-9d7d-d160cb0706dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:04.475649 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cf52b-82ec-4d37-9d7d-d160cb0706dd None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:04.475928 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cf52b-82ec-4d37-9d7d-d160cb0706dd None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:04.476201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cf52b-82ec-4d37-9d7d-d160cb0706dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:04.538364 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27cf52b-82ec-4d37-9d7d-d160cb0706dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:04.539786 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27cf52b-82ec-4d37-9d7d-d160cb0706dd None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:04.630669 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 559/1128] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:22:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 09:22:04.637018 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df1056-3c36-45d4-b84e-09217c70dada None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:04.730982 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df1056-3c36-45d4-b84e-09217c70dada None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:04.762296 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de371368-bd73-49aa-8639-cae74b091032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:04.763131 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de371368-bd73-49aa-8639-cae74b091032 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:04.763414 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de371368-bd73-49aa-8639-cae74b091032 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:04.763688 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de371368-bd73-49aa-8639-cae74b091032 None admin] PATH_INFO: `/v3/projects/35571df3fe6a4f099786e6475bcd5ce8` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:04.764857 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de371368-bd73-49aa-8639-cae74b091032 None admin] RBAC: Authorizing `identity:get_project(project_id=35571df3fe6a4f099786e6475bcd5ce8)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:04.766307 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de371368-bd73-49aa-8639-cae74b091032 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:04.767944 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 570/1129] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:22:04 2022] GET /identity/v3/projects/35571df3fe6a4f099786e6475bcd5ce8 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:22:04.773689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27cf52b-82ec-4d37-9d7d-d160cb0706dd None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:04.864712 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27cf52b-82ec-4d37-9d7d-d160cb0706dd None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:04.896238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef3c7a-efb3-4fb7-af56-dc22fcece8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:04.896823 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef3c7a-efb3-4fb7-af56-dc22fcece8f7 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:04.897103 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef3c7a-efb3-4fb7-af56-dc22fcece8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:04.897375 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef3c7a-efb3-4fb7-af56-dc22fcece8f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:04.898220 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef3c7a-efb3-4fb7-af56-dc22fcece8f7 None admin] RBAC: Adding query filter params (role.id=7d5eb6a968a74fb0a30eb1e80603005c, scope.project.id=35571df3fe6a4f099786e6475bcd5ce8, user.id=e49f3d04cae84b298e6f8fdf3345929e) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:22:04.898530 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef3c7a-efb3-4fb7-af56-dc22fcece8f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:04.900003 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef3c7a-efb3-4fb7-af56-dc22fcece8f7 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:04.905462 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 560/1130] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:22:04 2022] GET /identity/v3/role_assignments?user.id=e49f3d04cae84b298e6f8fdf3345929e&scope.project.id=35571df3fe6a4f099786e6475bcd5ce8&role.id=7d5eb6a968a74fb0a30eb1e80603005c => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:22:07.115073 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d7f18-4615-45a5-b2ec-bfb07af729b1 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:07.115519 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d7f18-4615-45a5-b2ec-bfb07af729b1 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:07.115620 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d7f18-4615-45a5-b2ec-bfb07af729b1 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:07.116979 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 571/1131] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:22:07.122891 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a9eca-5756-45ad-965d-9c09c234af49 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:07.123346 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a9eca-5756-45ad-965d-9c09c234af49 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:07.123462 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a9eca-5756-45ad-965d-9c09c234af49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:07.139844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-a78a9eca-5756-45ad-965d-9c09c234af49 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:22:07.141011 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-a78a9eca-5756-45ad-965d-9c09c234af49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:22:07.203074 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 561/1132] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:22:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:22:07.226754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d7f18-4615-45a5-b2ec-bfb07af729b1 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:07.321719 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d7f18-4615-45a5-b2ec-bfb07af729b1 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:07.353046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a63407-a4a7-456e-85a6-59e7330ef5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:07.353753 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a63407-a4a7-456e-85a6-59e7330ef5b0 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:07.354065 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a63407-a4a7-456e-85a6-59e7330ef5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:07.354341 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a63407-a4a7-456e-85a6-59e7330ef5b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:07.355497 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a63407-a4a7-456e-85a6-59e7330ef5b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:07.356917 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a63407-a4a7-456e-85a6-59e7330ef5b0 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:07.358495 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 572/1133] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:22:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:22:07.363989 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a9eca-5756-45ad-965d-9c09c234af49 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:07.455015 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a9eca-5756-45ad-965d-9c09c234af49 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:07.486379 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0fd6a-c64e-4e23-9bd5-e8f8d73ddcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:07.487019 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0fd6a-c64e-4e23-9bd5-e8f8d73ddcda None admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:07.487300 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0fd6a-c64e-4e23-9bd5-e8f8d73ddcda None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:07.487571 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0fd6a-c64e-4e23-9bd5-e8f8d73ddcda None admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:07.488259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0fd6a-c64e-4e23-9bd5-e8f8d73ddcda None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:07.489673 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0fd6a-c64e-4e23-9bd5-e8f8d73ddcda None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:07.513797 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 562/1134] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 12 09:22:07 2022] POST /identity/v3/projects => generated 311 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:22:09.712691 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347ff82-7125-494f-bdca-36f8c8520743 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:09.713266 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347ff82-7125-494f-bdca-36f8c8520743 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:09.713266 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347ff82-7125-494f-bdca-36f8c8520743 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:09.714611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 573/1135] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:22:09.720177 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401e4bd-3eae-49fc-809a-3aa4f453077f None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:09.720618 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401e4bd-3eae-49fc-809a-3aa4f453077f None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:09.720728 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401e4bd-3eae-49fc-809a-3aa4f453077f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:09.737320 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-f401e4bd-3eae-49fc-809a-3aa4f453077f None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:22:09.738525 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-f401e4bd-3eae-49fc-809a-3aa4f453077f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:22:09.800917 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 563/1136] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:22:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:22:09.825123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347ff82-7125-494f-bdca-36f8c8520743 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:09.921033 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347ff82-7125-494f-bdca-36f8c8520743 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:09.954546 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb61af-ddf8-4691-b4a5-cc5dda90d7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:09.955326 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb61af-ddf8-4691-b4a5-cc5dda90d7d3 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:09.955609 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb61af-ddf8-4691-b4a5-cc5dda90d7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:09.955887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb61af-ddf8-4691-b4a5-cc5dda90d7d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:09.957098 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb61af-ddf8-4691-b4a5-cc5dda90d7d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:09.958563 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb61af-ddf8-4691-b4a5-cc5dda90d7d3 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:09.960144 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 574/1137] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:22:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:22:09.967533 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401e4bd-3eae-49fc-809a-3aa4f453077f None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:10.062473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401e4bd-3eae-49fc-809a-3aa4f453077f None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:10.093643 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff5149-a2fe-45d0-9c47-843505fa7168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:10.094350 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff5149-a2fe-45d0-9c47-843505fa7168 None admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:10.094637 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff5149-a2fe-45d0-9c47-843505fa7168 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:10.094905 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff5149-a2fe-45d0-9c47-843505fa7168 None admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:10.095603 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff5149-a2fe-45d0-9c47-843505fa7168 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:10.097088 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff5149-a2fe-45d0-9c47-843505fa7168 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:10.115809 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 564/1138] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 12 09:22:09 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:22:12.372997 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36255d80-183a-40e5-b213-3f4af6215224 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:12.373531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36255d80-183a-40e5-b213-3f4af6215224 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:12.373531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36255d80-183a-40e5-b213-3f4af6215224 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:12.374837 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 575/1139] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:22:12.380067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429589c-5549-4b5a-894c-55a4b1f98751 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:12.380724 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429589c-5549-4b5a-894c-55a4b1f98751 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:12.380860 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429589c-5549-4b5a-894c-55a4b1f98751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:12.396740 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-8429589c-5549-4b5a-894c-55a4b1f98751 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:22:12.397926 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-8429589c-5549-4b5a-894c-55a4b1f98751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:22:12.459502 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 565/1140] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:22:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:22:12.482512 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36255d80-183a-40e5-b213-3f4af6215224 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:12.577313 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36255d80-183a-40e5-b213-3f4af6215224 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:12.608468 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d5728-f417-4134-a5e7-6f1512977b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:12.609229 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d5728-f417-4134-a5e7-6f1512977b74 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:12.609505 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d5728-f417-4134-a5e7-6f1512977b74 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:12.609775 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d5728-f417-4134-a5e7-6f1512977b74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:12.619255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d5728-f417-4134-a5e7-6f1512977b74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:22:12.626882 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-732d5728-f417-4134-a5e7-6f1512977b74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:22:12.626882 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:22:12.626882 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:22:12.626882 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:22:12.626882 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:22:12.626882 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:22:12.626882 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:22:12.626882 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:22:12.626882 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:22:12.626882 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:22:12.626882 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:22:12.626882 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:22:12.626882 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:22:12.626882 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:22:12.626882 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:22:12.626882 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:22:12.628121 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:22:12.628121 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:22:12.628121 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:22:12.628121 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:22:12.628121 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:22:12.628121 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:22:12.628121 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:22:12.628121 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:22:12.628121 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:22:12.628121 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:22:12.628121 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:22:12.628121 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:22:12.628121 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:22:12.628121 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:22:12.628121 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:22:12.628121 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:22:12.629283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:22:12.629283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:22:12.629283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:22:12.629283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:22:12.629283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:22:12.629283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:22:12.629283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:22:12.629283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:22:12.629283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:22:12.629283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:22:12.629283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:22:12.629283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:22:12.629283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 576/1141] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:22:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:22:12.634549 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429589c-5549-4b5a-894c-55a4b1f98751 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:12.725996 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429589c-5549-4b5a-894c-55a4b1f98751 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:12.757188 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6c41c-df7e-4161-b785-57ea50e9af0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:12.757826 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6c41c-df7e-4161-b785-57ea50e9af0d None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:12.758132 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6c41c-df7e-4161-b785-57ea50e9af0d None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:12.758404 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6c41c-df7e-4161-b785-57ea50e9af0d None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:12.759668 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6c41c-df7e-4161-b785-57ea50e9af0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:22:12.759966 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6c41c-df7e-4161-b785-57ea50e9af0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:12.761305 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6c41c-df7e-4161-b785-57ea50e9af0d None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:12.768734 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 566/1142] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:22:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:22:12.774252 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d5728-f417-4134-a5e7-6f1512977b74 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:12.867691 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d5728-f417-4134-a5e7-6f1512977b74 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:12.899551 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a539c-42ab-4acd-800f-5f74f65ee337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:12.900334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a539c-42ab-4acd-800f-5f74f65ee337 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:12.900611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a539c-42ab-4acd-800f-5f74f65ee337 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:12.900879 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a539c-42ab-4acd-800f-5f74f65ee337 None admin] PATH_INFO: `/v3/users/4263f747b52f4c8991c40cd96b6c4104` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:12.913094 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a539c-42ab-4acd-800f-5f74f65ee337 None admin] RBAC: Authorizing `identity:get_user(user_id=4263f747b52f4c8991c40cd96b6c4104)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:12.914548 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a539c-42ab-4acd-800f-5f74f65ee337 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:12.916171 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 577/1143] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:22:12 2022] GET /identity/v3/users/4263f747b52f4c8991c40cd96b6c4104 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:22:12.921940 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6c41c-df7e-4161-b785-57ea50e9af0d None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:13.014283 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6c41c-df7e-4161-b785-57ea50e9af0d None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:13.045630 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43cfb2-6775-4fe4-8132-67498d3be9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:13.046303 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43cfb2-6775-4fe4-8132-67498d3be9c7 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:13.046583 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43cfb2-6775-4fe4-8132-67498d3be9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:13.046852 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43cfb2-6775-4fe4-8132-67498d3be9c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:13.110382 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43cfb2-6775-4fe4-8132-67498d3be9c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:13.111819 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43cfb2-6775-4fe4-8132-67498d3be9c7 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:13.202072 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 567/1144] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:22:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 09:22:13.207775 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a539c-42ab-4acd-800f-5f74f65ee337 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:13.300472 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a539c-42ab-4acd-800f-5f74f65ee337 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:13.332103 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993f8f6-f9cf-41a6-8873-4c200276af6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:13.332952 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993f8f6-f9cf-41a6-8873-4c200276af6e None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:13.333229 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993f8f6-f9cf-41a6-8873-4c200276af6e None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:13.333499 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993f8f6-f9cf-41a6-8873-4c200276af6e None admin] PATH_INFO: `/v3/projects/97543c1c0b0245329684b7c94a5661b9` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:13.334686 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993f8f6-f9cf-41a6-8873-4c200276af6e None admin] RBAC: Authorizing `identity:get_project(project_id=97543c1c0b0245329684b7c94a5661b9)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:13.336101 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993f8f6-f9cf-41a6-8873-4c200276af6e None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:13.338349 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 578/1145] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:22:13 2022] GET /identity/v3/projects/97543c1c0b0245329684b7c94a5661b9 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:22:13.344343 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43cfb2-6775-4fe4-8132-67498d3be9c7 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:13.437057 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43cfb2-6775-4fe4-8132-67498d3be9c7 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:13.469039 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb2b15-f049-46a9-9ec5-2f55a2774582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:13.469615 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb2b15-f049-46a9-9ec5-2f55a2774582 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:13.469891 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb2b15-f049-46a9-9ec5-2f55a2774582 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:13.470222 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb2b15-f049-46a9-9ec5-2f55a2774582 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:13.471010 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb2b15-f049-46a9-9ec5-2f55a2774582 None admin] RBAC: Adding query filter params (role.id=8f01c4c38fa44034a54c1f8cd2d2db1a, scope.project.id=97543c1c0b0245329684b7c94a5661b9, user.id=4263f747b52f4c8991c40cd96b6c4104) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:22:13.471311 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb2b15-f049-46a9-9ec5-2f55a2774582 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:13.472708 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb2b15-f049-46a9-9ec5-2f55a2774582 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:13.478340 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 568/1146] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:22:13 2022] GET /identity/v3/role_assignments?user.id=4263f747b52f4c8991c40cd96b6c4104&scope.project.id=97543c1c0b0245329684b7c94a5661b9&role.id=8f01c4c38fa44034a54c1f8cd2d2db1a => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:22:15.628877 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb139e2-bf2f-4266-9a07-6e229542805e None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:15.629479 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb139e2-bf2f-4266-9a07-6e229542805e None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:15.629479 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb139e2-bf2f-4266-9a07-6e229542805e None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:15.631132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 579/1147] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:22:15.636907 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45565432-cdeb-4533-baa6-191931ab93f6 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:15.637284 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45565432-cdeb-4533-baa6-191931ab93f6 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:15.637457 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45565432-cdeb-4533-baa6-191931ab93f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:15.653353 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-45565432-cdeb-4533-baa6-191931ab93f6 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:22:15.654529 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-45565432-cdeb-4533-baa6-191931ab93f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:22:15.715607 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 569/1148] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:22:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:22:15.737634 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb139e2-bf2f-4266-9a07-6e229542805e None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:15.832159 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb139e2-bf2f-4266-9a07-6e229542805e None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:15.863434 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46414c6c-e700-4934-b8e4-e747925f47ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:15.864193 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46414c6c-e700-4934-b8e4-e747925f47ac None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:15.864471 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46414c6c-e700-4934-b8e4-e747925f47ac None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:15.864741 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46414c6c-e700-4934-b8e4-e747925f47ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:15.874753 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46414c6c-e700-4934-b8e4-e747925f47ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:22:15.882747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-46414c6c-e700-4934-b8e4-e747925f47ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:22:15.882747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:22:15.882747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:22:15.882747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:22:15.882747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:22:15.882747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:22:15.882747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:22:15.882747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:22:15.882747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:22:15.882747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:22:15.882747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:22:15.882747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:22:15.882747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:22:15.882747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:22:15.882747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:22:15.882747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:22:15.883900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:22:15.883900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:22:15.883900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:22:15.883900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:22:15.883900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:22:15.883900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:22:15.883900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:22:15.883900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:22:15.883900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:22:15.883900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:22:15.883900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:22:15.883900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:22:15.883900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:22:15.883900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:22:15.883900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:22:15.883900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:22:15.884974 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:22:15.884974 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:22:15.884974 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:22:15.884974 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:22:15.884974 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:22:15.884974 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:22:15.884974 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:22:15.884974 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:22:15.884974 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:22:15.884974 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:22:15.884974 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:22:15.884974 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:22:15.884974 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 580/1149] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:22:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:22:15.889661 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45565432-cdeb-4533-baa6-191931ab93f6 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:15.980472 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45565432-cdeb-4533-baa6-191931ab93f6 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:16.013962 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b364f89-0929-48b1-950b-66c068ddad83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:16.015642 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b364f89-0929-48b1-950b-66c068ddad83 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:16.015921 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b364f89-0929-48b1-950b-66c068ddad83 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:16.016194 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b364f89-0929-48b1-950b-66c068ddad83 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:16.016933 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b364f89-0929-48b1-950b-66c068ddad83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:22:16.017437 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b364f89-0929-48b1-950b-66c068ddad83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:16.019976 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b364f89-0929-48b1-950b-66c068ddad83 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:16.032960 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 570/1150] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:22:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:22:16.038814 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46414c6c-e700-4934-b8e4-e747925f47ac None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:16.135294 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46414c6c-e700-4934-b8e4-e747925f47ac None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:16.167325 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de890700-71ae-4e81-82c2-07577748fba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:16.168185 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de890700-71ae-4e81-82c2-07577748fba8 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:16.168467 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de890700-71ae-4e81-82c2-07577748fba8 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:16.168743 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de890700-71ae-4e81-82c2-07577748fba8 None admin] PATH_INFO: `/v3/users/4263f747b52f4c8991c40cd96b6c4104` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:16.169941 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de890700-71ae-4e81-82c2-07577748fba8 None admin] RBAC: Authorizing `identity:get_user(user_id=4263f747b52f4c8991c40cd96b6c4104)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:16.171367 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de890700-71ae-4e81-82c2-07577748fba8 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:16.172955 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 581/1151] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:22:16 2022] GET /identity/v3/users/4263f747b52f4c8991c40cd96b6c4104 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:22:16.178574 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b364f89-0929-48b1-950b-66c068ddad83 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:16.271778 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b364f89-0929-48b1-950b-66c068ddad83 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:16.302897 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a9a02-7606-41d8-829f-86502a736765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:16.303739 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a9a02-7606-41d8-829f-86502a736765 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:16.304021 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a9a02-7606-41d8-829f-86502a736765 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:16.304296 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a9a02-7606-41d8-829f-86502a736765 None admin] PATH_INFO: `/v3/projects/97543c1c0b0245329684b7c94a5661b9` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:16.305525 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a9a02-7606-41d8-829f-86502a736765 None admin] RBAC: Authorizing `identity:get_project(project_id=97543c1c0b0245329684b7c94a5661b9)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:16.306979 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a9a02-7606-41d8-829f-86502a736765 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:16.308643 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 571/1152] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:22:16 2022] GET /identity/v3/projects/97543c1c0b0245329684b7c94a5661b9 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:22:16.314339 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de890700-71ae-4e81-82c2-07577748fba8 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:16.407341 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de890700-71ae-4e81-82c2-07577748fba8 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:16.438954 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33127032-850c-42ae-82c3-0767d0fd824e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:16.439817 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33127032-850c-42ae-82c3-0767d0fd824e None admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:16.440095 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33127032-850c-42ae-82c3-0767d0fd824e None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:16.440368 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33127032-850c-42ae-82c3-0767d0fd824e None admin] PATH_INFO: `/v3/projects/97543c1c0b0245329684b7c94a5661b9/users/4263f747b52f4c8991c40cd96b6c4104/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:16.442346 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33127032-850c-42ae-82c3-0767d0fd824e None admin] RBAC: Authorizing `identity:create_grant(project_id=97543c1c0b0245329684b7c94a5661b9, user_id=4263f747b52f4c8991c40cd96b6c4104, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:16.443764 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33127032-850c-42ae-82c3-0767d0fd824e None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:16.456428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 582/1153] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 12 09:22:16 2022] PUT /identity/v3/projects/97543c1c0b0245329684b7c94a5661b9/users/4263f747b52f4c8991c40cd96b6c4104/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:22:18.652521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c50fe-4496-4a8b-b91b-e990b929e6c0 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:18.653100 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c50fe-4496-4a8b-b91b-e990b929e6c0 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:18.653100 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c50fe-4496-4a8b-b91b-e990b929e6c0 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:18.654475 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 572/1154] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:22:18.659743 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4c997-c4c8-4447-a741-27a390fc673e None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:18.660170 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4c997-c4c8-4447-a741-27a390fc673e None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:18.660302 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4c997-c4c8-4447-a741-27a390fc673e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:18.676943 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-47c4c997-c4c8-4447-a741-27a390fc673e None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:22:18.678132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-47c4c997-c4c8-4447-a741-27a390fc673e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:22:18.742016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 583/1155] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:22:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:22:18.765922 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c50fe-4496-4a8b-b91b-e990b929e6c0 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:18.859830 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c50fe-4496-4a8b-b91b-e990b929e6c0 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:18.892022 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a93849-1082-49bf-93a3-3b4c27ce07d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:18.892794 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a93849-1082-49bf-93a3-3b4c27ce07d9 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:18.893076 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a93849-1082-49bf-93a3-3b4c27ce07d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:18.893345 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a93849-1082-49bf-93a3-3b4c27ce07d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:18.902943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a93849-1082-49bf-93a3-3b4c27ce07d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:22:18.910550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-c9a93849-1082-49bf-93a3-3b4c27ce07d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:22:18.910550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:22:18.910550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:22:18.910550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:22:18.910550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:22:18.910550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:22:18.910550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:22:18.910550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:22:18.910550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:22:18.910550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:22:18.910550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:22:18.910550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:22:18.910550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:22:18.910550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:22:18.910550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:22:18.910550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:22:18.911640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:22:18.911640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:22:18.911640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:22:18.911640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:22:18.911640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:22:18.911640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:22:18.911640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:22:18.911640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:22:18.911640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:22:18.911640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:22:18.911640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:22:18.911640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:22:18.911640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:22:18.911640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:22:18.911640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:22:18.911640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:22:18.912712 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:22:18.912712 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:22:18.912712 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:22:18.912712 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:22:18.912712 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:22:18.912712 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:22:18.912712 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:22:18.912712 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:22:18.912712 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:22:18.912712 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:22:18.912712 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:22:18.912712 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:22:18.912712 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 573/1156] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:22:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:22:18.917722 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4c997-c4c8-4447-a741-27a390fc673e None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:19.010508 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4c997-c4c8-4447-a741-27a390fc673e None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:19.042386 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cb797-8005-4f02-a7f4-67467b170432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:19.043032 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cb797-8005-4f02-a7f4-67467b170432 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:19.043314 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cb797-8005-4f02-a7f4-67467b170432 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:19.043586 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cb797-8005-4f02-a7f4-67467b170432 None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:19.044320 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30cb797-8005-4f02-a7f4-67467b170432 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:22:19.044626 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30cb797-8005-4f02-a7f4-67467b170432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:19.046037 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30cb797-8005-4f02-a7f4-67467b170432 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:19.053539 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 584/1157] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:22:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:22:19.059093 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a93849-1082-49bf-93a3-3b4c27ce07d9 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:19.161028 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a93849-1082-49bf-93a3-3b4c27ce07d9 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:19.191640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192bed5-0f1c-4199-aaba-a41b56531321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:19.192499 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192bed5-0f1c-4199-aaba-a41b56531321 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:19.192778 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192bed5-0f1c-4199-aaba-a41b56531321 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:19.193050 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192bed5-0f1c-4199-aaba-a41b56531321 None admin] PATH_INFO: `/v3/users/4263f747b52f4c8991c40cd96b6c4104` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:19.194237 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192bed5-0f1c-4199-aaba-a41b56531321 None admin] RBAC: Authorizing `identity:get_user(user_id=4263f747b52f4c8991c40cd96b6c4104)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:19.195655 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192bed5-0f1c-4199-aaba-a41b56531321 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:19.197745 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 574/1158] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:22:19 2022] GET /identity/v3/users/4263f747b52f4c8991c40cd96b6c4104 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:22:19.203621 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cb797-8005-4f02-a7f4-67467b170432 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:19.297115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cb797-8005-4f02-a7f4-67467b170432 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:19.330652 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0809a-3faf-4e0a-8b23-2f1dabe648bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:19.331287 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0809a-3faf-4e0a-8b23-2f1dabe648bd None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:19.331567 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0809a-3faf-4e0a-8b23-2f1dabe648bd None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:19.331840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0809a-3faf-4e0a-8b23-2f1dabe648bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:19.393797 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0809a-3faf-4e0a-8b23-2f1dabe648bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:19.395260 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0809a-3faf-4e0a-8b23-2f1dabe648bd None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:19.485178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 585/1159] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:22:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 09:22:19.491025 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192bed5-0f1c-4199-aaba-a41b56531321 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:19.584717 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192bed5-0f1c-4199-aaba-a41b56531321 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:19.616665 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286fdfa-5011-498d-87d3-31535115d399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:19.617500 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286fdfa-5011-498d-87d3-31535115d399 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:19.617813 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286fdfa-5011-498d-87d3-31535115d399 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:19.618115 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286fdfa-5011-498d-87d3-31535115d399 None admin] PATH_INFO: `/v3/projects/97543c1c0b0245329684b7c94a5661b9` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:19.619283 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286fdfa-5011-498d-87d3-31535115d399 None admin] RBAC: Authorizing `identity:get_project(project_id=97543c1c0b0245329684b7c94a5661b9)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:19.620691 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286fdfa-5011-498d-87d3-31535115d399 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:19.622382 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 575/1160] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:22:19 2022] GET /identity/v3/projects/97543c1c0b0245329684b7c94a5661b9 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:22:19.628113 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0809a-3faf-4e0a-8b23-2f1dabe648bd None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:19.719735 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0809a-3faf-4e0a-8b23-2f1dabe648bd None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:19.751047 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f7d00-59e7-46d6-bac6-1fbb5953ca95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:19.751615 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f7d00-59e7-46d6-bac6-1fbb5953ca95 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:19.751893 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f7d00-59e7-46d6-bac6-1fbb5953ca95 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:19.752164 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f7d00-59e7-46d6-bac6-1fbb5953ca95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:19.752966 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f7d00-59e7-46d6-bac6-1fbb5953ca95 None admin] RBAC: Adding query filter params (role.id=8f01c4c38fa44034a54c1f8cd2d2db1a, scope.project.id=97543c1c0b0245329684b7c94a5661b9, user.id=4263f747b52f4c8991c40cd96b6c4104) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:22:19.753269 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f7d00-59e7-46d6-bac6-1fbb5953ca95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:19.754680 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f7d00-59e7-46d6-bac6-1fbb5953ca95 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:19.760370 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 586/1161] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:22:19 2022] GET /identity/v3/role_assignments?user.id=4263f747b52f4c8991c40cd96b6c4104&scope.project.id=97543c1c0b0245329684b7c94a5661b9&role.id=8f01c4c38fa44034a54c1f8cd2d2db1a => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:22:21.967349 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4992bcc-41a7-49c5-bfb6-aaf7991860de None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:21.967919 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4992bcc-41a7-49c5-bfb6-aaf7991860de None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:21.967919 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4992bcc-41a7-49c5-bfb6-aaf7991860de None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:21.969227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 576/1162] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:22:21.974505 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4725d0d-a689-4f95-b567-7910db6383c2 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:21.974927 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4725d0d-a689-4f95-b567-7910db6383c2 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:21.975062 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4725d0d-a689-4f95-b567-7910db6383c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:21.991753 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-f4725d0d-a689-4f95-b567-7910db6383c2 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:22:21.992958 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-f4725d0d-a689-4f95-b567-7910db6383c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:22:22.055679 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 587/1163] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:22:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:22:22.078017 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4992bcc-41a7-49c5-bfb6-aaf7991860de None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:22.173602 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4992bcc-41a7-49c5-bfb6-aaf7991860de None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:22.204724 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ef003-86de-41bf-853c-316517b5a3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:22.205360 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ef003-86de-41bf-853c-316517b5a3b4 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:22.205638 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ef003-86de-41bf-853c-316517b5a3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:22.205930 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ef003-86de-41bf-853c-316517b5a3b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:22.267461 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ef003-86de-41bf-853c-316517b5a3b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:22.268875 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ef003-86de-41bf-853c-316517b5a3b4 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:22.359226 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 577/1164] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:22:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 09:22:22.365102 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4725d0d-a689-4f95-b567-7910db6383c2 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:22.463143 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4725d0d-a689-4f95-b567-7910db6383c2 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:22.496955 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43b9c5-8153-4d11-ac2a-61d0c1b4f3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:22.497749 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43b9c5-8153-4d11-ac2a-61d0c1b4f3ab None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:22.498059 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43b9c5-8153-4d11-ac2a-61d0c1b4f3ab None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:22.498330 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43b9c5-8153-4d11-ac2a-61d0c1b4f3ab None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:22.505030 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43b9c5-8153-4d11-ac2a-61d0c1b4f3ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:22.507740 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43b9c5-8153-4d11-ac2a-61d0c1b4f3ab None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:22.524868 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-6d43b9c5-8153-4d11-ac2a-61d0c1b4f3ab None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 12 09:22:22.524868 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:22:22.524868 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 12 09:22:22.524868 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 12 09:22:22.524868 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:22:22.524868 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:22:22.524868 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:22:22.524868 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:22:22.524868 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 12 09:22:22.524868 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:22:22.524868 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 09:22:22.524868 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:22:22.524868 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:22:22.524868 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:22:22.524868 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:22:22.524868 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:22:22.524868 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:22:22.526141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:22:22.526141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:22:22.526141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:22:22.526141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:22:22.526141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:22:22.526141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:22:22.526141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:22:22.526141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:22:22.526141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:22:22.526141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:22:22.526141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:22:22.526141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:22:22.526141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:22:22.526141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:22:22.526141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:22:22.526141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:22:22.527162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:22:22.527162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:22:22.527162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:22:22.527162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:22:22.527162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:22:22.527162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:22:22.527162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:22:22.527162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:22:22.527162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:22:22.527162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:22:22.527162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 12 09:22:22.527162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:22:22.527162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 12 09:22:22.527162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:22:22.527162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 588/1165] 10.222.0.60 () {56 vars in 1117 bytes} [Thu May 12 09:22:22 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:22:22.531930 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ef003-86de-41bf-853c-316517b5a3b4 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:22.632920 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ef003-86de-41bf-853c-316517b5a3b4 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:22.666869 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ee611-bf02-4edc-bbdb-cb5f38a5fd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:22.667530 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ee611-bf02-4edc-bbdb-cb5f38a5fd77 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:22.667807 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ee611-bf02-4edc-bbdb-cb5f38a5fd77 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:22.668074 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ee611-bf02-4edc-bbdb-cb5f38a5fd77 None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:22.668892 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ee611-bf02-4edc-bbdb-cb5f38a5fd77 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:22:22.669194 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ee611-bf02-4edc-bbdb-cb5f38a5fd77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:22.670642 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ee611-bf02-4edc-bbdb-cb5f38a5fd77 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:22.677431 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 578/1166] 10.222.0.60 () {56 vars in 1115 bytes} [Thu May 12 09:22:22 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:22:24.906703 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006d528-23c4-4556-ab52-c29bb021e630 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:24.907308 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006d528-23c4-4556-ab52-c29bb021e630 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:24.907308 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006d528-23c4-4556-ab52-c29bb021e630 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:24.908585 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 589/1167] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:22:24.914136 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258b6fe-0c04-43d5-a9a2-926c6f5691cf None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:24.914582 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258b6fe-0c04-43d5-a9a2-926c6f5691cf None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:24.914784 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258b6fe-0c04-43d5-a9a2-926c6f5691cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:24.931374 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-6258b6fe-0c04-43d5-a9a2-926c6f5691cf None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:22:24.932515 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-6258b6fe-0c04-43d5-a9a2-926c6f5691cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:22:24.993704 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 579/1168] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:22:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:22:25.015963 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006d528-23c4-4556-ab52-c29bb021e630 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:25.111435 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006d528-23c4-4556-ab52-c29bb021e630 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:25.142842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9346d35-541c-49fc-b891-af7dbe26daaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:25.143484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9346d35-541c-49fc-b891-af7dbe26daaa None admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:25.143764 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9346d35-541c-49fc-b891-af7dbe26daaa None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:25.144036 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9346d35-541c-49fc-b891-af7dbe26daaa None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:25.144764 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9346d35-541c-49fc-b891-af7dbe26daaa None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:25.146640 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9346d35-541c-49fc-b891-af7dbe26daaa None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:25.163667 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 590/1169] 10.222.0.60 () {60 vars in 1138 bytes} [Thu May 12 09:22:25 2022] POST /identity/v3/domains => generated 267 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:22:27.393711 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5708774-34df-46fc-8001-2f55f0abe991 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:27.394269 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5708774-34df-46fc-8001-2f55f0abe991 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:27.394269 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5708774-34df-46fc-8001-2f55f0abe991 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:27.395541 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 580/1170] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:22:27.401296 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9cb57-910a-419b-866f-6cff2b207e3d None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:27.401730 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9cb57-910a-419b-866f-6cff2b207e3d None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:27.401853 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9cb57-910a-419b-866f-6cff2b207e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:27.421756 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-66f9cb57-910a-419b-866f-6cff2b207e3d None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:22:27.422959 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-66f9cb57-910a-419b-866f-6cff2b207e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:22:27.488329 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 591/1171] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:22:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:22:27.512347 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5708774-34df-46fc-8001-2f55f0abe991 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:27.606984 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5708774-34df-46fc-8001-2f55f0abe991 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:27.638751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8fa48-fb87-4258-88e9-f89afdb2a341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:27.639598 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8fa48-fb87-4258-88e9-f89afdb2a341 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:27.639879 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8fa48-fb87-4258-88e9-f89afdb2a341 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:27.640154 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8fa48-fb87-4258-88e9-f89afdb2a341 None admin] PATH_INFO: `/v3/domains/c6c4385e9d9c474c882ed7db370ea516` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:27.650517 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8fa48-fb87-4258-88e9-f89afdb2a341 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c6c4385e9d9c474c882ed7db370ea516)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:27.651903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8fa48-fb87-4258-88e9-f89afdb2a341 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:27.653530 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 581/1172] 10.222.0.60 () {56 vars in 1183 bytes} [Thu May 12 09:22:27 2022] GET /identity/v3/domains/c6c4385e9d9c474c882ed7db370ea516 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:22:27.659100 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9cb57-910a-419b-866f-6cff2b207e3d None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:27.750689 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9cb57-910a-419b-866f-6cff2b207e3d None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:27.782685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc72d2-000e-4003-af09-eef302830522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:27.783326 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc72d2-000e-4003-af09-eef302830522 None admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:27.783614 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc72d2-000e-4003-af09-eef302830522 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:27.783889 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc72d2-000e-4003-af09-eef302830522 None admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:27.784601 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc72d2-000e-4003-af09-eef302830522 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:27.786045 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc72d2-000e-4003-af09-eef302830522 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:27.812049 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 592/1173] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 12 09:22:27 2022] POST /identity/v3/projects => generated 361 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:22:30.041415 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc2d8d-f309-4899-9454-246a7a7a7430 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:30.041986 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc2d8d-f309-4899-9454-246a7a7a7430 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:30.041986 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc2d8d-f309-4899-9454-246a7a7a7430 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:30.043339 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 582/1174] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:22:30.048409 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4c500-53ea-4441-b7f1-679c807ebf16 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:30.048838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4c500-53ea-4441-b7f1-679c807ebf16 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:30.048962 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4c500-53ea-4441-b7f1-679c807ebf16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:30.065497 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-91a4c500-53ea-4441-b7f1-679c807ebf16 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:22:30.066675 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-91a4c500-53ea-4441-b7f1-679c807ebf16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:22:30.127965 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 593/1175] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:22:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:22:30.152534 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc2d8d-f309-4899-9454-246a7a7a7430 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:30.253985 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc2d8d-f309-4899-9454-246a7a7a7430 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:30.285052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c661e7-0584-4139-9c49-d2ad8cfd2e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:30.285891 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c661e7-0584-4139-9c49-d2ad8cfd2e3c None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:30.286191 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c661e7-0584-4139-9c49-d2ad8cfd2e3c None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:30.286453 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c661e7-0584-4139-9c49-d2ad8cfd2e3c None admin] PATH_INFO: `/v3/domains/c6c4385e9d9c474c882ed7db370ea516` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:30.287600 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c661e7-0584-4139-9c49-d2ad8cfd2e3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=c6c4385e9d9c474c882ed7db370ea516)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:30.289019 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c661e7-0584-4139-9c49-d2ad8cfd2e3c None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:30.290656 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 583/1176] 10.222.0.60 () {56 vars in 1183 bytes} [Thu May 12 09:22:30 2022] GET /identity/v3/domains/c6c4385e9d9c474c882ed7db370ea516 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:22:30.296436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4c500-53ea-4441-b7f1-679c807ebf16 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:30.389558 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4c500-53ea-4441-b7f1-679c807ebf16 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:30.421201 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60982d4-d3db-41ff-a5f6-ad2d7950b6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:30.421850 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60982d4-d3db-41ff-a5f6-ad2d7950b6c5 None admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:30.422165 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60982d4-d3db-41ff-a5f6-ad2d7950b6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:30.422438 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60982d4-d3db-41ff-a5f6-ad2d7950b6c5 None admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:30.423134 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60982d4-d3db-41ff-a5f6-ad2d7950b6c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:30.424547 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60982d4-d3db-41ff-a5f6-ad2d7950b6c5 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:30.444387 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 594/1177] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 12 09:22:30 2022] POST /identity/v3/users => generated 311 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:22:32.675349 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1afd40-3eff-4fa5-9afb-4ce72345204c None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:32.675907 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1afd40-3eff-4fa5-9afb-4ce72345204c None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:32.675907 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1afd40-3eff-4fa5-9afb-4ce72345204c None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:32.677223 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 584/1178] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:22:32.683203 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda1bbb-64a7-4699-a179-de71f9b67452 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:32.683647 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda1bbb-64a7-4699-a179-de71f9b67452 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:32.683745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda1bbb-64a7-4699-a179-de71f9b67452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:32.699937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-acda1bbb-64a7-4699-a179-de71f9b67452 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:22:32.701106 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-acda1bbb-64a7-4699-a179-de71f9b67452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:22:32.763921 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 595/1179] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:22:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 09:22:32.786449 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1afd40-3eff-4fa5-9afb-4ce72345204c None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:32.882503 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1afd40-3eff-4fa5-9afb-4ce72345204c None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:32.917651 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcf9a3-a0fe-4b87-a93c-5cd8102cd980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:32.918488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcf9a3-a0fe-4b87-a93c-5cd8102cd980 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:32.918769 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcf9a3-a0fe-4b87-a93c-5cd8102cd980 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:32.919037 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcf9a3-a0fe-4b87-a93c-5cd8102cd980 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:32.928913 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dcf9a3-a0fe-4b87-a93c-5cd8102cd980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:22:32.937197 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-20dcf9a3-a0fe-4b87-a93c-5cd8102cd980 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:22:32.937197 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:22:32.937197 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:22:32.937197 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:22:32.937197 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:22:32.937197 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:22:32.937197 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:22:32.937197 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:22:32.937197 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:22:32.937197 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:22:32.937197 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:22:32.937197 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:22:32.937197 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:22:32.937197 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:22:32.937197 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:22:32.937197 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:22:32.942132 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:22:32.942132 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:22:32.942132 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:22:32.942132 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:22:32.942132 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:22:32.942132 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:22:32.942132 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:22:32.942132 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:22:32.942132 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:22:32.942132 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:22:32.942132 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:22:32.942132 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:22:32.942132 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:22:32.942132 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:22:32.942132 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:22:32.942132 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:22:32.943107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:22:32.943107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:22:32.943107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:22:32.943107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:22:32.943107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:22:32.943107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:22:32.943107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:22:32.943107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:22:32.943107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:22:32.943107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:22:32.943107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:22:32.943107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:22:32.943107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 585/1180] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:22:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:22:32.944425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda1bbb-64a7-4699-a179-de71f9b67452 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:33.040396 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda1bbb-64a7-4699-a179-de71f9b67452 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:33.072656 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a400bb8-5abf-4699-a59d-6f3fb48f8af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:33.073325 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a400bb8-5abf-4699-a59d-6f3fb48f8af0 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:33.073603 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a400bb8-5abf-4699-a59d-6f3fb48f8af0 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:33.073875 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a400bb8-5abf-4699-a59d-6f3fb48f8af0 None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:33.074642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a400bb8-5abf-4699-a59d-6f3fb48f8af0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:22:33.074947 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a400bb8-5abf-4699-a59d-6f3fb48f8af0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:33.076320 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a400bb8-5abf-4699-a59d-6f3fb48f8af0 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:33.084189 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 596/1181] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:22:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:22:33.090371 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcf9a3-a0fe-4b87-a93c-5cd8102cd980 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:33.185314 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcf9a3-a0fe-4b87-a93c-5cd8102cd980 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:33.216262 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1f913-2e00-4ed9-b859-4f3f2f715c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:33.217155 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1f913-2e00-4ed9-b859-4f3f2f715c56 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:33.217440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1f913-2e00-4ed9-b859-4f3f2f715c56 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:33.217717 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1f913-2e00-4ed9-b859-4f3f2f715c56 None admin] PATH_INFO: `/v3/users/c223cffb46e749528530fb7910b87e95` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:33.230535 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde1f913-2e00-4ed9-b859-4f3f2f715c56 None admin] RBAC: Authorizing `identity:get_user(user_id=c223cffb46e749528530fb7910b87e95)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:33.231963 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde1f913-2e00-4ed9-b859-4f3f2f715c56 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:33.233586 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 586/1182] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:22:33 2022] GET /identity/v3/users/c223cffb46e749528530fb7910b87e95 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:22:33.239484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a400bb8-5abf-4699-a59d-6f3fb48f8af0 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:33.330865 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a400bb8-5abf-4699-a59d-6f3fb48f8af0 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:33.362379 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d11b31-e526-4abd-9448-ff444eaf2bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:33.362996 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d11b31-e526-4abd-9448-ff444eaf2bac None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:33.363272 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d11b31-e526-4abd-9448-ff444eaf2bac None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:33.363538 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d11b31-e526-4abd-9448-ff444eaf2bac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:33.424801 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d11b31-e526-4abd-9448-ff444eaf2bac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:33.426229 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d11b31-e526-4abd-9448-ff444eaf2bac None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:33.515515 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 597/1183] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:22:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 09:22:33.521307 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1f913-2e00-4ed9-b859-4f3f2f715c56 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:33.612798 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1f913-2e00-4ed9-b859-4f3f2f715c56 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:33.644632 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d71aa0-d409-4c2c-adba-9b71eac53823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:33.645484 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d71aa0-d409-4c2c-adba-9b71eac53823 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:33.645761 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d71aa0-d409-4c2c-adba-9b71eac53823 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:33.646227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d71aa0-d409-4c2c-adba-9b71eac53823 None admin] PATH_INFO: `/v3/projects/7b2d2be5d3a6456b8aae58805dd89aa2` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:33.647394 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d71aa0-d409-4c2c-adba-9b71eac53823 None admin] RBAC: Authorizing `identity:get_project(project_id=7b2d2be5d3a6456b8aae58805dd89aa2)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:33.649374 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d71aa0-d409-4c2c-adba-9b71eac53823 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:33.651066 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 587/1184] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:22:33 2022] GET /identity/v3/projects/7b2d2be5d3a6456b8aae58805dd89aa2 => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:22:33.657035 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d11b31-e526-4abd-9448-ff444eaf2bac None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:33.747962 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d11b31-e526-4abd-9448-ff444eaf2bac None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:33.779644 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875d2b8-5d21-402f-afc7-268e02825007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:33.780212 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875d2b8-5d21-402f-afc7-268e02825007 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:33.780490 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875d2b8-5d21-402f-afc7-268e02825007 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:33.780762 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875d2b8-5d21-402f-afc7-268e02825007 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:33.781560 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2875d2b8-5d21-402f-afc7-268e02825007 None admin] RBAC: Adding query filter params (role.id=8f01c4c38fa44034a54c1f8cd2d2db1a, scope.project.id=7b2d2be5d3a6456b8aae58805dd89aa2, user.id=c223cffb46e749528530fb7910b87e95) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:22:33.781866 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2875d2b8-5d21-402f-afc7-268e02825007 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:33.783290 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2875d2b8-5d21-402f-afc7-268e02825007 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:33.788341 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 598/1185] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:22:33 2022] GET /identity/v3/role_assignments?user.id=c223cffb46e749528530fb7910b87e95&scope.project.id=7b2d2be5d3a6456b8aae58805dd89aa2&role.id=8f01c4c38fa44034a54c1f8cd2d2db1a => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:22:35.972979 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66020d7-4923-4c2b-ac3a-675be9d99bfb None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:35.973537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66020d7-4923-4c2b-ac3a-675be9d99bfb None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:35.973537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66020d7-4923-4c2b-ac3a-675be9d99bfb None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:35.974917 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 588/1186] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:22:35.980662 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfc9da-9277-4930-abbf-65acad5ca54e None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:35.981064 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfc9da-9277-4930-abbf-65acad5ca54e None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:35.981210 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfc9da-9277-4930-abbf-65acad5ca54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:35.997731 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-50bfc9da-9277-4930-abbf-65acad5ca54e None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:22:35.998907 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-50bfc9da-9277-4930-abbf-65acad5ca54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:22:36.060537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 599/1187] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:22:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:22:36.083195 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66020d7-4923-4c2b-ac3a-675be9d99bfb None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:36.177907 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66020d7-4923-4c2b-ac3a-675be9d99bfb None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:36.209588 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28c9dc-1b2d-48f3-a712-cc610106ee14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:36.210403 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28c9dc-1b2d-48f3-a712-cc610106ee14 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:36.210677 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28c9dc-1b2d-48f3-a712-cc610106ee14 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:36.210972 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28c9dc-1b2d-48f3-a712-cc610106ee14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:36.223135 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28c9dc-1b2d-48f3-a712-cc610106ee14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:22:36.230923 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-ab28c9dc-1b2d-48f3-a712-cc610106ee14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:22:36.230923 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:22:36.230923 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:22:36.230923 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:22:36.230923 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:22:36.230923 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:22:36.230923 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:22:36.230923 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:22:36.230923 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:22:36.230923 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:22:36.230923 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:22:36.230923 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:22:36.230923 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:22:36.230923 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:22:36.230923 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:22:36.230923 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:22:36.232115 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:22:36.232115 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:22:36.232115 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:22:36.232115 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:22:36.232115 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:22:36.232115 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:22:36.232115 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:22:36.232115 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:22:36.232115 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:22:36.232115 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:22:36.232115 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:22:36.232115 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:22:36.232115 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:22:36.232115 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:22:36.232115 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:22:36.232115 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:22:36.233830 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:22:36.233830 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:22:36.233830 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:22:36.233830 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:22:36.233830 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:22:36.233830 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:22:36.233830 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:22:36.233830 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:22:36.233830 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:22:36.233830 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:22:36.233830 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:22:36.233830 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:22:36.233830 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 589/1188] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:22:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:22:36.238402 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfc9da-9277-4930-abbf-65acad5ca54e None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:36.332339 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfc9da-9277-4930-abbf-65acad5ca54e None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:36.363708 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c64c9-d048-4826-bcaa-382b2b01fa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:36.364363 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c64c9-d048-4826-bcaa-382b2b01fa10 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:36.364644 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c64c9-d048-4826-bcaa-382b2b01fa10 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:36.364915 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c64c9-d048-4826-bcaa-382b2b01fa10 None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:36.365652 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c64c9-d048-4826-bcaa-382b2b01fa10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:22:36.365981 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c64c9-d048-4826-bcaa-382b2b01fa10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:36.367887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c64c9-d048-4826-bcaa-382b2b01fa10 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:36.375415 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 600/1189] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:22:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:22:36.381343 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28c9dc-1b2d-48f3-a712-cc610106ee14 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:36.472220 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28c9dc-1b2d-48f3-a712-cc610106ee14 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:36.503762 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a51a6-0791-49cf-89d1-9ab0790a7c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:36.504543 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a51a6-0791-49cf-89d1-9ab0790a7c0a None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:36.504823 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a51a6-0791-49cf-89d1-9ab0790a7c0a None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:36.505352 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a51a6-0791-49cf-89d1-9ab0790a7c0a None admin] PATH_INFO: `/v3/users/c223cffb46e749528530fb7910b87e95` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:36.506533 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a51a6-0791-49cf-89d1-9ab0790a7c0a None admin] RBAC: Authorizing `identity:get_user(user_id=c223cffb46e749528530fb7910b87e95)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:36.507944 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a51a6-0791-49cf-89d1-9ab0790a7c0a None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:36.509527 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 590/1190] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:22:36 2022] GET /identity/v3/users/c223cffb46e749528530fb7910b87e95 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:22:36.514917 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c64c9-d048-4826-bcaa-382b2b01fa10 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:36.612901 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c64c9-d048-4826-bcaa-382b2b01fa10 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:36.644540 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969fcac-1d4d-4320-84c0-6f412ce1c998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:36.645383 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969fcac-1d4d-4320-84c0-6f412ce1c998 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:36.645662 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969fcac-1d4d-4320-84c0-6f412ce1c998 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:36.645987 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969fcac-1d4d-4320-84c0-6f412ce1c998 None admin] PATH_INFO: `/v3/projects/7b2d2be5d3a6456b8aae58805dd89aa2` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:36.647154 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969fcac-1d4d-4320-84c0-6f412ce1c998 None admin] RBAC: Authorizing `identity:get_project(project_id=7b2d2be5d3a6456b8aae58805dd89aa2)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:36.648601 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969fcac-1d4d-4320-84c0-6f412ce1c998 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:36.650293 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 601/1191] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:22:36 2022] GET /identity/v3/projects/7b2d2be5d3a6456b8aae58805dd89aa2 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:22:36.656351 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a51a6-0791-49cf-89d1-9ab0790a7c0a None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:36.748554 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a51a6-0791-49cf-89d1-9ab0790a7c0a None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:36.779762 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35072b34-febf-4351-b2f7-7cbe27df017f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:36.780572 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35072b34-febf-4351-b2f7-7cbe27df017f None admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:36.780850 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35072b34-febf-4351-b2f7-7cbe27df017f None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:36.781122 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35072b34-febf-4351-b2f7-7cbe27df017f None admin] PATH_INFO: `/v3/projects/7b2d2be5d3a6456b8aae58805dd89aa2/users/c223cffb46e749528530fb7910b87e95/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:36.783063 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35072b34-febf-4351-b2f7-7cbe27df017f None admin] RBAC: Authorizing `identity:create_grant(project_id=7b2d2be5d3a6456b8aae58805dd89aa2, user_id=c223cffb46e749528530fb7910b87e95, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:36.784467 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35072b34-febf-4351-b2f7-7cbe27df017f None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:36.796794 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 591/1192] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 12 09:22:36 2022] PUT /identity/v3/projects/7b2d2be5d3a6456b8aae58805dd89aa2/users/c223cffb46e749528530fb7910b87e95/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:22:38.940124 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649805c4-6f2e-4ada-948c-21a5ff408182 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:38.940666 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649805c4-6f2e-4ada-948c-21a5ff408182 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:38.940666 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649805c4-6f2e-4ada-948c-21a5ff408182 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:38.942047 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 602/1193] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:22:38.947259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ee839-502e-4116-838b-1ca478a3476b None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:38.947711 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ee839-502e-4116-838b-1ca478a3476b None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:38.947807 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ee839-502e-4116-838b-1ca478a3476b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:38.963744 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-f73ee839-502e-4116-838b-1ca478a3476b None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:22:38.964888 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-f73ee839-502e-4116-838b-1ca478a3476b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:22:39.026735 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 592/1194] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:22:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:22:39.049810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649805c4-6f2e-4ada-948c-21a5ff408182 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:39.144105 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649805c4-6f2e-4ada-948c-21a5ff408182 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:39.175328 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1044f89-f165-46a2-bab8-1728f23940ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:39.176104 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1044f89-f165-46a2-bab8-1728f23940ef None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:39.176380 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1044f89-f165-46a2-bab8-1728f23940ef None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:39.176649 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1044f89-f165-46a2-bab8-1728f23940ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:39.186479 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1044f89-f165-46a2-bab8-1728f23940ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:22:39.193929 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-c1044f89-f165-46a2-bab8-1728f23940ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:22:39.193929 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:22:39.193929 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:22:39.193929 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:22:39.193929 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:22:39.193929 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:22:39.193929 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:22:39.193929 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:22:39.193929 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:22:39.193929 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:22:39.193929 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:22:39.193929 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:22:39.193929 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:22:39.193929 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:22:39.193929 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:22:39.193929 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:22:39.195041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:22:39.195041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:22:39.195041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:22:39.195041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:22:39.195041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:22:39.195041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:22:39.195041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:22:39.195041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:22:39.195041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:22:39.195041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:22:39.195041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:22:39.195041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:22:39.195041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:22:39.195041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:22:39.195041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:22:39.195041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:22:39.196236 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:22:39.196236 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:22:39.196236 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:22:39.196236 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:22:39.196236 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:22:39.196236 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:22:39.196236 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:22:39.196236 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:22:39.196236 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:22:39.196236 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:22:39.196236 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:22:39.196236 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:22:39.196236 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 603/1195] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:22:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:22:39.200933 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ee839-502e-4116-838b-1ca478a3476b None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:39.292054 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ee839-502e-4116-838b-1ca478a3476b None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:39.322546 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943d842-4c8f-47dd-972e-08c77b0ce620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:39.323186 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943d842-4c8f-47dd-972e-08c77b0ce620 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:39.323464 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943d842-4c8f-47dd-972e-08c77b0ce620 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:39.323732 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943d842-4c8f-47dd-972e-08c77b0ce620 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:39.324456 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b943d842-4c8f-47dd-972e-08c77b0ce620 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:22:39.324752 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b943d842-4c8f-47dd-972e-08c77b0ce620 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:39.326110 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b943d842-4c8f-47dd-972e-08c77b0ce620 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:39.333537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 593/1196] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:22:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:22:39.339454 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1044f89-f165-46a2-bab8-1728f23940ef None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:39.431379 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1044f89-f165-46a2-bab8-1728f23940ef None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:39.463068 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e452208-faf4-4635-8c66-a8711a857b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:39.463841 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e452208-faf4-4635-8c66-a8711a857b77 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:39.464118 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e452208-faf4-4635-8c66-a8711a857b77 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:39.464386 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e452208-faf4-4635-8c66-a8711a857b77 None admin] PATH_INFO: `/v3/users/c223cffb46e749528530fb7910b87e95` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:39.465546 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e452208-faf4-4635-8c66-a8711a857b77 None admin] RBAC: Authorizing `identity:get_user(user_id=c223cffb46e749528530fb7910b87e95)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:39.466977 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e452208-faf4-4635-8c66-a8711a857b77 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:39.468522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 604/1197] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 12 09:22:39 2022] GET /identity/v3/users/c223cffb46e749528530fb7910b87e95 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:22:39.473875 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943d842-4c8f-47dd-972e-08c77b0ce620 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:39.564990 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943d842-4c8f-47dd-972e-08c77b0ce620 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:39.596585 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1abdd-f90e-41aa-85df-2784e516dd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:39.597217 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1abdd-f90e-41aa-85df-2784e516dd13 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:39.597497 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1abdd-f90e-41aa-85df-2784e516dd13 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:39.597766 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1abdd-f90e-41aa-85df-2784e516dd13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:39.660766 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1abdd-f90e-41aa-85df-2784e516dd13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:39.662209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1abdd-f90e-41aa-85df-2784e516dd13 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:39.752348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 594/1198] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:22:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 09:22:39.758989 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e452208-faf4-4635-8c66-a8711a857b77 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:39.850903 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e452208-faf4-4635-8c66-a8711a857b77 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:39.883534 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ebed0-7649-4222-9481-367d6955eef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:39.884361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ebed0-7649-4222-9481-367d6955eef4 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:39.884639 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ebed0-7649-4222-9481-367d6955eef4 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:39.884908 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ebed0-7649-4222-9481-367d6955eef4 None admin] PATH_INFO: `/v3/projects/7b2d2be5d3a6456b8aae58805dd89aa2` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:39.886102 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ebed0-7649-4222-9481-367d6955eef4 None admin] RBAC: Authorizing `identity:get_project(project_id=7b2d2be5d3a6456b8aae58805dd89aa2)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:39.887517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ebed0-7649-4222-9481-367d6955eef4 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:39.889155 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 605/1199] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 12 09:22:39 2022] GET /identity/v3/projects/7b2d2be5d3a6456b8aae58805dd89aa2 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:22:39.894871 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1abdd-f90e-41aa-85df-2784e516dd13 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:22:39.987651 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1abdd-f90e-41aa-85df-2784e516dd13 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:22:40.020053 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752a431-f51d-4d29-9d51-40e7db3d36f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:22:40.020639 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752a431-f51d-4d29-9d51-40e7db3d36f0 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:22:40.020921 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752a431-f51d-4d29-9d51-40e7db3d36f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:22:40.021196 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752a431-f51d-4d29-9d51-40e7db3d36f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:22:40.022034 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752a431-f51d-4d29-9d51-40e7db3d36f0 None admin] RBAC: Adding query filter params (role.id=8f01c4c38fa44034a54c1f8cd2d2db1a, scope.project.id=7b2d2be5d3a6456b8aae58805dd89aa2, user.id=c223cffb46e749528530fb7910b87e95) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:22:40.022344 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752a431-f51d-4d29-9d51-40e7db3d36f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:22:40.023777 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752a431-f51d-4d29-9d51-40e7db3d36f0 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:22:40.029268 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 595/1200] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:22:39 2022] GET /identity/v3/role_assignments?user.id=c223cffb46e749528530fb7910b87e95&scope.project.id=7b2d2be5d3a6456b8aae58805dd89aa2&role.id=8f01c4c38fa44034a54c1f8cd2d2db1a => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:23:40.753821 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45224eed-8046-48db-a46f-f478b62b29d8 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:40.754469 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45224eed-8046-48db-a46f-f478b62b29d8 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:40.754469 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45224eed-8046-48db-a46f-f478b62b29d8 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:40.758310 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 606/1201] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:23:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:23:40.762700 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72329dc8-2a72-4f8c-a58d-eea227886125 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:40.763251 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72329dc8-2a72-4f8c-a58d-eea227886125 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:40.763251 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72329dc8-2a72-4f8c-a58d-eea227886125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:40.784475 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-72329dc8-2a72-4f8c-a58d-eea227886125 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:23:40.785824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-72329dc8-2a72-4f8c-a58d-eea227886125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:23:40.872300 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 596/1202] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:23:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:23:40.906926 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45224eed-8046-48db-a46f-f478b62b29d8 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:41.053270 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45224eed-8046-48db-a46f-f478b62b29d8 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:41.099726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23f478-8b3d-4dc5-b7eb-3dbefbd9246c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:41.100489 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23f478-8b3d-4dc5-b7eb-3dbefbd9246c None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:41.100794 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23f478-8b3d-4dc5-b7eb-3dbefbd9246c None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:41.101093 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23f478-8b3d-4dc5-b7eb-3dbefbd9246c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:41.113576 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23f478-8b3d-4dc5-b7eb-3dbefbd9246c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:41.115985 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23f478-8b3d-4dc5-b7eb-3dbefbd9246c None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:41.139186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-4d23f478-8b3d-4dc5-b7eb-3dbefbd9246c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:23:41.139186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:23:41.139186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:23:41.139186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:23:41.139186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:23:41.139186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:23:41.139186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:23:41.139186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:23:41.139186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:23:41.139186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:23:41.139186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:23:41.139186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:23:41.139186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:23:41.139186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:23:41.139186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:23:41.140284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:23:41.140284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:23:41.140284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:23:41.140284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:23:41.140284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:23:41.140284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:23:41.140284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:23:41.140284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:23:41.140284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:23:41.140284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:23:41.140284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:23:41.140284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:23:41.140284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:23:41.140284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:23:41.140284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:23:41.140284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:23:41.140284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:23:41.141296 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:23:41.141296 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:23:41.141296 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:23:41.141296 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:23:41.141296 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 607/1203] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:23:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:23:41.147875 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72329dc8-2a72-4f8c-a58d-eea227886125 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:41.282058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72329dc8-2a72-4f8c-a58d-eea227886125 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:41.329577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575fbf5-798a-4080-8164-f6ac23b48545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:41.330435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575fbf5-798a-4080-8164-f6ac23b48545 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:41.330776 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575fbf5-798a-4080-8164-f6ac23b48545 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:41.331062 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575fbf5-798a-4080-8164-f6ac23b48545 None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:41.332179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575fbf5-798a-4080-8164-f6ac23b48545 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:23:41.332497 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575fbf5-798a-4080-8164-f6ac23b48545 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:41.334141 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575fbf5-798a-4080-8164-f6ac23b48545 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:41.348785 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 597/1204] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:23:41.355450 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23f478-8b3d-4dc5-b7eb-3dbefbd9246c None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:41.483152 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23f478-8b3d-4dc5-b7eb-3dbefbd9246c None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:41.528337 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75c8a7-15ec-4b48-9558-67cd1b08878f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:41.529417 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75c8a7-15ec-4b48-9558-67cd1b08878f None admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:41.529690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75c8a7-15ec-4b48-9558-67cd1b08878f None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:41.530070 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75c8a7-15ec-4b48-9558-67cd1b08878f None admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:41.530848 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75c8a7-15ec-4b48-9558-67cd1b08878f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:41.532615 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75c8a7-15ec-4b48-9558-67cd1b08878f None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:41.559617 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 608/1205] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 12 09:23:41 2022] POST /identity/v3/users => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:23:44.039970 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df4200-ad9b-4dab-ad81-389f625dbc64 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:44.040655 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df4200-ad9b-4dab-ad81-389f625dbc64 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:44.040655 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df4200-ad9b-4dab-ad81-389f625dbc64 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:44.042139 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 598/1206] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:23:44.047567 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5a481-cc76-4f05-861e-de2c3b5047b7 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:44.048010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5a481-cc76-4f05-861e-de2c3b5047b7 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:44.048116 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5a481-cc76-4f05-861e-de2c3b5047b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:44.065447 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-4ed5a481-cc76-4f05-861e-de2c3b5047b7 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:23:44.066736 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-4ed5a481-cc76-4f05-861e-de2c3b5047b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:23:44.146954 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 609/1207] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:23:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:23:44.174167 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df4200-ad9b-4dab-ad81-389f625dbc64 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:44.284493 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df4200-ad9b-4dab-ad81-389f625dbc64 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:44.326932 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54f365-0e1f-4759-9c27-995fa4edc36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:44.327768 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54f365-0e1f-4759-9c27-995fa4edc36c None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:44.328048 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54f365-0e1f-4759-9c27-995fa4edc36c None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:44.328314 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54f365-0e1f-4759-9c27-995fa4edc36c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:44.339138 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54f365-0e1f-4759-9c27-995fa4edc36c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:23:44.348962 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-3a54f365-0e1f-4759-9c27-995fa4edc36c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 09:23:44.348962 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:23:44.348962 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:23:44.348962 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:23:44.348962 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:23:44.348962 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:23:44.348962 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:23:44.348962 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:23:44.348962 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:23:44.348962 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:23:44.348962 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:23:44.348962 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:23:44.348962 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:23:44.348962 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:23:44.348962 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:23:44.348962 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:23:44.350558 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:23:44.350558 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:23:44.350558 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:23:44.350558 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:23:44.350558 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:23:44.350558 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:23:44.350558 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:23:44.350558 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:23:44.350558 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:23:44.350558 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:23:44.350558 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:23:44.350558 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:23:44.350558 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:23:44.350558 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:23:44.350558 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:23:44.350558 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:23:44.351448 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:23:44.351448 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:23:44.351448 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:23:44.351448 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:23:44.351448 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:23:44.351448 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:23:44.351448 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:23:44.351448 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:23:44.351448 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:23:44.351448 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:23:44.351448 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 09:23:44.351448 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:23:44.351448 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 599/1208] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 12 09:23:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:23:44.358581 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5a481-cc76-4f05-861e-de2c3b5047b7 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:44.469099 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5a481-cc76-4f05-861e-de2c3b5047b7 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:44.506417 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77586ad-e355-450b-a778-24b95f78a891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:44.507086 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77586ad-e355-450b-a778-24b95f78a891 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:44.507367 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77586ad-e355-450b-a778-24b95f78a891 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:44.509524 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77586ad-e355-450b-a778-24b95f78a891 None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:44.509524 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77586ad-e355-450b-a778-24b95f78a891 None admin] RBAC: Adding query filter params (name=service) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:23:44.509524 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77586ad-e355-450b-a778-24b95f78a891 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:44.510054 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77586ad-e355-450b-a778-24b95f78a891 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:44.518533 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 610/1209] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 12 09:23:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:23:44.525025 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54f365-0e1f-4759-9c27-995fa4edc36c None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:44.631531 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54f365-0e1f-4759-9c27-995fa4edc36c None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:44.678679 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a045cd-d843-4b06-bb3f-c2d159262b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:44.679523 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a045cd-d843-4b06-bb3f-c2d159262b26 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:44.679778 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a045cd-d843-4b06-bb3f-c2d159262b26 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:44.680045 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a045cd-d843-4b06-bb3f-c2d159262b26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:44.691990 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a045cd-d843-4b06-bb3f-c2d159262b26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:44.693516 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a045cd-d843-4b06-bb3f-c2d159262b26 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:44.716773 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-a6a045cd-d843-4b06-bb3f-c2d159262b26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:23:44.716773 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:23:44.716773 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:23:44.716773 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:23:44.716773 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:23:44.716773 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:23:44.716773 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:23:44.716773 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:23:44.716773 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:23:44.716773 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:23:44.716773 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:23:44.716773 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:23:44.716773 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:23:44.716773 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:23:44.716773 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:23:44.718209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:23:44.718209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:23:44.718209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:23:44.718209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:23:44.718209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:23:44.718209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:23:44.718209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:23:44.718209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:23:44.718209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:23:44.718209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:23:44.718209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:23:44.718209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:23:44.718209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:23:44.718209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:23:44.718209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:23:44.718209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:23:44.718209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:23:44.719157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:23:44.719157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:23:44.719157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:23:44.719157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:23:44.719157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 600/1210] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:23:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:23:44.727124 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77586ad-e355-450b-a778-24b95f78a891 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:44.840858 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77586ad-e355-450b-a778-24b95f78a891 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:44.876844 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fbc08-5d96-4b6a-8508-63eafb7d9b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:44.877509 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fbc08-5d96-4b6a-8508-63eafb7d9b0a None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:44.877787 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fbc08-5d96-4b6a-8508-63eafb7d9b0a None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:44.878097 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fbc08-5d96-4b6a-8508-63eafb7d9b0a None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:44.878941 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fbc08-5d96-4b6a-8508-63eafb7d9b0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:23:44.879186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fbc08-5d96-4b6a-8508-63eafb7d9b0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:44.881179 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fbc08-5d96-4b6a-8508-63eafb7d9b0a None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:44.893684 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 611/1211] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:23:44.899904 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a045cd-d843-4b06-bb3f-c2d159262b26 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:45.015228 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a045cd-d843-4b06-bb3f-c2d159262b26 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:45.064772 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c3747-bba0-4b7f-b248-433636b46986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:45.066663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c3747-bba0-4b7f-b248-433636b46986 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:45.066663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c3747-bba0-4b7f-b248-433636b46986 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:45.066663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c3747-bba0-4b7f-b248-433636b46986 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:45.076471 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c3747-bba0-4b7f-b248-433636b46986 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:45.077943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c3747-bba0-4b7f-b248-433636b46986 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:45.092904 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-530c3747-bba0-4b7f-b248-433636b46986 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 09:23:45.092904 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:23:45.092904 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:23:45.092904 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:23:45.092904 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:23:45.092904 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:23:45.092904 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:23:45.092904 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:23:45.092904 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:23:45.092904 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:23:45.092904 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:23:45.092904 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:23:45.092904 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:23:45.092904 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:23:45.092904 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:23:45.092904 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:23:45.095754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:23:45.095754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:23:45.095754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:23:45.095754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:23:45.095754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:23:45.095754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:23:45.095754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:23:45.095754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:23:45.095754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:23:45.095754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:23:45.095754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:23:45.095754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:23:45.095754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:23:45.095754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:23:45.095754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:23:45.095754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:23:45.095754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:23:45.095754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:23:45.096757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:23:45.096757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:23:45.096757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:23:45.096757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:23:45.096757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:23:45.096757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:23:45.096757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:23:45.096757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:23:45.096757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 09:23:45.096757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:23:45.096757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 601/1212] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:23:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:23:45.099984 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fbc08-5d96-4b6a-8508-63eafb7d9b0a None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:45.214983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fbc08-5d96-4b6a-8508-63eafb7d9b0a None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:45.253541 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea96f7b-0201-4d32-a0ba-1bfe19e8aef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:45.254896 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea96f7b-0201-4d32-a0ba-1bfe19e8aef5 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:45.255939 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea96f7b-0201-4d32-a0ba-1bfe19e8aef5 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:45.256639 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea96f7b-0201-4d32-a0ba-1bfe19e8aef5 None admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:45.257875 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea96f7b-0201-4d32-a0ba-1bfe19e8aef5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:23:45.258280 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea96f7b-0201-4d32-a0ba-1bfe19e8aef5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:45.259853 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea96f7b-0201-4d32-a0ba-1bfe19e8aef5 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:45.282826 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 612/1213] 10.222.0.60 () {56 vars in 1143 bytes} [Thu May 12 09:23:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:23:45.288557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c3747-bba0-4b7f-b248-433636b46986 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:45.407773 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c3747-bba0-4b7f-b248-433636b46986 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:45.442656 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410522c1-1f6c-418f-9b8b-6c53ac78f03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:45.444113 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410522c1-1f6c-418f-9b8b-6c53ac78f03f None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:45.444398 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410522c1-1f6c-418f-9b8b-6c53ac78f03f None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:45.444673 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410522c1-1f6c-418f-9b8b-6c53ac78f03f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:45.515780 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410522c1-1f6c-418f-9b8b-6c53ac78f03f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:45.517297 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410522c1-1f6c-418f-9b8b-6c53ac78f03f None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:45.623564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 602/1214] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:23:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 09:23:45.630055 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea96f7b-0201-4d32-a0ba-1bfe19e8aef5 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:45.742774 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea96f7b-0201-4d32-a0ba-1bfe19e8aef5 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:45.776618 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc91267-e202-4187-b266-a1ee3ba112bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:45.777326 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc91267-e202-4187-b266-a1ee3ba112bd None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:45.777601 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc91267-e202-4187-b266-a1ee3ba112bd None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:45.777871 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc91267-e202-4187-b266-a1ee3ba112bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:45.789698 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc91267-e202-4187-b266-a1ee3ba112bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:45.791241 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc91267-e202-4187-b266-a1ee3ba112bd None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:45.808753 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-bdc91267-e202-4187-b266-a1ee3ba112bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:23:45.808753 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:23:45.808753 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:23:45.808753 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:23:45.808753 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:23:45.808753 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:23:45.808753 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:23:45.808753 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:23:45.808753 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:23:45.808753 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:23:45.808753 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:23:45.808753 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:23:45.808753 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:23:45.808753 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:23:45.808753 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:23:45.809842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:23:45.809842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:23:45.809842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:23:45.809842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:23:45.809842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:23:45.809842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:23:45.809842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:23:45.809842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:23:45.809842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:23:45.809842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:23:45.809842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:23:45.809842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:23:45.809842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:23:45.809842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:23:45.809842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:23:45.809842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:23:45.809842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:23:45.810943 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:23:45.810943 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:23:45.810943 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:23:45.810943 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:23:45.814841 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 613/1215] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:23:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:23:45.816033 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410522c1-1f6c-418f-9b8b-6c53ac78f03f None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:45.922144 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410522c1-1f6c-418f-9b8b-6c53ac78f03f None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:45.959949 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7ab4d-6ab3-477d-9ba2-9cbd5b5a40fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:45.960641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7ab4d-6ab3-477d-9ba2-9cbd5b5a40fc None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:45.960940 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7ab4d-6ab3-477d-9ba2-9cbd5b5a40fc None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:45.961216 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7ab4d-6ab3-477d-9ba2-9cbd5b5a40fc None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:45.961995 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7ab4d-6ab3-477d-9ba2-9cbd5b5a40fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:23:45.962299 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7ab4d-6ab3-477d-9ba2-9cbd5b5a40fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:45.963770 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7ab4d-6ab3-477d-9ba2-9cbd5b5a40fc None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:45.976498 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 603/1216] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:23:45.982148 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc91267-e202-4187-b266-a1ee3ba112bd None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:46.097275 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc91267-e202-4187-b266-a1ee3ba112bd None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:46.139015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ab62b-ab73-45c3-ae43-5b9bf760803f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:46.139851 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ab62b-ab73-45c3-ae43-5b9bf760803f None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:46.140155 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ab62b-ab73-45c3-ae43-5b9bf760803f None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:46.140420 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ab62b-ab73-45c3-ae43-5b9bf760803f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:46.147804 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ab62b-ab73-45c3-ae43-5b9bf760803f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:46.149258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ab62b-ab73-45c3-ae43-5b9bf760803f None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:46.164224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-cd6ab62b-ab73-45c3-ae43-5b9bf760803f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:23:46.164224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:23:46.164224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:23:46.164224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:23:46.164224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:23:46.164224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:23:46.164224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:23:46.164224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:23:46.164224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:23:46.164224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:23:46.164224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:23:46.164224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:23:46.164224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:23:46.164224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:23:46.164224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:23:46.165227 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:23:46.165227 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:23:46.165227 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:23:46.165227 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:23:46.165227 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:23:46.165227 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:23:46.165227 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:23:46.165227 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:23:46.165227 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:23:46.165227 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:23:46.165227 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:23:46.165227 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:23:46.165227 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:23:46.165227 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:23:46.165227 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:23:46.165227 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:23:46.165227 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:23:46.166221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:23:46.166221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:23:46.166221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:23:46.166221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:23:46.166221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:23:46.166221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:23:46.166221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:23:46.166221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:23:46.170246 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 614/1217] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:23:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:23:46.171475 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7ab4d-6ab3-477d-9ba2-9cbd5b5a40fc None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:46.273704 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7ab4d-6ab3-477d-9ba2-9cbd5b5a40fc None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:46.312554 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a009a-a1a1-4d50-84ff-6c65a13a9764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:46.313332 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a009a-a1a1-4d50-84ff-6c65a13a9764 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:46.313627 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a009a-a1a1-4d50-84ff-6c65a13a9764 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:46.313948 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a009a-a1a1-4d50-84ff-6c65a13a9764 None admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:46.314950 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a009a-a1a1-4d50-84ff-6c65a13a9764 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:23:46.315251 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a009a-a1a1-4d50-84ff-6c65a13a9764 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:46.316808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a009a-a1a1-4d50-84ff-6c65a13a9764 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:46.330943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 604/1218] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:23:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:23:46.337419 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ab62b-ab73-45c3-ae43-5b9bf760803f None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:46.450637 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ab62b-ab73-45c3-ae43-5b9bf760803f None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:46.487537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cb7a1-1130-4675-80f5-9f69de1cf17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:46.488200 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cb7a1-1130-4675-80f5-9f69de1cf17c None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:46.488466 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cb7a1-1130-4675-80f5-9f69de1cf17c None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:46.488740 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cb7a1-1130-4675-80f5-9f69de1cf17c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:46.489595 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3cb7a1-1130-4675-80f5-9f69de1cf17c None admin] RBAC: Adding query filter params (role.id=4798f242077c416e9292660af5469faf, scope.project.id=9cf4f2954dd44516b3e594ed440781cc, user.id=525f4699878f461e82f7f06ef60c176a) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:23:46.489928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3cb7a1-1130-4675-80f5-9f69de1cf17c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:46.491485 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3cb7a1-1130-4675-80f5-9f69de1cf17c None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:46.497523 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 615/1219] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:23:46 2022] GET /identity/v3/role_assignments?user.id=525f4699878f461e82f7f06ef60c176a&scope.project.id=9cf4f2954dd44516b3e594ed440781cc&role.id=4798f242077c416e9292660af5469faf => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:23:48.985203 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae811bd-4938-49f0-b0b7-be4134ef6577 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:48.986198 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae811bd-4938-49f0-b0b7-be4134ef6577 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:48.986198 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae811bd-4938-49f0-b0b7-be4134ef6577 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:48.987173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 605/1220] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:23:48.993522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6948de-08f0-46b1-9624-a759dec3966c None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:48.994011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6948de-08f0-46b1-9624-a759dec3966c None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:48.994126 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6948de-08f0-46b1-9624-a759dec3966c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:49.012197 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-bc6948de-08f0-46b1-9624-a759dec3966c None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:23:49.013741 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-bc6948de-08f0-46b1-9624-a759dec3966c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:23:49.084864 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 616/1221] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:23:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:23:49.109425 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae811bd-4938-49f0-b0b7-be4134ef6577 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:49.208236 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae811bd-4938-49f0-b0b7-be4134ef6577 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:49.242663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1465f94-6eb7-4e87-bbe8-0e9fd68884d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:49.243383 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1465f94-6eb7-4e87-bbe8-0e9fd68884d4 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:49.243658 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1465f94-6eb7-4e87-bbe8-0e9fd68884d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:49.243925 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1465f94-6eb7-4e87-bbe8-0e9fd68884d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:49.254563 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1465f94-6eb7-4e87-bbe8-0e9fd68884d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:23:49.262599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-c1465f94-6eb7-4e87-bbe8-0e9fd68884d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 09:23:49.262599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:23:49.262599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:23:49.262599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:23:49.262599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:23:49.262599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:23:49.262599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:23:49.262599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:23:49.262599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:23:49.262599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:23:49.262599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:23:49.262599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:23:49.262599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:23:49.262599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:23:49.262599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:23:49.262599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:23:49.263718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:23:49.263718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:23:49.263718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:23:49.263718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:23:49.263718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:23:49.263718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:23:49.263718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:23:49.263718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:23:49.263718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:23:49.263718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:23:49.263718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:23:49.263718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:23:49.263718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:23:49.263718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:23:49.263718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:23:49.263718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:23:49.264595 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:23:49.264595 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:23:49.264595 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:23:49.264595 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:23:49.264595 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:23:49.264595 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:23:49.264595 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:23:49.264595 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:23:49.264595 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:23:49.264595 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:23:49.264595 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 09:23:49.264595 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:23:49.264595 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 606/1222] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 12 09:23:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:23:49.272033 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6948de-08f0-46b1-9624-a759dec3966c None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:49.374887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6948de-08f0-46b1-9624-a759dec3966c None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:49.411151 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa82b6-2e3a-44af-85b2-ad779e7f1dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:49.412468 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa82b6-2e3a-44af-85b2-ad779e7f1dee None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:49.412748 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa82b6-2e3a-44af-85b2-ad779e7f1dee None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:49.413017 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa82b6-2e3a-44af-85b2-ad779e7f1dee None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:49.413759 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa82b6-2e3a-44af-85b2-ad779e7f1dee None admin] RBAC: Adding query filter params (name=service) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:23:49.414101 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa82b6-2e3a-44af-85b2-ad779e7f1dee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:49.415492 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa82b6-2e3a-44af-85b2-ad779e7f1dee None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:49.425065 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 617/1223] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 12 09:23:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:23:49.430726 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1465f94-6eb7-4e87-bbe8-0e9fd68884d4 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:49.536168 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1465f94-6eb7-4e87-bbe8-0e9fd68884d4 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:49.574226 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6839408-027e-45af-b6ac-e7db97f7a922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:49.575100 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6839408-027e-45af-b6ac-e7db97f7a922 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:49.575390 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6839408-027e-45af-b6ac-e7db97f7a922 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:49.575655 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6839408-027e-45af-b6ac-e7db97f7a922 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:49.586647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6839408-027e-45af-b6ac-e7db97f7a922 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:49.588128 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6839408-027e-45af-b6ac-e7db97f7a922 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:49.605620 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-c6839408-027e-45af-b6ac-e7db97f7a922 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:23:49.605620 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:23:49.605620 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:23:49.605620 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:23:49.605620 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:23:49.605620 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:23:49.605620 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:23:49.605620 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:23:49.605620 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:23:49.605620 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:23:49.605620 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:23:49.605620 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:23:49.605620 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:23:49.605620 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:23:49.605620 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:23:49.606828 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:23:49.606828 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:23:49.606828 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:23:49.606828 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:23:49.606828 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:23:49.606828 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:23:49.606828 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:23:49.606828 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:23:49.606828 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:23:49.606828 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:23:49.606828 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:23:49.606828 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:23:49.606828 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:23:49.606828 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:23:49.606828 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:23:49.606828 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:23:49.606828 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:23:49.608172 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:23:49.608172 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:23:49.608172 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:23:49.608172 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:23:49.608172 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 607/1224] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:23:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:23:49.612752 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa82b6-2e3a-44af-85b2-ad779e7f1dee None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:49.720606 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa82b6-2e3a-44af-85b2-ad779e7f1dee None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:49.755401 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c34c8-f0f2-46e4-b5e5-50bc79aaf1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:49.756110 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c34c8-f0f2-46e4-b5e5-50bc79aaf1d9 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:49.756393 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c34c8-f0f2-46e4-b5e5-50bc79aaf1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:49.756694 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c34c8-f0f2-46e4-b5e5-50bc79aaf1d9 None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:49.757433 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c34c8-f0f2-46e4-b5e5-50bc79aaf1d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:23:49.757741 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c34c8-f0f2-46e4-b5e5-50bc79aaf1d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:49.759188 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c34c8-f0f2-46e4-b5e5-50bc79aaf1d9 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:49.770901 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 618/1225] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:23:49.776541 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6839408-027e-45af-b6ac-e7db97f7a922 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:49.879342 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6839408-027e-45af-b6ac-e7db97f7a922 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:49.914655 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e60dc4-652f-486f-83b2-e46002432fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:49.915469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e60dc4-652f-486f-83b2-e46002432fe8 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:49.915777 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e60dc4-652f-486f-83b2-e46002432fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:49.916022 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e60dc4-652f-486f-83b2-e46002432fe8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:49.923314 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e60dc4-652f-486f-83b2-e46002432fe8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:49.924757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e60dc4-652f-486f-83b2-e46002432fe8 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:49.940909 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-82e60dc4-652f-486f-83b2-e46002432fe8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 09:23:49.940909 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:23:49.940909 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:23:49.940909 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:23:49.940909 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:23:49.940909 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:23:49.940909 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:23:49.940909 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:23:49.940909 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:23:49.940909 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:23:49.940909 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:23:49.940909 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:23:49.940909 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:23:49.940909 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:23:49.940909 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:23:49.940909 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:23:49.942107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:23:49.942107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:23:49.942107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:23:49.942107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:23:49.942107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:23:49.942107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:23:49.942107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:23:49.942107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:23:49.942107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:23:49.942107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:23:49.942107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:23:49.942107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:23:49.942107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:23:49.942107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:23:49.942107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:23:49.942107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:23:49.942107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:23:49.942107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:23:49.943265 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:23:49.943265 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:23:49.943265 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:23:49.943265 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:23:49.943265 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:23:49.943265 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:23:49.943265 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:23:49.943265 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:23:49.943265 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 09:23:49.943265 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:23:49.943265 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 608/1226] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:23:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:23:49.948180 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c34c8-f0f2-46e4-b5e5-50bc79aaf1d9 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:50.047898 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c34c8-f0f2-46e4-b5e5-50bc79aaf1d9 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:50.083173 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e054e-260b-4427-b364-8ef0b6dbb134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:50.084377 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e054e-260b-4427-b364-8ef0b6dbb134 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:50.084674 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e054e-260b-4427-b364-8ef0b6dbb134 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:50.084933 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e054e-260b-4427-b364-8ef0b6dbb134 None admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:50.085757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e054e-260b-4427-b364-8ef0b6dbb134 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:23:50.086093 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e054e-260b-4427-b364-8ef0b6dbb134 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:50.087512 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e054e-260b-4427-b364-8ef0b6dbb134 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:50.110423 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 619/1227] 10.222.0.60 () {56 vars in 1143 bytes} [Thu May 12 09:23:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:23:50.111623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e60dc4-652f-486f-83b2-e46002432fe8 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:50.215709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e60dc4-652f-486f-83b2-e46002432fe8 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:50.253383 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6eeb4-2e7e-4c72-ba1e-3175ef0450ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:50.254224 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6eeb4-2e7e-4c72-ba1e-3175ef0450ab None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:50.254501 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6eeb4-2e7e-4c72-ba1e-3175ef0450ab None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:50.255026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6eeb4-2e7e-4c72-ba1e-3175ef0450ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:50.266778 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6eeb4-2e7e-4c72-ba1e-3175ef0450ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:50.268234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6eeb4-2e7e-4c72-ba1e-3175ef0450ab None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:50.285989 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-e9d6eeb4-2e7e-4c72-ba1e-3175ef0450ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:23:50.285989 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:23:50.285989 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:23:50.285989 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:23:50.285989 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:23:50.285989 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:23:50.285989 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:23:50.285989 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:23:50.285989 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:23:50.285989 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:23:50.285989 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:23:50.285989 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:23:50.285989 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:23:50.285989 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:23:50.285989 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:23:50.287841 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:23:50.287841 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:23:50.287841 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:23:50.287841 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:23:50.287841 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:23:50.287841 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:23:50.287841 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:23:50.287841 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:23:50.287841 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:23:50.287841 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:23:50.287841 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:23:50.287841 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:23:50.287841 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:23:50.287841 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:23:50.287841 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:23:50.287841 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:23:50.287841 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:23:50.289082 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:23:50.289082 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:23:50.289082 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:23:50.289082 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:23:50.289082 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 609/1228] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:23:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:23:50.293669 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e054e-260b-4427-b364-8ef0b6dbb134 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:50.394441 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e054e-260b-4427-b364-8ef0b6dbb134 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:50.430258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62490260-0231-4328-89a4-ab7b8141f352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:50.430919 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62490260-0231-4328-89a4-ab7b8141f352 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:50.431198 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62490260-0231-4328-89a4-ab7b8141f352 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:50.431465 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62490260-0231-4328-89a4-ab7b8141f352 None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:50.432213 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62490260-0231-4328-89a4-ab7b8141f352 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:23:50.432549 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62490260-0231-4328-89a4-ab7b8141f352 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:50.433903 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62490260-0231-4328-89a4-ab7b8141f352 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:50.445914 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 620/1229] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:23:50.452368 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6eeb4-2e7e-4c72-ba1e-3175ef0450ab None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:50.560527 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6eeb4-2e7e-4c72-ba1e-3175ef0450ab None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:50.596275 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0301057-af31-4c6c-895d-5a3126dc5238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:50.597082 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0301057-af31-4c6c-895d-5a3126dc5238 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:50.597364 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0301057-af31-4c6c-895d-5a3126dc5238 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:50.597793 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0301057-af31-4c6c-895d-5a3126dc5238 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:50.605156 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0301057-af31-4c6c-895d-5a3126dc5238 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:50.606780 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0301057-af31-4c6c-895d-5a3126dc5238 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:50.620856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-a0301057-af31-4c6c-895d-5a3126dc5238 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:23:50.620856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:23:50.620856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:23:50.620856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:23:50.620856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:23:50.620856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:23:50.620856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:23:50.620856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:23:50.620856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:23:50.620856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:23:50.620856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:23:50.620856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:23:50.620856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:23:50.620856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:23:50.620856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:23:50.622044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:23:50.622044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:23:50.622044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:23:50.622044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:23:50.622044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:23:50.622044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:23:50.622044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:23:50.622044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:23:50.622044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:23:50.622044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:23:50.622044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:23:50.622044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:23:50.622044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:23:50.622044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:23:50.622044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:23:50.622044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:23:50.622044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:23:50.623444 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:23:50.623444 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:23:50.623444 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:23:50.623444 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:23:50.623444 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:23:50.623444 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:23:50.623444 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:23:50.623444 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:23:50.623444 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 610/1230] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:23:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:23:50.629186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62490260-0231-4328-89a4-ab7b8141f352 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:50.735207 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62490260-0231-4328-89a4-ab7b8141f352 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:50.772785 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9ef45-46ec-46df-b9ea-9e6ee4d5a1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:50.773524 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9ef45-46ec-46df-b9ea-9e6ee4d5a1da None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:50.773863 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9ef45-46ec-46df-b9ea-9e6ee4d5a1da None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:50.774176 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9ef45-46ec-46df-b9ea-9e6ee4d5a1da None admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:50.774968 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9ef45-46ec-46df-b9ea-9e6ee4d5a1da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:23:50.775294 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9ef45-46ec-46df-b9ea-9e6ee4d5a1da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:50.777013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9ef45-46ec-46df-b9ea-9e6ee4d5a1da None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:50.791153 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 621/1231] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:23:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:23:50.797124 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0301057-af31-4c6c-895d-5a3126dc5238 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:50.909872 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0301057-af31-4c6c-895d-5a3126dc5238 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:50.949705 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f181173-97f5-4a36-aee3-7e62c0ebbc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:50.950639 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f181173-97f5-4a36-aee3-7e62c0ebbc8f None admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:50.950919 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f181173-97f5-4a36-aee3-7e62c0ebbc8f None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:50.951258 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f181173-97f5-4a36-aee3-7e62c0ebbc8f None admin] PATH_INFO: `/v3/projects/9cf4f2954dd44516b3e594ed440781cc/users/525f4699878f461e82f7f06ef60c176a/roles/4798f242077c416e9292660af5469faf` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:50.966277 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f181173-97f5-4a36-aee3-7e62c0ebbc8f None admin] RBAC: Authorizing `identity:create_grant(project_id=9cf4f2954dd44516b3e594ed440781cc, user_id=525f4699878f461e82f7f06ef60c176a, role_id=4798f242077c416e9292660af5469faf)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:50.967702 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f181173-97f5-4a36-aee3-7e62c0ebbc8f None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:50.980777 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 611/1232] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 12 09:23:50 2022] PUT /identity/v3/projects/9cf4f2954dd44516b3e594ed440781cc/users/525f4699878f461e82f7f06ef60c176a/roles/4798f242077c416e9292660af5469faf => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:23:53.497147 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f00814-d119-485b-92b8-85f73e4453e9 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:53.498920 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f00814-d119-485b-92b8-85f73e4453e9 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:53.498920 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f00814-d119-485b-92b8-85f73e4453e9 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:53.500121 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 622/1233] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:23:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:23:53.507342 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c6ad2-2bca-45bd-aa88-23994fd2c7cc None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:53.507948 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c6ad2-2bca-45bd-aa88-23994fd2c7cc None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:53.507948 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c6ad2-2bca-45bd-aa88-23994fd2c7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:53.525938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-709c6ad2-2bca-45bd-aa88-23994fd2c7cc None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:23:53.527361 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-709c6ad2-2bca-45bd-aa88-23994fd2c7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:23:53.600277 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 612/1234] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:23:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:23:53.623966 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f00814-d119-485b-92b8-85f73e4453e9 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:53.736064 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f00814-d119-485b-92b8-85f73e4453e9 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:53.771002 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aca722-53a1-48e1-8a9d-1e5dadfbd086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:53.771713 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aca722-53a1-48e1-8a9d-1e5dadfbd086 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:53.771992 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aca722-53a1-48e1-8a9d-1e5dadfbd086 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:53.772261 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aca722-53a1-48e1-8a9d-1e5dadfbd086 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:53.783547 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aca722-53a1-48e1-8a9d-1e5dadfbd086 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:23:53.792206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-13aca722-53a1-48e1-8a9d-1e5dadfbd086 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 09:23:53.792206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:23:53.792206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:23:53.792206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:23:53.792206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:23:53.792206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:23:53.792206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:23:53.792206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:23:53.792206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:23:53.792206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:23:53.792206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:23:53.792206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:23:53.792206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:23:53.792206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:23:53.792206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:23:53.792206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:23:53.793206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:23:53.793206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:23:53.793206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:23:53.793206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:23:53.793206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:23:53.793206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:23:53.793206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:23:53.793206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:23:53.793206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:23:53.793206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:23:53.793206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:23:53.793206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:23:53.793206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:23:53.793206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:23:53.793206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:23:53.793206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:23:53.794107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:23:53.794107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:23:53.794107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:23:53.794107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:23:53.794107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:23:53.794107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:23:53.794107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:23:53.794107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:23:53.794107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:23:53.794107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:23:53.794107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 09:23:53.794107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:23:53.794107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 623/1235] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 12 09:23:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:23:53.800987 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c6ad2-2bca-45bd-aa88-23994fd2c7cc None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:53.904355 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c6ad2-2bca-45bd-aa88-23994fd2c7cc None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:53.941033 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4f7fc-80b9-44c7-9441-c7021c56a52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:53.941717 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4f7fc-80b9-44c7-9441-c7021c56a52c None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:53.942028 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4f7fc-80b9-44c7-9441-c7021c56a52c None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:53.942303 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4f7fc-80b9-44c7-9441-c7021c56a52c None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:53.943620 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4f7fc-80b9-44c7-9441-c7021c56a52c None admin] RBAC: Adding query filter params (name=service) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:23:53.943922 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4f7fc-80b9-44c7-9441-c7021c56a52c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:53.945309 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4f7fc-80b9-44c7-9441-c7021c56a52c None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:53.955419 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 613/1236] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 12 09:23:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:23:53.963746 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aca722-53a1-48e1-8a9d-1e5dadfbd086 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:54.080392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aca722-53a1-48e1-8a9d-1e5dadfbd086 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:54.116064 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80c41e-12b7-4677-b113-29c42d11989e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:54.116856 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80c41e-12b7-4677-b113-29c42d11989e None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:54.117184 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80c41e-12b7-4677-b113-29c42d11989e None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:54.117548 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80c41e-12b7-4677-b113-29c42d11989e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:54.128665 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80c41e-12b7-4677-b113-29c42d11989e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:54.130756 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80c41e-12b7-4677-b113-29c42d11989e None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:54.150491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-4b80c41e-12b7-4677-b113-29c42d11989e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:23:54.150491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:23:54.150491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:23:54.150491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:23:54.150491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:23:54.150491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:23:54.150491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:23:54.150491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:23:54.150491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:23:54.150491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:23:54.150491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:23:54.150491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:23:54.150491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:23:54.150491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:23:54.150491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:23:54.151574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:23:54.151574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:23:54.151574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:23:54.151574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:23:54.151574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:23:54.151574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:23:54.151574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:23:54.151574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:23:54.151574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:23:54.151574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:23:54.151574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:23:54.151574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:23:54.151574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:23:54.151574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:23:54.151574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:23:54.151574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:23:54.151574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:23:54.152856 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:23:54.152856 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:23:54.152856 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:23:54.152856 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:23:54.152856 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 624/1237] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:23:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:23:54.157399 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4f7fc-80b9-44c7-9441-c7021c56a52c None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:54.265707 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4f7fc-80b9-44c7-9441-c7021c56a52c None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:54.299731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf491ed-d525-4462-9a37-510c0f41221b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:54.300419 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf491ed-d525-4462-9a37-510c0f41221b None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:54.300695 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf491ed-d525-4462-9a37-510c0f41221b None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:54.301000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf491ed-d525-4462-9a37-510c0f41221b None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:54.301748 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf491ed-d525-4462-9a37-510c0f41221b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:23:54.302663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf491ed-d525-4462-9a37-510c0f41221b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:54.304180 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf491ed-d525-4462-9a37-510c0f41221b None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:54.316910 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 614/1238] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:23:54.323540 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80c41e-12b7-4677-b113-29c42d11989e None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:54.427688 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80c41e-12b7-4677-b113-29c42d11989e None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:54.462792 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a493bcb-547b-4176-81c7-9b627d8b75f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:54.463587 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a493bcb-547b-4176-81c7-9b627d8b75f0 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:54.463863 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a493bcb-547b-4176-81c7-9b627d8b75f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:54.464130 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a493bcb-547b-4176-81c7-9b627d8b75f0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:54.471473 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a493bcb-547b-4176-81c7-9b627d8b75f0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:54.472897 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a493bcb-547b-4176-81c7-9b627d8b75f0 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:54.486671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-0a493bcb-547b-4176-81c7-9b627d8b75f0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 09:23:54.486671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:23:54.486671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:23:54.486671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:23:54.486671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:23:54.486671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:23:54.486671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:23:54.486671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:23:54.486671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:23:54.486671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:23:54.486671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:23:54.486671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:23:54.486671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:23:54.486671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:23:54.486671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:23:54.486671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:23:54.487835 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:23:54.487835 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:23:54.487835 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:23:54.487835 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:23:54.487835 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:23:54.487835 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:23:54.487835 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:23:54.487835 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:23:54.487835 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:23:54.487835 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:23:54.487835 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:23:54.487835 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:23:54.487835 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:23:54.487835 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:23:54.487835 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:23:54.487835 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:23:54.487835 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:23:54.487835 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:23:54.488834 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:23:54.488834 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:23:54.488834 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:23:54.488834 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:23:54.488834 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:23:54.488834 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:23:54.488834 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:23:54.488834 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:23:54.488834 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 09:23:54.488834 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:23:54.488834 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 625/1239] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:23:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:23:54.494061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf491ed-d525-4462-9a37-510c0f41221b None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:54.600786 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf491ed-d525-4462-9a37-510c0f41221b None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:54.636017 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bdb89-ef5c-4370-81b7-a24c3020d840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:54.636674 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bdb89-ef5c-4370-81b7-a24c3020d840 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:54.637997 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bdb89-ef5c-4370-81b7-a24c3020d840 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:54.638406 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bdb89-ef5c-4370-81b7-a24c3020d840 None admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:54.639257 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5bdb89-ef5c-4370-81b7-a24c3020d840 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:23:54.639743 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5bdb89-ef5c-4370-81b7-a24c3020d840 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:54.641036 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5bdb89-ef5c-4370-81b7-a24c3020d840 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:54.660572 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 615/1240] 10.222.0.60 () {56 vars in 1143 bytes} [Thu May 12 09:23:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:23:54.666983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a493bcb-547b-4176-81c7-9b627d8b75f0 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:54.772109 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a493bcb-547b-4176-81c7-9b627d8b75f0 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:54.805590 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eac8ec-44bb-413f-b61c-b8efe0731ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:54.806286 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eac8ec-44bb-413f-b61c-b8efe0731ecc None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:54.806564 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eac8ec-44bb-413f-b61c-b8efe0731ecc None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:54.806841 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eac8ec-44bb-413f-b61c-b8efe0731ecc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:54.878749 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eac8ec-44bb-413f-b61c-b8efe0731ecc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:54.881218 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eac8ec-44bb-413f-b61c-b8efe0731ecc None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:54.981649 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 626/1241] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:23:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 09:23:54.987359 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bdb89-ef5c-4370-81b7-a24c3020d840 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:55.096694 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bdb89-ef5c-4370-81b7-a24c3020d840 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:55.131081 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c73bf-b851-4c82-8e97-7401f12ff8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:55.131904 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c73bf-b851-4c82-8e97-7401f12ff8b6 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:55.132235 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c73bf-b851-4c82-8e97-7401f12ff8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:55.132493 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c73bf-b851-4c82-8e97-7401f12ff8b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:55.143132 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c73bf-b851-4c82-8e97-7401f12ff8b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:55.144598 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c73bf-b851-4c82-8e97-7401f12ff8b6 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:55.165990 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-bb3c73bf-b851-4c82-8e97-7401f12ff8b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:23:55.165990 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:23:55.165990 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:23:55.165990 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:23:55.165990 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:23:55.165990 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:23:55.165990 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:23:55.165990 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:23:55.165990 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:23:55.165990 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:23:55.165990 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:23:55.165990 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:23:55.165990 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:23:55.165990 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:23:55.165990 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:23:55.167122 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:23:55.167122 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:23:55.167122 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:23:55.167122 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:23:55.167122 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:23:55.167122 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:23:55.167122 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:23:55.167122 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:23:55.167122 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:23:55.167122 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:23:55.167122 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:23:55.167122 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:23:55.167122 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:23:55.167122 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:23:55.167122 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:23:55.167122 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:23:55.167122 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:23:55.168240 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:23:55.168240 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:23:55.168240 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:23:55.168240 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:23:55.171880 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 616/1242] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:23:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:23:55.172857 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eac8ec-44bb-413f-b61c-b8efe0731ecc None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:55.275212 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eac8ec-44bb-413f-b61c-b8efe0731ecc None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:55.314424 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d04a18-5442-4b47-88c7-54fa2659a36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:55.315082 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d04a18-5442-4b47-88c7-54fa2659a36f None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:55.315358 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d04a18-5442-4b47-88c7-54fa2659a36f None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:55.315628 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d04a18-5442-4b47-88c7-54fa2659a36f None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:55.316334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d04a18-5442-4b47-88c7-54fa2659a36f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:23:55.316635 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d04a18-5442-4b47-88c7-54fa2659a36f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:55.318244 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d04a18-5442-4b47-88c7-54fa2659a36f None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:55.338455 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 627/1243] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:23:55.338671 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c73bf-b851-4c82-8e97-7401f12ff8b6 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:55.444090 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c73bf-b851-4c82-8e97-7401f12ff8b6 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:55.478282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c424af5-f002-43dc-adf6-528176180dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:55.479085 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c424af5-f002-43dc-adf6-528176180dd7 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:55.479363 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c424af5-f002-43dc-adf6-528176180dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:55.479632 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c424af5-f002-43dc-adf6-528176180dd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:55.486331 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c424af5-f002-43dc-adf6-528176180dd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:55.487771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c424af5-f002-43dc-adf6-528176180dd7 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:55.501599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-5c424af5-f002-43dc-adf6-528176180dd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:23:55.501599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:23:55.501599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:23:55.501599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:23:55.501599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:23:55.501599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:23:55.501599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:23:55.501599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:23:55.501599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:23:55.501599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:23:55.501599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:23:55.501599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:23:55.501599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:23:55.501599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:23:55.501599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:23:55.502611 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:23:55.502611 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:23:55.502611 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:23:55.502611 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:23:55.502611 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:23:55.502611 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:23:55.502611 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:23:55.502611 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:23:55.502611 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:23:55.502611 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:23:55.502611 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:23:55.502611 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:23:55.502611 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:23:55.502611 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:23:55.502611 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:23:55.502611 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:23:55.502611 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:23:55.503550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:23:55.503550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:23:55.503550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:23:55.503550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:23:55.503550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:23:55.503550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:23:55.503550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:23:55.503550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:23:55.508394 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 617/1244] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:23:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:23:55.510029 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d04a18-5442-4b47-88c7-54fa2659a36f None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:55.614480 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d04a18-5442-4b47-88c7-54fa2659a36f None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:55.649885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc594e1a-3a05-4269-950f-50b5b0686bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:55.650573 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc594e1a-3a05-4269-950f-50b5b0686bc0 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:55.650868 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc594e1a-3a05-4269-950f-50b5b0686bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:55.651125 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc594e1a-3a05-4269-950f-50b5b0686bc0 None admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:55.651894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc594e1a-3a05-4269-950f-50b5b0686bc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:23:55.652196 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc594e1a-3a05-4269-950f-50b5b0686bc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:55.653637 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc594e1a-3a05-4269-950f-50b5b0686bc0 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:55.665854 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 628/1245] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:23:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:23:55.671967 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c424af5-f002-43dc-adf6-528176180dd7 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:55.778295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c424af5-f002-43dc-adf6-528176180dd7 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:55.812351 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a9ef1-661d-4530-b890-7d14eacf3066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:55.813273 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a9ef1-661d-4530-b890-7d14eacf3066 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:55.813561 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a9ef1-661d-4530-b890-7d14eacf3066 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:55.813969 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a9ef1-661d-4530-b890-7d14eacf3066 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:55.814887 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a9ef1-661d-4530-b890-7d14eacf3066 None admin] RBAC: Adding query filter params (role.id=4798f242077c416e9292660af5469faf, scope.project.id=9cf4f2954dd44516b3e594ed440781cc, user.id=525f4699878f461e82f7f06ef60c176a) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:23:55.815275 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a9ef1-661d-4530-b890-7d14eacf3066 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:55.816743 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a9ef1-661d-4530-b890-7d14eacf3066 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:55.823382 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 618/1246] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:23:55 2022] GET /identity/v3/role_assignments?user.id=525f4699878f461e82f7f06ef60c176a&scope.project.id=9cf4f2954dd44516b3e594ed440781cc&role.id=4798f242077c416e9292660af5469faf => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:23:58.291745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbf60e-29cc-4f59-8fd9-6b742cdad764 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:58.292354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbf60e-29cc-4f59-8fd9-6b742cdad764 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:58.292354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbf60e-29cc-4f59-8fd9-6b742cdad764 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:58.293619 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 629/1247] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:23:58.299073 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c59f3-0738-48b4-a030-239be77d8cb4 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:58.299509 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c59f3-0738-48b4-a030-239be77d8cb4 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:58.299615 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c59f3-0738-48b4-a030-239be77d8cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:58.319230 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-283c59f3-0738-48b4-a030-239be77d8cb4 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:23:58.321194 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-283c59f3-0738-48b4-a030-239be77d8cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:23:58.392920 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 619/1248] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:23:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:23:58.416805 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbf60e-29cc-4f59-8fd9-6b742cdad764 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:58.530500 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbf60e-29cc-4f59-8fd9-6b742cdad764 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:58.567769 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37942bf9-2624-46ac-a6c2-942eaacc4d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:58.568572 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37942bf9-2624-46ac-a6c2-942eaacc4d50 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:58.568850 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37942bf9-2624-46ac-a6c2-942eaacc4d50 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:58.569121 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37942bf9-2624-46ac-a6c2-942eaacc4d50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:58.579311 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37942bf9-2624-46ac-a6c2-942eaacc4d50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:23:58.587644 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-37942bf9-2624-46ac-a6c2-942eaacc4d50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:23:58.587644 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:23:58.587644 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:23:58.587644 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:23:58.587644 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:23:58.587644 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:23:58.587644 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:23:58.587644 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:23:58.587644 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:23:58.587644 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:23:58.587644 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:23:58.587644 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:23:58.587644 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:23:58.587644 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:23:58.587644 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:23:58.587644 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:23:58.589168 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:23:58.589168 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:23:58.589168 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:23:58.589168 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:23:58.589168 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:23:58.589168 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:23:58.589168 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:23:58.589168 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:23:58.589168 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:23:58.589168 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:23:58.589168 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:23:58.589168 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:23:58.589168 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:23:58.589168 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:23:58.589168 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:23:58.589168 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:23:58.590329 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:23:58.590329 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:23:58.590329 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:23:58.590329 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:23:58.590329 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:23:58.590329 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:23:58.590329 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:23:58.590329 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:23:58.590329 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:23:58.590329 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:23:58.590329 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:23:58.590329 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:23:58.590329 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 630/1249] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:23:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:23:58.595078 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c59f3-0738-48b4-a030-239be77d8cb4 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:58.705573 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c59f3-0738-48b4-a030-239be77d8cb4 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:58.739018 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baedb6e-2f47-45c5-934d-8418f667b9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:58.739832 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baedb6e-2f47-45c5-934d-8418f667b9b4 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:58.740234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baedb6e-2f47-45c5-934d-8418f667b9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:58.740784 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baedb6e-2f47-45c5-934d-8418f667b9b4 None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:58.742003 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baedb6e-2f47-45c5-934d-8418f667b9b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:23:58.742322 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baedb6e-2f47-45c5-934d-8418f667b9b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:58.744367 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baedb6e-2f47-45c5-934d-8418f667b9b4 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:58.756680 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 620/1250] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:23:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:23:58.763059 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37942bf9-2624-46ac-a6c2-942eaacc4d50 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:58.873175 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37942bf9-2624-46ac-a6c2-942eaacc4d50 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:58.906800 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4233a-e479-41e1-a492-ac7354d74083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:58.908808 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4233a-e479-41e1-a492-ac7354d74083 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:58.908808 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4233a-e479-41e1-a492-ac7354d74083 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:58.908808 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4233a-e479-41e1-a492-ac7354d74083 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:58.924062 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4233a-e479-41e1-a492-ac7354d74083 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:58.926125 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4233a-e479-41e1-a492-ac7354d74083 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:58.950588 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-97f4233a-e479-41e1-a492-ac7354d74083 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:23:58.950588 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:23:58.950588 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:23:58.950588 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:23:58.950588 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:23:58.950588 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:23:58.950588 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:23:58.950588 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:23:58.950588 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:23:58.950588 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:23:58.950588 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:23:58.950588 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:23:58.950588 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:23:58.950588 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:23:58.950588 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:23:58.951739 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:23:58.951739 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:23:58.951739 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:23:58.951739 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:23:58.951739 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:23:58.951739 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:23:58.951739 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:23:58.951739 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:23:58.951739 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:23:58.951739 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:23:58.951739 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:23:58.951739 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:23:58.951739 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:23:58.951739 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:23:58.951739 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:23:58.951739 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:23:58.951739 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:23:58.952654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:23:58.952654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:23:58.952654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:23:58.952654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:23:58.952654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 631/1251] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:23:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:23:58.958539 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baedb6e-2f47-45c5-934d-8418f667b9b4 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:59.068566 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baedb6e-2f47-45c5-934d-8418f667b9b4 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:59.110644 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273daae9-5969-4352-9e9f-74d02da97428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:59.111825 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273daae9-5969-4352-9e9f-74d02da97428 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:59.112324 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273daae9-5969-4352-9e9f-74d02da97428 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:59.112818 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273daae9-5969-4352-9e9f-74d02da97428 None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:59.114769 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273daae9-5969-4352-9e9f-74d02da97428 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:23:59.115301 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273daae9-5969-4352-9e9f-74d02da97428 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:59.117987 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273daae9-5969-4352-9e9f-74d02da97428 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:59.134785 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 621/1252] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:23:59.140746 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4233a-e479-41e1-a492-ac7354d74083 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:59.251223 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4233a-e479-41e1-a492-ac7354d74083 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:59.285270 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb6c06-df5c-4aa0-8902-4e33630ca884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:59.286640 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb6c06-df5c-4aa0-8902-4e33630ca884 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:59.286918 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb6c06-df5c-4aa0-8902-4e33630ca884 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:59.287187 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb6c06-df5c-4aa0-8902-4e33630ca884 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:59.295562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb6c06-df5c-4aa0-8902-4e33630ca884 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:59.297027 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb6c06-df5c-4aa0-8902-4e33630ca884 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:59.312511 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-ddfb6c06-df5c-4aa0-8902-4e33630ca884 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 09:23:59.312511 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:23:59.312511 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:23:59.312511 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:23:59.312511 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:23:59.312511 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:23:59.312511 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:23:59.312511 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:23:59.312511 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:23:59.312511 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:23:59.312511 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:23:59.312511 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:23:59.312511 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:23:59.312511 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:23:59.312511 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:23:59.312511 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:23:59.313757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:23:59.313757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:23:59.313757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:23:59.313757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:23:59.313757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:23:59.313757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:23:59.313757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:23:59.313757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:23:59.313757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:23:59.313757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:23:59.313757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:23:59.313757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:23:59.313757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:23:59.313757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:23:59.313757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:23:59.313757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:23:59.313757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:23:59.313757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:23:59.314935 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:23:59.314935 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:23:59.314935 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:23:59.314935 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:23:59.314935 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:23:59.314935 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:23:59.314935 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:23:59.314935 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:23:59.314935 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 09:23:59.314935 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:23:59.314935 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 632/1253] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:23:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:23:59.320063 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273daae9-5969-4352-9e9f-74d02da97428 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:59.420690 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273daae9-5969-4352-9e9f-74d02da97428 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:59.455034 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd30f3-f471-405c-94f2-9133cb8efdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:59.455716 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd30f3-f471-405c-94f2-9133cb8efdf4 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:59.455997 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd30f3-f471-405c-94f2-9133cb8efdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:59.456271 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd30f3-f471-405c-94f2-9133cb8efdf4 None admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:59.457105 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd30f3-f471-405c-94f2-9133cb8efdf4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:23:59.457408 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd30f3-f471-405c-94f2-9133cb8efdf4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:59.458891 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd30f3-f471-405c-94f2-9133cb8efdf4 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:59.476921 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 622/1254] 10.222.0.60 () {56 vars in 1143 bytes} [Thu May 12 09:23:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:23:59.482739 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb6c06-df5c-4aa0-8902-4e33630ca884 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:59.582238 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb6c06-df5c-4aa0-8902-4e33630ca884 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:59.615076 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8dccc-57f3-4c0b-a6c7-6d89e3c02ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:59.615735 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8dccc-57f3-4c0b-a6c7-6d89e3c02ba4 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:59.616020 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8dccc-57f3-4c0b-a6c7-6d89e3c02ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:59.616296 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8dccc-57f3-4c0b-a6c7-6d89e3c02ba4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:59.697675 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8dccc-57f3-4c0b-a6c7-6d89e3c02ba4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:59.699151 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8dccc-57f3-4c0b-a6c7-6d89e3c02ba4 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:59.798882 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 633/1255] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:23:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 09:23:59.805245 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd30f3-f471-405c-94f2-9133cb8efdf4 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:23:59.898283 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd30f3-f471-405c-94f2-9133cb8efdf4 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:23:59.929593 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e4bac-e595-4d26-8b3a-e084f4830539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:23:59.930532 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e4bac-e595-4d26-8b3a-e084f4830539 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:23:59.930812 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e4bac-e595-4d26-8b3a-e084f4830539 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:23:59.931083 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e4bac-e595-4d26-8b3a-e084f4830539 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:23:59.940453 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e4bac-e595-4d26-8b3a-e084f4830539 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:23:59.941883 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e4bac-e595-4d26-8b3a-e084f4830539 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:23:59.959150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-f42e4bac-e595-4d26-8b3a-e084f4830539 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:23:59.959150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:23:59.959150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:23:59.959150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:23:59.959150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:23:59.959150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:23:59.959150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:23:59.959150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:23:59.959150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:23:59.959150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:23:59.959150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:23:59.959150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:23:59.959150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:23:59.959150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:23:59.959150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:23:59.960182 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:23:59.960182 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:23:59.960182 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:23:59.960182 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:23:59.960182 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:23:59.960182 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:23:59.960182 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:23:59.960182 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:23:59.960182 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:23:59.960182 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:23:59.960182 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:23:59.960182 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:23:59.960182 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:23:59.960182 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:23:59.960182 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:23:59.960182 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:23:59.960182 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:23:59.961311 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:23:59.961311 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:23:59.961311 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:23:59.961311 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:23:59.961311 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 623/1256] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:23:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:23:59.966060 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8dccc-57f3-4c0b-a6c7-6d89e3c02ba4 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:00.062320 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8dccc-57f3-4c0b-a6c7-6d89e3c02ba4 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:00.093605 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72d890-43be-4dd9-bea6-2d948952910f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:00.094291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72d890-43be-4dd9-bea6-2d948952910f None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:00.094579 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72d890-43be-4dd9-bea6-2d948952910f None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:00.094850 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72d890-43be-4dd9-bea6-2d948952910f None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:00.095565 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed72d890-43be-4dd9-bea6-2d948952910f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:24:00.095871 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed72d890-43be-4dd9-bea6-2d948952910f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:00.097234 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed72d890-43be-4dd9-bea6-2d948952910f None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:00.109370 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 634/1257] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:24:00.115097 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e4bac-e595-4d26-8b3a-e084f4830539 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:00.207504 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e4bac-e595-4d26-8b3a-e084f4830539 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:00.238983 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97ed4a-5538-4718-8172-9f2dd9242c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:00.239761 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97ed4a-5538-4718-8172-9f2dd9242c1a None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:00.240042 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97ed4a-5538-4718-8172-9f2dd9242c1a None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:00.240314 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97ed4a-5538-4718-8172-9f2dd9242c1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:00.246592 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97ed4a-5538-4718-8172-9f2dd9242c1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:00.248004 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97ed4a-5538-4718-8172-9f2dd9242c1a None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:00.261998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-4f97ed4a-5538-4718-8172-9f2dd9242c1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:24:00.261998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:24:00.261998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:24:00.261998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:24:00.261998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:24:00.261998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:24:00.261998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:24:00.261998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:24:00.261998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:24:00.261998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:24:00.261998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:24:00.261998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:24:00.261998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:24:00.261998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:24:00.261998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:24:00.263061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:24:00.263061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:24:00.263061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:24:00.263061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:24:00.263061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:24:00.263061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:24:00.263061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:24:00.263061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:24:00.263061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:24:00.263061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:24:00.263061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:24:00.263061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:24:00.263061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:24:00.263061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:24:00.263061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:24:00.263061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:24:00.263061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:24:00.264179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:24:00.264179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:24:00.264179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:24:00.264179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:24:00.264179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:24:00.264179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:24:00.264179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:24:00.264179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:24:00.264179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 624/1258] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:24:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:24:00.268769 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72d890-43be-4dd9-bea6-2d948952910f None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:00.368960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72d890-43be-4dd9-bea6-2d948952910f None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:00.400154 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f3d34-c432-4a8b-8d6a-f7bb39fa14a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:00.400802 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f3d34-c432-4a8b-8d6a-f7bb39fa14a5 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:00.401086 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f3d34-c432-4a8b-8d6a-f7bb39fa14a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:00.401363 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f3d34-c432-4a8b-8d6a-f7bb39fa14a5 None admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:00.402162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f3d34-c432-4a8b-8d6a-f7bb39fa14a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:24:00.402475 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f3d34-c432-4a8b-8d6a-f7bb39fa14a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:00.403889 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f3d34-c432-4a8b-8d6a-f7bb39fa14a5 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:00.415663 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 635/1259] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:24:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:24:00.421594 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97ed4a-5538-4718-8172-9f2dd9242c1a None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:00.513263 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97ed4a-5538-4718-8172-9f2dd9242c1a None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:00.544377 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122543da-f3c8-4e04-a7ec-b3fe1e31b283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:00.544999 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122543da-f3c8-4e04-a7ec-b3fe1e31b283 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:00.545274 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122543da-f3c8-4e04-a7ec-b3fe1e31b283 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:00.545543 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122543da-f3c8-4e04-a7ec-b3fe1e31b283 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:00.546374 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122543da-f3c8-4e04-a7ec-b3fe1e31b283 None admin] RBAC: Adding query filter params (role.id=8f01c4c38fa44034a54c1f8cd2d2db1a, scope.project.id=9cf4f2954dd44516b3e594ed440781cc, user.id=525f4699878f461e82f7f06ef60c176a) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:24:00.546679 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122543da-f3c8-4e04-a7ec-b3fe1e31b283 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:00.548065 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122543da-f3c8-4e04-a7ec-b3fe1e31b283 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:00.553150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 625/1260] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:24:00 2022] GET /identity/v3/role_assignments?user.id=525f4699878f461e82f7f06ef60c176a&scope.project.id=9cf4f2954dd44516b3e594ed440781cc&role.id=8f01c4c38fa44034a54c1f8cd2d2db1a => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:24:02.721634 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e2118-2dc9-4342-91b2-e91ca25a783e None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:02.722246 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e2118-2dc9-4342-91b2-e91ca25a783e None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:02.722246 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e2118-2dc9-4342-91b2-e91ca25a783e None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:02.724193 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 636/1261] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:24:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:24:02.729207 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c6ced-66b9-4d48-9fcd-0172dfcf3425 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:02.729587 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c6ced-66b9-4d48-9fcd-0172dfcf3425 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:02.729746 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c6ced-66b9-4d48-9fcd-0172dfcf3425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:02.745732 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-ba0c6ced-66b9-4d48-9fcd-0172dfcf3425 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:24:02.746907 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-ba0c6ced-66b9-4d48-9fcd-0172dfcf3425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:24:02.808195 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 626/1262] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:24:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:24:02.830013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e2118-2dc9-4342-91b2-e91ca25a783e None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:02.927637 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e2118-2dc9-4342-91b2-e91ca25a783e None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:02.958965 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc689e-1167-455c-bfeb-c2d298d71975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:02.959728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc689e-1167-455c-bfeb-c2d298d71975 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:02.960007 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc689e-1167-455c-bfeb-c2d298d71975 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:02.960277 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc689e-1167-455c-bfeb-c2d298d71975 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:02.969703 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc689e-1167-455c-bfeb-c2d298d71975 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:24:02.977775 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-1efc689e-1167-455c-bfeb-c2d298d71975 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:24:02.977775 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:24:02.977775 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:24:02.977775 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:24:02.977775 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:24:02.977775 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:24:02.977775 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:24:02.977775 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:24:02.977775 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:24:02.977775 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:24:02.977775 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:24:02.977775 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:24:02.977775 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:24:02.977775 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:24:02.977775 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:24:02.977775 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:24:02.978938 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:24:02.978938 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:24:02.978938 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:24:02.978938 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:24:02.978938 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:24:02.978938 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:24:02.978938 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:24:02.978938 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:24:02.978938 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:24:02.978938 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:24:02.978938 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:24:02.978938 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:24:02.978938 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:24:02.978938 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:24:02.978938 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:24:02.978938 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:24:02.979975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:24:02.979975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:24:02.979975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:24:02.979975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:24:02.979975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:24:02.979975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:24:02.979975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:24:02.979975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:24:02.979975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:24:02.979975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:24:02.979975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:24:02.979975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:24:02.979975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 637/1263] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:24:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:24:02.985006 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c6ced-66b9-4d48-9fcd-0172dfcf3425 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:03.076322 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c6ced-66b9-4d48-9fcd-0172dfcf3425 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:03.107948 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89411b87-5256-41ae-a2a9-622ffbd0a8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:03.108603 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89411b87-5256-41ae-a2a9-622ffbd0a8ea None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:03.108882 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89411b87-5256-41ae-a2a9-622ffbd0a8ea None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:03.109153 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89411b87-5256-41ae-a2a9-622ffbd0a8ea None admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:03.109883 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89411b87-5256-41ae-a2a9-622ffbd0a8ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:24:03.110214 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89411b87-5256-41ae-a2a9-622ffbd0a8ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:03.111561 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89411b87-5256-41ae-a2a9-622ffbd0a8ea None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:03.119308 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 627/1264] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:24:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:24:03.124948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc689e-1167-455c-bfeb-c2d298d71975 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:03.222449 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc689e-1167-455c-bfeb-c2d298d71975 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:03.253323 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac087a-726e-4560-a5b2-38242d637bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:03.254068 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac087a-726e-4560-a5b2-38242d637bbb None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:03.254349 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac087a-726e-4560-a5b2-38242d637bbb None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:03.255401 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac087a-726e-4560-a5b2-38242d637bbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:03.267993 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac087a-726e-4560-a5b2-38242d637bbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:03.269428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac087a-726e-4560-a5b2-38242d637bbb None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:03.286631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-22ac087a-726e-4560-a5b2-38242d637bbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:24:03.286631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:24:03.286631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:24:03.286631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:24:03.286631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:24:03.286631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:24:03.286631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:24:03.286631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:24:03.286631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:24:03.286631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:24:03.286631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:24:03.286631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:24:03.286631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:24:03.286631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:24:03.286631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:24:03.287711 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:24:03.287711 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:24:03.287711 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:24:03.287711 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:24:03.287711 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:24:03.287711 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:24:03.287711 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:24:03.287711 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:24:03.287711 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:24:03.287711 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:24:03.287711 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:24:03.287711 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:24:03.287711 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:24:03.287711 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:24:03.287711 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:24:03.287711 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:24:03.287711 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:24:03.288899 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:24:03.288899 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:24:03.288899 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:24:03.288899 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:24:03.288899 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 638/1265] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:24:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:24:03.293515 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89411b87-5256-41ae-a2a9-622ffbd0a8ea None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:03.387098 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89411b87-5256-41ae-a2a9-622ffbd0a8ea None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:03.417825 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef6f5e-777e-42f8-b2e9-ac373ed037e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:03.418496 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef6f5e-777e-42f8-b2e9-ac373ed037e0 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:03.418783 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef6f5e-777e-42f8-b2e9-ac373ed037e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:03.419055 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef6f5e-777e-42f8-b2e9-ac373ed037e0 None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:03.419756 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef6f5e-777e-42f8-b2e9-ac373ed037e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:24:03.420060 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef6f5e-777e-42f8-b2e9-ac373ed037e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:03.421412 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef6f5e-777e-42f8-b2e9-ac373ed037e0 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:03.433115 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 628/1266] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:24:03.438457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac087a-726e-4560-a5b2-38242d637bbb None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:03.530290 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac087a-726e-4560-a5b2-38242d637bbb None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:03.561025 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b95b1-6a78-4e7c-9b46-8eed1bfef8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:03.561791 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b95b1-6a78-4e7c-9b46-8eed1bfef8f7 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:03.562096 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b95b1-6a78-4e7c-9b46-8eed1bfef8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:03.562366 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b95b1-6a78-4e7c-9b46-8eed1bfef8f7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:03.569910 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b95b1-6a78-4e7c-9b46-8eed1bfef8f7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:03.571341 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b95b1-6a78-4e7c-9b46-8eed1bfef8f7 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:03.585095 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-bf7b95b1-6a78-4e7c-9b46-8eed1bfef8f7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 09:24:03.585095 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:24:03.585095 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:24:03.585095 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:24:03.585095 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:24:03.585095 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:24:03.585095 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:24:03.585095 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:24:03.585095 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:24:03.585095 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:24:03.585095 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:24:03.585095 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:24:03.585095 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:24:03.585095 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:24:03.585095 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:24:03.585095 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:24:03.586262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:24:03.586262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:24:03.586262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:24:03.586262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:24:03.586262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:24:03.586262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:24:03.586262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:24:03.586262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:24:03.586262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:24:03.586262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:24:03.586262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:24:03.586262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:24:03.586262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:24:03.586262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:24:03.586262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:24:03.586262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:24:03.586262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:24:03.586262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:24:03.587267 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:24:03.587267 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:24:03.587267 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:24:03.587267 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:24:03.587267 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:24:03.587267 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:24:03.587267 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:24:03.587267 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:24:03.587267 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 09:24:03.587267 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:24:03.587267 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 639/1267] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:24:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:24:03.591960 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef6f5e-777e-42f8-b2e9-ac373ed037e0 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:03.699744 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef6f5e-777e-42f8-b2e9-ac373ed037e0 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:03.731610 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c56d1-b01f-462b-bf54-29bb79780352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:03.732267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c56d1-b01f-462b-bf54-29bb79780352 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:03.732543 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c56d1-b01f-462b-bf54-29bb79780352 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:03.732812 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c56d1-b01f-462b-bf54-29bb79780352 None admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:03.733620 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c56d1-b01f-462b-bf54-29bb79780352 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:24:03.733937 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c56d1-b01f-462b-bf54-29bb79780352 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:03.735368 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c56d1-b01f-462b-bf54-29bb79780352 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:03.751635 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 629/1268] 10.222.0.60 () {56 vars in 1143 bytes} [Thu May 12 09:24:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:24:03.758141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b95b1-6a78-4e7c-9b46-8eed1bfef8f7 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:03.850178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b95b1-6a78-4e7c-9b46-8eed1bfef8f7 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:03.881112 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a50c5a-a779-4a87-8ef4-8e6f58338fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:03.881867 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a50c5a-a779-4a87-8ef4-8e6f58338fd8 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:03.882172 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a50c5a-a779-4a87-8ef4-8e6f58338fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:03.882436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a50c5a-a779-4a87-8ef4-8e6f58338fd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:03.892155 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a50c5a-a779-4a87-8ef4-8e6f58338fd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:03.893573 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a50c5a-a779-4a87-8ef4-8e6f58338fd8 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:03.909625 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-97a50c5a-a779-4a87-8ef4-8e6f58338fd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:24:03.909625 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:24:03.909625 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:24:03.909625 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:24:03.909625 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:24:03.909625 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:24:03.909625 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:24:03.909625 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:24:03.909625 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:24:03.909625 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:24:03.909625 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:24:03.909625 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:24:03.909625 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:24:03.909625 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:24:03.909625 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:24:03.910692 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:24:03.910692 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:24:03.910692 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:24:03.910692 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:24:03.910692 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:24:03.910692 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:24:03.910692 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:24:03.910692 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:24:03.910692 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:24:03.910692 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:24:03.910692 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:24:03.910692 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:24:03.910692 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:24:03.910692 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:24:03.910692 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:24:03.910692 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:24:03.910692 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:24:03.912427 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:24:03.912427 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:24:03.912427 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:24:03.912427 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:24:03.912427 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 640/1269] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:24:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:24:03.917578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c56d1-b01f-462b-bf54-29bb79780352 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:04.011139 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c56d1-b01f-462b-bf54-29bb79780352 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:04.042469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36fe89-5eb1-4fd7-96db-bceffbc6448b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:04.043117 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36fe89-5eb1-4fd7-96db-bceffbc6448b None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:04.043396 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36fe89-5eb1-4fd7-96db-bceffbc6448b None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:04.043665 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36fe89-5eb1-4fd7-96db-bceffbc6448b None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:04.044366 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36fe89-5eb1-4fd7-96db-bceffbc6448b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:24:04.044667 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36fe89-5eb1-4fd7-96db-bceffbc6448b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:04.046036 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36fe89-5eb1-4fd7-96db-bceffbc6448b None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:04.057154 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 630/1270] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:24:04.062725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a50c5a-a779-4a87-8ef4-8e6f58338fd8 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:04.156584 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a50c5a-a779-4a87-8ef4-8e6f58338fd8 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:04.187900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8c1b9-a449-4784-984a-2364a4496a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:04.188667 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8c1b9-a449-4784-984a-2364a4496a5f None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:04.188944 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8c1b9-a449-4784-984a-2364a4496a5f None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:04.189212 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8c1b9-a449-4784-984a-2364a4496a5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:04.195426 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8c1b9-a449-4784-984a-2364a4496a5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:04.196841 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8c1b9-a449-4784-984a-2364a4496a5f None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:04.210810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-e5a8c1b9-a449-4784-984a-2364a4496a5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:24:04.210810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:24:04.210810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:24:04.210810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:24:04.210810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:24:04.210810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:24:04.210810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:24:04.210810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:24:04.210810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:24:04.210810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:24:04.210810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:24:04.210810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:24:04.210810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:24:04.210810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:24:04.210810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:24:04.211859 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:24:04.211859 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:24:04.211859 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:24:04.211859 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:24:04.211859 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:24:04.211859 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:24:04.211859 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:24:04.211859 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:24:04.211859 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:24:04.211859 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:24:04.211859 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:24:04.211859 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:24:04.211859 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:24:04.211859 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:24:04.211859 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:24:04.211859 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:24:04.211859 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:24:04.212843 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:24:04.212843 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:24:04.212843 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:24:04.212843 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:24:04.212843 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:24:04.212843 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:24:04.212843 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:24:04.212843 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:24:04.212843 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 641/1271] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:24:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:24:04.217775 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36fe89-5eb1-4fd7-96db-bceffbc6448b None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:04.312060 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36fe89-5eb1-4fd7-96db-bceffbc6448b None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:04.345551 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b05437-e98a-4a90-9eef-5d484ee27db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:04.346234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b05437-e98a-4a90-9eef-5d484ee27db5 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:04.346519 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b05437-e98a-4a90-9eef-5d484ee27db5 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:04.346795 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b05437-e98a-4a90-9eef-5d484ee27db5 None admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:04.347566 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b05437-e98a-4a90-9eef-5d484ee27db5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:24:04.347871 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b05437-e98a-4a90-9eef-5d484ee27db5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:04.349915 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b05437-e98a-4a90-9eef-5d484ee27db5 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:04.361201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 631/1272] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:24:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:24:04.367019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8c1b9-a449-4784-984a-2364a4496a5f None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:04.460761 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8c1b9-a449-4784-984a-2364a4496a5f None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:04.492523 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74752c70-7369-4a14-bc38-913b4b15437c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:04.493379 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74752c70-7369-4a14-bc38-913b4b15437c None admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:04.493652 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74752c70-7369-4a14-bc38-913b4b15437c None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:04.493943 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74752c70-7369-4a14-bc38-913b4b15437c None admin] PATH_INFO: `/v3/projects/9cf4f2954dd44516b3e594ed440781cc/users/525f4699878f461e82f7f06ef60c176a/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:04.495850 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74752c70-7369-4a14-bc38-913b4b15437c None admin] RBAC: Authorizing `identity:create_grant(project_id=9cf4f2954dd44516b3e594ed440781cc, user_id=525f4699878f461e82f7f06ef60c176a, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:04.497256 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74752c70-7369-4a14-bc38-913b4b15437c None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:04.509360 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 642/1273] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 12 09:24:04 2022] PUT /identity/v3/projects/9cf4f2954dd44516b3e594ed440781cc/users/525f4699878f461e82f7f06ef60c176a/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:24:06.676397 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25bdeb-e483-4cd7-b998-eab59c536341 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:06.677035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25bdeb-e483-4cd7-b998-eab59c536341 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:06.677035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25bdeb-e483-4cd7-b998-eab59c536341 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:06.678857 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 632/1274] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:24:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:24:06.683918 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3be177-c2dc-4ee4-8d92-84e593220bb2 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:06.684372 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3be177-c2dc-4ee4-8d92-84e593220bb2 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:06.684482 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3be177-c2dc-4ee4-8d92-84e593220bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:06.700627 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-1e3be177-c2dc-4ee4-8d92-84e593220bb2 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:24:06.701783 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-1e3be177-c2dc-4ee4-8d92-84e593220bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:24:06.764717 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 643/1275] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:24:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 09:24:06.788420 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25bdeb-e483-4cd7-b998-eab59c536341 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:06.882184 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25bdeb-e483-4cd7-b998-eab59c536341 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:06.914504 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98825856-9641-4e57-a2bb-591ba17d5486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:06.915275 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98825856-9641-4e57-a2bb-591ba17d5486 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:06.915547 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98825856-9641-4e57-a2bb-591ba17d5486 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:06.915811 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98825856-9641-4e57-a2bb-591ba17d5486 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:06.925086 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98825856-9641-4e57-a2bb-591ba17d5486 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 09:24:06.933217 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-98825856-9641-4e57-a2bb-591ba17d5486 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:24:06.933217 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:24:06.933217 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:24:06.933217 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:24:06.933217 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:24:06.933217 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:24:06.933217 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:24:06.933217 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:24:06.933217 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:24:06.933217 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:24:06.933217 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:24:06.933217 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:24:06.933217 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 09:24:06.933217 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 09:24:06.933217 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 09:24:06.933217 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 09:24:06.934356 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 09:24:06.934356 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 09:24:06.934356 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 09:24:06.934356 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 09:24:06.934356 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:24:06.934356 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:24:06.934356 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:24:06.934356 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:24:06.934356 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:24:06.934356 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:24:06.934356 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:24:06.934356 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:24:06.934356 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:24:06.934356 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:24:06.934356 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:24:06.934356 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:24:06.935431 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:24:06.935431 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:24:06.935431 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:24:06.935431 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:24:06.935431 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 09:24:06.935431 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 09:24:06.935431 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 09:24:06.935431 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 09:24:06.935431 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 09:24:06.935431 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 09:24:06.935431 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 09:24:06.935431 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:24:06.935431 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 633/1276] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 12 09:24:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:24:06.940231 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3be177-c2dc-4ee4-8d92-84e593220bb2 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:07.032158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3be177-c2dc-4ee4-8d92-84e593220bb2 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:07.063631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf835e-9a2e-4e4c-88fc-66be86ec3656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:07.064291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf835e-9a2e-4e4c-88fc-66be86ec3656 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:07.064572 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf835e-9a2e-4e4c-88fc-66be86ec3656 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:07.064846 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf835e-9a2e-4e4c-88fc-66be86ec3656 None admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:07.065586 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf835e-9a2e-4e4c-88fc-66be86ec3656 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:24:07.065891 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf835e-9a2e-4e4c-88fc-66be86ec3656 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:07.067787 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf835e-9a2e-4e4c-88fc-66be86ec3656 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:07.075488 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 644/1277] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 12 09:24:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:24:07.081092 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98825856-9641-4e57-a2bb-591ba17d5486 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:07.176263 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98825856-9641-4e57-a2bb-591ba17d5486 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:07.207583 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6003685-3066-42de-9d78-ea763a2da67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:07.208828 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6003685-3066-42de-9d78-ea763a2da67a None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:07.209105 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6003685-3066-42de-9d78-ea763a2da67a None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:07.209372 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6003685-3066-42de-9d78-ea763a2da67a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:07.219765 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6003685-3066-42de-9d78-ea763a2da67a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:07.221190 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6003685-3066-42de-9d78-ea763a2da67a None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:07.238978 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-c6003685-3066-42de-9d78-ea763a2da67a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:24:07.238978 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:24:07.238978 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:24:07.238978 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:24:07.238978 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:24:07.238978 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:24:07.238978 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:24:07.238978 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:24:07.238978 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:24:07.238978 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:24:07.238978 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:24:07.238978 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:24:07.238978 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:24:07.238978 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:24:07.238978 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:24:07.240061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:24:07.240061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:24:07.240061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:24:07.240061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:24:07.240061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:24:07.240061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:24:07.240061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:24:07.240061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:24:07.240061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:24:07.240061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:24:07.240061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:24:07.240061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:24:07.240061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:24:07.240061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:24:07.240061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:24:07.240061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:24:07.240061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:24:07.241210 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:24:07.241210 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:24:07.241210 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:24:07.241210 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:24:07.241210 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 634/1278] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:24:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:24:07.245835 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf835e-9a2e-4e4c-88fc-66be86ec3656 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:07.342284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf835e-9a2e-4e4c-88fc-66be86ec3656 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:07.373675 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f40222-8b77-4eed-a84f-66bc9e9c912e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:07.374353 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f40222-8b77-4eed-a84f-66bc9e9c912e None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:07.374636 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f40222-8b77-4eed-a84f-66bc9e9c912e None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:07.374909 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f40222-8b77-4eed-a84f-66bc9e9c912e None admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:07.375617 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f40222-8b77-4eed-a84f-66bc9e9c912e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:24:07.375921 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f40222-8b77-4eed-a84f-66bc9e9c912e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:07.377274 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f40222-8b77-4eed-a84f-66bc9e9c912e None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:07.388510 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 645/1279] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:24:07.394056 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6003685-3066-42de-9d78-ea763a2da67a None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:07.486567 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6003685-3066-42de-9d78-ea763a2da67a None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:07.516881 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f9775-5d4c-427e-bff0-40ceaef8669d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:07.517652 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f9775-5d4c-427e-bff0-40ceaef8669d None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:07.517955 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f9775-5d4c-427e-bff0-40ceaef8669d None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:07.518228 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f9775-5d4c-427e-bff0-40ceaef8669d None admin] PATH_INFO: `/v3/users/placement` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:07.525600 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f9775-5d4c-427e-bff0-40ceaef8669d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:07.527033 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f9775-5d4c-427e-bff0-40ceaef8669d None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:07.540621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-9f9f9775-5d4c-427e-bff0-40ceaef8669d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 09:24:07.540621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:24:07.540621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:24:07.540621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:24:07.540621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:24:07.540621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:24:07.540621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:24:07.540621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:24:07.540621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:24:07.540621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:24:07.540621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:24:07.540621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:24:07.540621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 09:24:07.540621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 09:24:07.540621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 09:24:07.540621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 09:24:07.541722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:24:07.541722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:24:07.541722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 09:24:07.541722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:24:07.541722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 09:24:07.541722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 09:24:07.541722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:24:07.541722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:24:07.541722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:24:07.541722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:24:07.541722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:24:07.541722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:24:07.541722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:24:07.541722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:24:07.541722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:24:07.541722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:24:07.541722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:24:07.541722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:24:07.547172 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:24:07.547172 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:24:07.547172 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 09:24:07.547172 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 09:24:07.547172 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 09:24:07.547172 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 09:24:07.547172 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 09:24:07.547172 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 09:24:07.547172 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 09:24:07.547172 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:24:07.547172 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 635/1280] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:24:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:24:07.547931 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f40222-8b77-4eed-a84f-66bc9e9c912e None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:07.647046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f40222-8b77-4eed-a84f-66bc9e9c912e None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:07.687935 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cc0fd-613e-4b5f-9489-387d36b9b10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:07.688620 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cc0fd-613e-4b5f-9489-387d36b9b10d None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:07.688983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cc0fd-613e-4b5f-9489-387d36b9b10d None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:07.689283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cc0fd-613e-4b5f-9489-387d36b9b10d None admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:07.690478 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554cc0fd-613e-4b5f-9489-387d36b9b10d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:24:07.690854 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554cc0fd-613e-4b5f-9489-387d36b9b10d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:07.692599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554cc0fd-613e-4b5f-9489-387d36b9b10d None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:07.711097 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 646/1281] 10.222.0.60 () {56 vars in 1143 bytes} [Thu May 12 09:24:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:24:07.716881 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f9775-5d4c-427e-bff0-40ceaef8669d None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:07.809673 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f9775-5d4c-427e-bff0-40ceaef8669d None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:07.839827 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8437106-74ca-4990-8feb-11044a5b1e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:07.840471 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8437106-74ca-4990-8feb-11044a5b1e5d None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:07.840751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8437106-74ca-4990-8feb-11044a5b1e5d None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:07.841022 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8437106-74ca-4990-8feb-11044a5b1e5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:07.902320 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8437106-74ca-4990-8feb-11044a5b1e5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:07.903726 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8437106-74ca-4990-8feb-11044a5b1e5d None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:07.994431 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 636/1282] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 12 09:24:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 09:24:08.000135 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cc0fd-613e-4b5f-9489-387d36b9b10d None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:08.092995 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cc0fd-613e-4b5f-9489-387d36b9b10d None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:08.124953 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafd029-0a04-4558-bfa7-ba42a54aa0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:08.125731 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafd029-0a04-4558-bfa7-ba42a54aa0c4 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:08.126051 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafd029-0a04-4558-bfa7-ba42a54aa0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:08.126325 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafd029-0a04-4558-bfa7-ba42a54aa0c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:08.135960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fafd029-0a04-4558-bfa7-ba42a54aa0c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:08.137386 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fafd029-0a04-4558-bfa7-ba42a54aa0c4 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:08.154411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-3fafd029-0a04-4558-bfa7-ba42a54aa0c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:24:08.154411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:24:08.154411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:24:08.154411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:24:08.154411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:24:08.154411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:24:08.154411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:24:08.154411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:24:08.154411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:24:08.154411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:24:08.154411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:24:08.154411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:24:08.154411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 09:24:08.154411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 09:24:08.154411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 09:24:08.155479 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 09:24:08.155479 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:24:08.155479 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:24:08.155479 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:24:08.155479 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:24:08.155479 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:24:08.155479 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:24:08.155479 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:24:08.155479 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:24:08.155479 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:24:08.155479 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:24:08.155479 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:24:08.155479 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:24:08.155479 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:24:08.155479 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:24:08.155479 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:24:08.155479 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:24:08.156452 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 09:24:08.156452 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 09:24:08.156452 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 09:24:08.156452 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:24:08.156452 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 647/1283] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:24:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:24:08.161616 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8437106-74ca-4990-8feb-11044a5b1e5d None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:08.251433 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8437106-74ca-4990-8feb-11044a5b1e5d None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:08.283000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd227d-7fc4-4074-8ae7-aed0a49feec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:08.283639 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd227d-7fc4-4074-8ae7-aed0a49feec1 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:08.283917 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd227d-7fc4-4074-8ae7-aed0a49feec1 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:08.284187 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd227d-7fc4-4074-8ae7-aed0a49feec1 None admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:08.284878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd227d-7fc4-4074-8ae7-aed0a49feec1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:24:08.285177 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd227d-7fc4-4074-8ae7-aed0a49feec1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:08.286584 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd227d-7fc4-4074-8ae7-aed0a49feec1 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:08.297032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 637/1284] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 12 09:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:24:08.302364 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafd029-0a04-4558-bfa7-ba42a54aa0c4 None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:08.396153 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafd029-0a04-4558-bfa7-ba42a54aa0c4 None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:08.428130 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc8b79-25a6-44fa-834e-5a26f386247f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:08.428897 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc8b79-25a6-44fa-834e-5a26f386247f None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:08.429176 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc8b79-25a6-44fa-834e-5a26f386247f None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:08.429447 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc8b79-25a6-44fa-834e-5a26f386247f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:08.435861 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc8b79-25a6-44fa-834e-5a26f386247f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:08.437282 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc8b79-25a6-44fa-834e-5a26f386247f None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:08.451052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application [None req-26cc8b79-25a6-44fa-834e-5a26f386247f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:24:08.451052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:24:08.451052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:24:08.451052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:24:08.451052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:24:08.451052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:24:08.451052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:24:08.451052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:24:08.451052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:24:08.451052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:24:08.451052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:24:08.451052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:24:08.451052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 09:24:08.451052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 09:24:08.451052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 09:24:08.452115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 09:24:08.452115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:24:08.452115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:24:08.452115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:24:08.452115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:24:08.452115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:24:08.452115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:24:08.452115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:24:08.452115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application with Lock( May 12 09:24:08.452115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:24:08.452115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._enter() May 12 09:24:08.452115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:24:08.452115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:24:08.452115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:24:08.452115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.creator() May 12 09:24:08.452115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:24:08.452115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application created_value = creator( May 12 09:24:08.453221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 09:24:08.453221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 09:24:08.453221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 09:24:08.453221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 09:24:08.453221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 09:24:08.453221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 09:24:08.453221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 09:24:08.453221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: ERROR keystone.server.flask.application May 12 09:24:08.453221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 648/1285] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 12 09:24:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 09:24:08.458433 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd227d-7fc4-4074-8ae7-aed0a49feec1 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:08.550134 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd227d-7fc4-4074-8ae7-aed0a49feec1 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:08.580736 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fc1b2-661e-46cc-b5e7-21df6c2d67e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:08.581372 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fc1b2-661e-46cc-b5e7-21df6c2d67e7 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:08.581649 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fc1b2-661e-46cc-b5e7-21df6c2d67e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:08.581942 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fc1b2-661e-46cc-b5e7-21df6c2d67e7 None admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:08.582728 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fc1b2-661e-46cc-b5e7-21df6c2d67e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:24:08.583030 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fc1b2-661e-46cc-b5e7-21df6c2d67e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:08.584405 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fc1b2-661e-46cc-b5e7-21df6c2d67e7 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:08.595651 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 638/1286] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 12 09:24:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:24:08.602032 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc8b79-25a6-44fa-834e-5a26f386247f None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:08.698173 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc8b79-25a6-44fa-834e-5a26f386247f None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:08.729543 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b302d46-7f5b-4b6e-ae4f-5772af55b267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:08.730211 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b302d46-7f5b-4b6e-ae4f-5772af55b267 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:08.730492 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b302d46-7f5b-4b6e-ae4f-5772af55b267 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:08.730761 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b302d46-7f5b-4b6e-ae4f-5772af55b267 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:08.731573 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b302d46-7f5b-4b6e-ae4f-5772af55b267 None admin] RBAC: Adding query filter params (role.id=8f01c4c38fa44034a54c1f8cd2d2db1a, scope.project.id=9cf4f2954dd44516b3e594ed440781cc, user.id=525f4699878f461e82f7f06ef60c176a) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:24:08.731876 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b302d46-7f5b-4b6e-ae4f-5772af55b267 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:08.733290 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b302d46-7f5b-4b6e-ae4f-5772af55b267 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:08.738757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 649/1287] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 12 09:24:08 2022] GET /identity/v3/role_assignments?user.id=525f4699878f461e82f7f06ef60c176a&scope.project.id=9cf4f2954dd44516b3e594ed440781cc&role.id=8f01c4c38fa44034a54c1f8cd2d2db1a => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:24:10.924732 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3cb1b-68ec-4959-999f-3e6fe9261691 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:10.925274 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3cb1b-68ec-4959-999f-3e6fe9261691 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:10.925274 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3cb1b-68ec-4959-999f-3e6fe9261691 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:10.927237 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 639/1288] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:24:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:24:10.932338 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0eb433-e147-4bd9-94cb-012b7f24bf56 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:10.932741 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0eb433-e147-4bd9-94cb-012b7f24bf56 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:10.932900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0eb433-e147-4bd9-94cb-012b7f24bf56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:10.949739 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-6a0eb433-e147-4bd9-94cb-012b7f24bf56 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:24:10.950945 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-6a0eb433-e147-4bd9-94cb-012b7f24bf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:24:11.013751 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 650/1289] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:24:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:24:11.035045 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3cb1b-68ec-4959-999f-3e6fe9261691 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:11.129679 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3cb1b-68ec-4959-999f-3e6fe9261691 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:11.161602 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958203f4-3d48-486c-a523-bd09486af005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:11.162419 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958203f4-3d48-486c-a523-bd09486af005 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:11.162698 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958203f4-3d48-486c-a523-bd09486af005 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:11.162969 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958203f4-3d48-486c-a523-bd09486af005 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:11.163606 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958203f4-3d48-486c-a523-bd09486af005 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:11.164948 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958203f4-3d48-486c-a523-bd09486af005 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:11.177026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-958203f4-3d48-486c-a523-bd09486af005 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 09:24:11.177026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:24:11.177026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 09:24:11.177026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 09:24:11.177026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 09:24:11.177026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 09:24:11.177026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 09:24:11.177026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:24:11.177026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 09:24:11.177026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:24:11.177026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 09:24:11.177026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:24:11.177026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:24:11.177026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:24:11.177026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:24:11.177026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:24:11.177026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:24:11.178252 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:24:11.178252 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:24:11.178252 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:24:11.178252 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:24:11.178252 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:24:11.178252 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:24:11.178252 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 09:24:11.178252 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 09:24:11.178252 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 09:24:11.178252 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 09:24:11.178252 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:24:11.178252 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:24:11.178252 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:24:11.178252 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:24:11.178252 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:24:11.178252 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:24:11.179529 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:24:11.179529 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:24:11.179529 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:24:11.179529 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:24:11.179529 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:24:11.179529 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:24:11.179529 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:24:11.179529 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:24:11.179529 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:24:11.179529 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:24:11.179529 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 09:24:11.179529 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:24:11.179529 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 09:24:11.179529 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:24:11.179529 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 640/1290] 10.222.0.60 () {56 vars in 1117 bytes} [Thu May 12 09:24:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:24:11.184147 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0eb433-e147-4bd9-94cb-012b7f24bf56 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:11.278400 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0eb433-e147-4bd9-94cb-012b7f24bf56 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:11.311962 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20a62a-d73c-49a6-8ef5-a730d122e538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:11.312615 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20a62a-d73c-49a6-8ef5-a730d122e538 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:11.312899 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20a62a-d73c-49a6-8ef5-a730d122e538 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:11.313176 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20a62a-d73c-49a6-8ef5-a730d122e538 None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:11.313874 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe20a62a-d73c-49a6-8ef5-a730d122e538 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:24:11.314217 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe20a62a-d73c-49a6-8ef5-a730d122e538 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:11.315581 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe20a62a-d73c-49a6-8ef5-a730d122e538 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:11.320658 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 651/1291] 10.222.0.60 () {56 vars in 1116 bytes} [Thu May 12 09:24:11 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:24:11.326416 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958203f4-3d48-486c-a523-bd09486af005 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:11.420999 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958203f4-3d48-486c-a523-bd09486af005 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:11.452342 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3881f99-22b6-4bbe-8a0e-d2e66ea36c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:11.452934 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3881f99-22b6-4bbe-8a0e-d2e66ea36c30 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:11.453215 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3881f99-22b6-4bbe-8a0e-d2e66ea36c30 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:11.453487 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3881f99-22b6-4bbe-8a0e-d2e66ea36c30 None admin] PATH_INFO: `/v3/services` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:11.454205 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3881f99-22b6-4bbe-8a0e-d2e66ea36c30 None admin] RBAC: Adding query filter params (type=placement) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:24:11.454508 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3881f99-22b6-4bbe-8a0e-d2e66ea36c30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:11.455847 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3881f99-22b6-4bbe-8a0e-d2e66ea36c30 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:11.460582 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 641/1292] 10.222.0.60 () {56 vars in 1116 bytes} [Thu May 12 09:24:11 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:24:13.656727 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5439d-13d1-4a04-91ac-a3fec0e283a7 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:13.657615 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5439d-13d1-4a04-91ac-a3fec0e283a7 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:13.657925 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5439d-13d1-4a04-91ac-a3fec0e283a7 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:13.659280 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 652/1293] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:24:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:24:13.665110 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25248658-362a-43c6-ad6c-076aafd41d32 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:13.665648 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25248658-362a-43c6-ad6c-076aafd41d32 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:13.665746 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25248658-362a-43c6-ad6c-076aafd41d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:13.685643 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-25248658-362a-43c6-ad6c-076aafd41d32 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:24:13.687173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-25248658-362a-43c6-ad6c-076aafd41d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:24:13.749801 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 642/1294] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:24:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 09:24:13.772434 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5439d-13d1-4a04-91ac-a3fec0e283a7 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:13.867280 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5439d-13d1-4a04-91ac-a3fec0e283a7 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:13.898329 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1689e1-aace-4aa3-99ef-aa427f95d823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:13.898968 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1689e1-aace-4aa3-99ef-aa427f95d823 None admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:13.899248 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1689e1-aace-4aa3-99ef-aa427f95d823 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:13.899522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1689e1-aace-4aa3-99ef-aa427f95d823 None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:13.900239 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1689e1-aace-4aa3-99ef-aa427f95d823 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:13.901621 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1689e1-aace-4aa3-99ef-aa427f95d823 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:13.914290 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 653/1295] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 12 09:24:13 2022] POST /identity/v3/services => generated 246 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:24:16.107946 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e9ca6-5dec-4407-8e77-4c00786c3137 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:16.108387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e9ca6-5dec-4407-8e77-4c00786c3137 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:16.108481 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e9ca6-5dec-4407-8e77-4c00786c3137 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:16.109830 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 643/1296] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:24:16.115694 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af587e93-cb30-47f6-b10f-1aec62ea68bf None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:16.116107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af587e93-cb30-47f6-b10f-1aec62ea68bf None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:16.116234 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af587e93-cb30-47f6-b10f-1aec62ea68bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:16.132458 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-af587e93-cb30-47f6-b10f-1aec62ea68bf None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:24:16.133610 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-af587e93-cb30-47f6-b10f-1aec62ea68bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:24:16.200022 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 654/1297] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:24:16 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:24:16.221960 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e9ca6-5dec-4407-8e77-4c00786c3137 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:16.315434 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e9ca6-5dec-4407-8e77-4c00786c3137 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:16.346372 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e4a5d-ef14-4b48-94c1-3e9af735543e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:16.347145 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e4a5d-ef14-4b48-94c1-3e9af735543e None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:16.347421 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e4a5d-ef14-4b48-94c1-3e9af735543e None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:16.347689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e4a5d-ef14-4b48-94c1-3e9af735543e None admin] PATH_INFO: `/v3/services/placement` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:16.348500 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e4a5d-ef14-4b48-94c1-3e9af735543e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:16.349932 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e4a5d-ef14-4b48-94c1-3e9af735543e None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:16.361165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-040e4a5d-ef14-4b48-94c1-3e9af735543e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 09:24:16.361165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:24:16.361165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 09:24:16.361165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 09:24:16.361165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 09:24:16.361165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 09:24:16.361165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 09:24:16.361165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:24:16.361165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 09:24:16.361165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:24:16.361165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 09:24:16.361165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:24:16.361165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:24:16.361165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:24:16.361165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:24:16.361165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:24:16.361165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:24:16.362469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:24:16.362469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:24:16.362469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:24:16.362469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:24:16.362469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:24:16.362469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:24:16.362469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 09:24:16.362469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 09:24:16.362469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 09:24:16.362469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 09:24:16.362469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:24:16.362469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:24:16.362469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:24:16.362469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:24:16.362469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:24:16.362469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:24:16.364027 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:24:16.364027 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:24:16.364027 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:24:16.364027 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:24:16.364027 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:24:16.364027 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:24:16.364027 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:24:16.364027 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:24:16.364027 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:24:16.364027 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:24:16.364027 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 09:24:16.364027 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:24:16.364027 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 09:24:16.364027 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:24:16.364027 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 644/1298] 10.222.0.60 () {56 vars in 1117 bytes} [Thu May 12 09:24:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:24:16.370206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af587e93-cb30-47f6-b10f-1aec62ea68bf None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:16.462354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af587e93-cb30-47f6-b10f-1aec62ea68bf None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:16.493816 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee8aea-3225-475c-bcd3-e0ed0d8f6b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:16.494492 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee8aea-3225-475c-bcd3-e0ed0d8f6b6c None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:16.494768 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee8aea-3225-475c-bcd3-e0ed0d8f6b6c None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:16.495037 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee8aea-3225-475c-bcd3-e0ed0d8f6b6c None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:16.495724 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee8aea-3225-475c-bcd3-e0ed0d8f6b6c None admin] RBAC: Adding query filter params (name=placement) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:24:16.496027 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee8aea-3225-475c-bcd3-e0ed0d8f6b6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:16.497444 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee8aea-3225-475c-bcd3-e0ed0d8f6b6c None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:16.502460 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 655/1299] 10.222.0.60 () {56 vars in 1116 bytes} [Thu May 12 09:24:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:24:16.508327 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e4a5d-ef14-4b48-94c1-3e9af735543e None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:16.601548 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e4a5d-ef14-4b48-94c1-3e9af735543e None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:16.632738 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd0dde-3b1a-455a-b1d6-a1d0aee0e245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:16.633372 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd0dde-3b1a-455a-b1d6-a1d0aee0e245 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:16.633650 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd0dde-3b1a-455a-b1d6-a1d0aee0e245 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:16.633943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd0dde-3b1a-455a-b1d6-a1d0aee0e245 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:16.634713 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd0dde-3b1a-455a-b1d6-a1d0aee0e245 None admin] RBAC: Adding query filter params (interface=public, service_id=25172b1b66664b4badb4f88f051901a1, region_id=RegionOne) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:24:16.635017 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd0dde-3b1a-455a-b1d6-a1d0aee0e245 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:16.636345 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd0dde-3b1a-455a-b1d6-a1d0aee0e245 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:16.641029 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 645/1300] 10.222.0.60 () {56 vars in 1251 bytes} [Thu May 12 09:24:16 2022] GET /identity/v3/endpoints?service_id=25172b1b66664b4badb4f88f051901a1&interface=public®ion_id=RegionOne => generated 194 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:24:16.646902 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee8aea-3225-475c-bcd3-e0ed0d8f6b6c None admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:16.741055 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee8aea-3225-475c-bcd3-e0ed0d8f6b6c None admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:16.773151 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1923bf2-9ae1-4cea-97fe-f7ea276a82e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:16.773787 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1923bf2-9ae1-4cea-97fe-f7ea276a82e4 None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:16.774102 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1923bf2-9ae1-4cea-97fe-f7ea276a82e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:16.774378 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1923bf2-9ae1-4cea-97fe-f7ea276a82e4 None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:16.775040 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1923bf2-9ae1-4cea-97fe-f7ea276a82e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:16.776393 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1923bf2-9ae1-4cea-97fe-f7ea276a82e4 None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:16.782779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 656/1301] 10.222.0.60 () {56 vars in 1087 bytes} [Thu May 12 09:24:16 2022] GET /identity/v3/services => generated 2191 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:24:18.949557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eacc3b-aa88-45b6-8d15-c20da410abf3 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:18.950142 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eacc3b-aa88-45b6-8d15-c20da410abf3 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:18.950142 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eacc3b-aa88-45b6-8d15-c20da410abf3 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:18.951474 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 646/1302] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:24:18.956537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c57414-8658-41a1-82aa-25f4352c0052 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:18.956934 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c57414-8658-41a1-82aa-25f4352c0052 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:18.957084 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c57414-8658-41a1-82aa-25f4352c0052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:18.973729 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-56c57414-8658-41a1-82aa-25f4352c0052 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:24:18.974921 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-56c57414-8658-41a1-82aa-25f4352c0052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:24:19.036732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 657/1303] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:24:18 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 09:24:19.059018 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eacc3b-aa88-45b6-8d15-c20da410abf3 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:19.154103 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eacc3b-aa88-45b6-8d15-c20da410abf3 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:19.186042 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a226114-6ac6-4fb1-b7ce-f75489b81bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:19.186826 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a226114-6ac6-4fb1-b7ce-f75489b81bf3 None admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:19.187106 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a226114-6ac6-4fb1-b7ce-f75489b81bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:19.187376 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a226114-6ac6-4fb1-b7ce-f75489b81bf3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:19.188012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a226114-6ac6-4fb1-b7ce-f75489b81bf3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:19.189357 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a226114-6ac6-4fb1-b7ce-f75489b81bf3 None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:19.200742 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application [None req-6a226114-6ac6-4fb1-b7ce-f75489b81bf3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 09:24:19.200742 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:24:19.200742 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 09:24:19.200742 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 09:24:19.200742 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 09:24:19.200742 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 09:24:19.200742 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 09:24:19.200742 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:24:19.200742 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 09:24:19.200742 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:24:19.200742 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 09:24:19.200742 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:24:19.200742 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 09:24:19.200742 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 09:24:19.200742 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 09:24:19.200742 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 09:24:19.200742 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 09:24:19.201936 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 09:24:19.201936 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 09:24:19.201936 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 09:24:19.201936 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 09:24:19.201936 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 09:24:19.201936 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 09:24:19.201936 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 09:24:19.201936 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 09:24:19.201936 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 09:24:19.201936 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 09:24:19.201936 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 09:24:19.201936 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 09:24:19.201936 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 09:24:19.201936 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 09:24:19.201936 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 09:24:19.201936 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.get_or_create( May 12 09:24:19.203015 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 09:24:19.203015 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application with Lock( May 12 09:24:19.203015 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 09:24:19.203015 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self._enter() May 12 09:24:19.203015 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 09:24:19.203015 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 09:24:19.203015 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 09:24:19.203015 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application return self.creator() May 12 09:24:19.203015 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 09:24:19.203015 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application created_value = creator( May 12 09:24:19.203015 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 09:24:19.203015 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 09:24:19.203015 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 09:24:19.203015 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: ERROR keystone.server.flask.application May 12 09:24:19.203015 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 647/1304] 10.222.0.60 () {56 vars in 1117 bytes} [Thu May 12 09:24:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 09:24:19.208583 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c57414-8658-41a1-82aa-25f4352c0052 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:19.301853 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c57414-8658-41a1-82aa-25f4352c0052 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:19.334732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e114c-166e-4dbc-b8ce-b6d45e18141e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:19.335374 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e114c-166e-4dbc-b8ce-b6d45e18141e None admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:19.335657 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e114c-166e-4dbc-b8ce-b6d45e18141e None admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:19.335931 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e114c-166e-4dbc-b8ce-b6d45e18141e None admin] PATH_INFO: `/v3/services` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:19.336623 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e114c-166e-4dbc-b8ce-b6d45e18141e None admin] RBAC: Adding query filter params (name=placement) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:24:19.336928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e114c-166e-4dbc-b8ce-b6d45e18141e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:19.338336 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e114c-166e-4dbc-b8ce-b6d45e18141e None admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:19.343246 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 658/1305] 10.222.0.60 () {56 vars in 1116 bytes} [Thu May 12 09:24:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:24:19.349432 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a226114-6ac6-4fb1-b7ce-f75489b81bf3 None admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:24:19.447169 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a226114-6ac6-4fb1-b7ce-f75489b81bf3 None admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:24:19.482937 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76d8ec-d64f-4154-9193-3d05ebc73f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:24:19.483588 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76d8ec-d64f-4154-9193-3d05ebc73f8a None admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:24:19.483868 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76d8ec-d64f-4154-9193-3d05ebc73f8a None admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:24:19.484139 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76d8ec-d64f-4154-9193-3d05ebc73f8a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:24:19.484872 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76d8ec-d64f-4154-9193-3d05ebc73f8a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:24:19.486245 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76d8ec-d64f-4154-9193-3d05ebc73f8a None admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:24:19.503500 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 648/1306] 10.222.0.60 () {60 vars in 1144 bytes} [Thu May 12 09:24:19 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:25:22.399457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999a2f5-45e9-44bb-8495-d8555d8d27b0 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:22.400494 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999a2f5-45e9-44bb-8495-d8555d8d27b0 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:22.400995 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999a2f5-45e9-44bb-8495-d8555d8d27b0 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:22.406612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 659/1307] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:25:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:25:22.407846 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c5096-7517-446d-a369-87096562221d None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:22.408291 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c5096-7517-446d-a369-87096562221d None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:22.408501 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c5096-7517-446d-a369-87096562221d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:22.532634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-ac3c5096-7517-446d-a369-87096562221d None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:25:22.534830 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-ac3c5096-7517-446d-a369-87096562221d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:22.695322 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 649/1308] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:25:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:25:22.770950 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4ba5a-888e-4b44-a8d6-6bb8936761dd None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:22.771470 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4ba5a-888e-4b44-a8d6-6bb8936761dd None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:22.771969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4ba5a-888e-4b44-a8d6-6bb8936761dd None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:22.773528 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 660/1309] 10.222.0.60 () {54 vars in 964 bytes} [Thu May 12 09:25:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:25:22.781077 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c129d-3e17-4c99-bd30-ceef4f949fb6 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:22.781365 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c129d-3e17-4c99-bd30-ceef4f949fb6 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:22.781636 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c129d-3e17-4c99-bd30-ceef4f949fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:22.942360 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-bc3c129d-3e17-4c99-bd30-ceef4f949fb6 None None] MFA Rules not processed for user `bf7b793f84bd4a72a68d5ab65221e1a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:25:22.943785 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-bc3c129d-3e17-4c99-bd30-ceef4f949fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:23.061815 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 650/1310] 10.222.0.60 () {58 vars in 1061 bytes} [Thu May 12 09:25:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:25:23.070118 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4ba5a-888e-4b44-a8d6-6bb8936761dd None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:25:23.072233 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-aab4ba5a-888e-4b44-a8d6-6bb8936761dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:23.182691 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4ba5a-888e-4b44-a8d6-6bb8936761dd None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:25:23.256638 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86880b90-8015-4752-9116-4652c22ca6da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:25:23.257693 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86880b90-8015-4752-9116-4652c22ca6da service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:23.258224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86880b90-8015-4752-9116-4652c22ca6da service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:23.258714 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86880b90-8015-4752-9116-4652c22ca6da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:23.260549 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-86880b90-8015-4752-9116-4652c22ca6da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:23.370662 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86880b90-8015-4752-9116-4652c22ca6da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:25:23.372519 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86880b90-8015-4752-9116-4652c22ca6da service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:25:23.391612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 661/1311] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:25:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:25:25.916607 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f27f61-33e8-4913-ba2f-f030610c0cf9 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:25.917115 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f27f61-33e8-4913-ba2f-f030610c0cf9 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:25.917206 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f27f61-33e8-4913-ba2f-f030610c0cf9 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:25.918564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 651/1312] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:25:25.924525 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ac7df-57b5-41c9-8e6c-0003f3bb2bd8 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:25.924983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ac7df-57b5-41c9-8e6c-0003f3bb2bd8 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:25.925217 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ac7df-57b5-41c9-8e6c-0003f3bb2bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:26.025673 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-af0ac7df-57b5-41c9-8e6c-0003f3bb2bd8 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:25:26.026921 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-af0ac7df-57b5-41c9-8e6c-0003f3bb2bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:26.123491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 662/1313] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:25:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:25:26.162158 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f27f61-33e8-4913-ba2f-f030610c0cf9 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:25:26.163696 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-62f27f61-33e8-4913-ba2f-f030610c0cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:26.268232 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f27f61-33e8-4913-ba2f-f030610c0cf9 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:25:26.339903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f351624-8291-40c6-913c-58ad332c06b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:25:26.340478 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f351624-8291-40c6-913c-58ad332c06b2 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:26.340754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f351624-8291-40c6-913c-58ad332c06b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:26.341023 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f351624-8291-40c6-913c-58ad332c06b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:26.343776 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-8f351624-8291-40c6-913c-58ad332c06b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:26.446875 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f351624-8291-40c6-913c-58ad332c06b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:25:26.448215 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f351624-8291-40c6-913c-58ad332c06b2 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:25:26.466531 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 652/1314] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:25:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:25:29.089607 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cad64a-1994-4b63-a575-41299ec09a59 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:29.090266 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cad64a-1994-4b63-a575-41299ec09a59 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:29.090266 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cad64a-1994-4b63-a575-41299ec09a59 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:29.091548 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 663/1315] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:25:29.097857 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fef977-c9a4-4445-ac1f-060df7fc304c None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:29.098353 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fef977-c9a4-4445-ac1f-060df7fc304c None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:29.098462 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fef977-c9a4-4445-ac1f-060df7fc304c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:29.159898 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-92fef977-c9a4-4445-ac1f-060df7fc304c None None] MFA Rules not processed for user `6b240d8064a348a686e6f1ef20babb14`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:25:29.161100 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-92fef977-c9a4-4445-ac1f-060df7fc304c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:29.249638 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 653/1316] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:25:29 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:25:29.289111 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cad64a-1994-4b63-a575-41299ec09a59 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:25:29.290725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-d5cad64a-1994-4b63-a575-41299ec09a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:29.388894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cad64a-1994-4b63-a575-41299ec09a59 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:25:29.458939 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b991d1b-454e-4bc3-9280-69e5bc645e36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:25:29.459570 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b991d1b-454e-4bc3-9280-69e5bc645e36 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:29.459847 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b991d1b-454e-4bc3-9280-69e5bc645e36 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:29.460116 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b991d1b-454e-4bc3-9280-69e5bc645e36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:29.461707 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-1b991d1b-454e-4bc3-9280-69e5bc645e36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:29.562404 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b991d1b-454e-4bc3-9280-69e5bc645e36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:25:29.563833 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b991d1b-454e-4bc3-9280-69e5bc645e36 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:25:29.582811 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 664/1317] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:25:29 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:25:32.332608 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58202e1-03ec-4d80-a649-dd3dea9bf76e None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:32.333171 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58202e1-03ec-4d80-a649-dd3dea9bf76e None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:32.333171 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58202e1-03ec-4d80-a649-dd3dea9bf76e None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:32.334549 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 654/1318] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:25:32.339781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049fa54-7f88-4dd8-8424-8126331f0c02 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:32.340233 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049fa54-7f88-4dd8-8424-8126331f0c02 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:32.340357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049fa54-7f88-4dd8-8424-8126331f0c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:32.404714 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-8049fa54-7f88-4dd8-8424-8126331f0c02 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:25:32.406725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-8049fa54-7f88-4dd8-8424-8126331f0c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:32.501476 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 665/1319] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:25:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:25:32.540655 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58202e1-03ec-4d80-a649-dd3dea9bf76e None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:25:32.542245 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-d58202e1-03ec-4d80-a649-dd3dea9bf76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:32.639922 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58202e1-03ec-4d80-a649-dd3dea9bf76e None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:25:32.712434 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a27cb-1c54-4071-938f-ff389a39682b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:25:32.713077 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a27cb-1c54-4071-938f-ff389a39682b service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:32.713358 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a27cb-1c54-4071-938f-ff389a39682b service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:32.713696 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a27cb-1c54-4071-938f-ff389a39682b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:32.715362 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-4c8a27cb-1c54-4071-938f-ff389a39682b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:32.819380 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a27cb-1c54-4071-938f-ff389a39682b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:25:32.820803 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a27cb-1c54-4071-938f-ff389a39682b service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:25:32.838313 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 655/1320] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:25:32 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:25:35.671791 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964caa41-a644-4d73-a5c7-a4ecce63fc71 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:35.672393 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964caa41-a644-4d73-a5c7-a4ecce63fc71 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:35.672393 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964caa41-a644-4d73-a5c7-a4ecce63fc71 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:35.674221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 666/1321] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:25:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:25:35.679358 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbb2a5-4e64-4381-b314-6939a34bbada None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:35.679823 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbb2a5-4e64-4381-b314-6939a34bbada None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:35.680031 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbb2a5-4e64-4381-b314-6939a34bbada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:35.741020 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-1ebbb2a5-4e64-4381-b314-6939a34bbada None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:25:35.742241 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-1ebbb2a5-4e64-4381-b314-6939a34bbada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:35.832426 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 656/1322] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:25:35.867345 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964caa41-a644-4d73-a5c7-a4ecce63fc71 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:25:35.868858 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-964caa41-a644-4d73-a5c7-a4ecce63fc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:35.969270 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964caa41-a644-4d73-a5c7-a4ecce63fc71 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:25:36.040371 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e9f60-42a7-43a7-8678-92d371712838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:25:36.041014 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e9f60-42a7-43a7-8678-92d371712838 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:36.041295 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e9f60-42a7-43a7-8678-92d371712838 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:36.041571 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e9f60-42a7-43a7-8678-92d371712838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:36.043250 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-358e9f60-42a7-43a7-8678-92d371712838 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:36.151013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e9f60-42a7-43a7-8678-92d371712838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:25:36.152444 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e9f60-42a7-43a7-8678-92d371712838 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:25:36.170233 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 667/1323] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:25:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:25:38.460456 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc0cf1-36a5-4794-bafc-4544e8ee192c None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:38.460995 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc0cf1-36a5-4794-bafc-4544e8ee192c None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:38.461259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc0cf1-36a5-4794-bafc-4544e8ee192c None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:38.463334 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 657/1324] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:25:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:25:38.469426 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c11877-9070-4010-b73b-b845b59ac4e3 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:38.470513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c11877-9070-4010-b73b-b845b59ac4e3 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:38.470610 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c11877-9070-4010-b73b-b845b59ac4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:38.533765 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-50c11877-9070-4010-b73b-b845b59ac4e3 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:25:38.534991 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-50c11877-9070-4010-b73b-b845b59ac4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:38.628221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 668/1325] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:25:38.663626 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc0cf1-36a5-4794-bafc-4544e8ee192c None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:25:38.665225 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-27dc0cf1-36a5-4794-bafc-4544e8ee192c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:38.763875 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc0cf1-36a5-4794-bafc-4544e8ee192c None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:25:38.832752 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5105bc-da6f-4a5f-a6df-81cecb82818a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:25:38.833391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5105bc-da6f-4a5f-a6df-81cecb82818a service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:38.833669 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5105bc-da6f-4a5f-a6df-81cecb82818a service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:38.833966 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5105bc-da6f-4a5f-a6df-81cecb82818a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:38.835562 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-5a5105bc-da6f-4a5f-a6df-81cecb82818a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:38.937566 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5105bc-da6f-4a5f-a6df-81cecb82818a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:25:38.939042 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5105bc-da6f-4a5f-a6df-81cecb82818a service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:25:38.958138 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 658/1326] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:25:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:25:41.200618 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93255b68-c2a8-49a4-9ea0-37478412beb4 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:41.201159 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93255b68-c2a8-49a4-9ea0-37478412beb4 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:41.201159 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93255b68-c2a8-49a4-9ea0-37478412beb4 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:41.202528 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 669/1327] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:25:41.208152 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96f45a-4821-4847-913d-70f1c1e81a2c None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:41.208579 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96f45a-4821-4847-913d-70f1c1e81a2c None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:41.208764 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96f45a-4821-4847-913d-70f1c1e81a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:41.269717 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-0c96f45a-4821-4847-913d-70f1c1e81a2c None None] MFA Rules not processed for user `6b240d8064a348a686e6f1ef20babb14`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:25:41.270928 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-0c96f45a-4821-4847-913d-70f1c1e81a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:41.361654 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 659/1328] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:25:41 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:25:41.398627 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93255b68-c2a8-49a4-9ea0-37478412beb4 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:25:41.400146 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-93255b68-c2a8-49a4-9ea0-37478412beb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:41.497823 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93255b68-c2a8-49a4-9ea0-37478412beb4 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:25:41.572038 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b167e5-60af-4b95-ad2f-83586a602719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:25:41.572682 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b167e5-60af-4b95-ad2f-83586a602719 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:41.572959 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b167e5-60af-4b95-ad2f-83586a602719 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:41.573229 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b167e5-60af-4b95-ad2f-83586a602719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:41.574875 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-89b167e5-60af-4b95-ad2f-83586a602719 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:41.679995 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b167e5-60af-4b95-ad2f-83586a602719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:25:41.681355 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b167e5-60af-4b95-ad2f-83586a602719 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:25:41.699380 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 670/1329] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:25:41 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:25:44.171508 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad682b-60cc-4e32-a540-fcaf3dbe5a1b None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:44.171970 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad682b-60cc-4e32-a540-fcaf3dbe5a1b None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:44.172067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad682b-60cc-4e32-a540-fcaf3dbe5a1b None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:44.173850 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 660/1330] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:25:44.187769 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368a28e-64d3-4777-a051-ccc078303686 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:44.187769 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368a28e-64d3-4777-a051-ccc078303686 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:44.187769 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368a28e-64d3-4777-a051-ccc078303686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:44.261645 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-c368a28e-64d3-4777-a051-ccc078303686 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:25:44.262961 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-c368a28e-64d3-4777-a051-ccc078303686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:44.358434 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 671/1331] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:25:44.396077 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad682b-60cc-4e32-a540-fcaf3dbe5a1b None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:25:44.397591 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-baad682b-60cc-4e32-a540-fcaf3dbe5a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:44.497095 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad682b-60cc-4e32-a540-fcaf3dbe5a1b None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:25:44.572128 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85babc18-bc42-4ace-8bf3-012b6fad565e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:25:44.572782 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85babc18-bc42-4ace-8bf3-012b6fad565e service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:44.573060 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85babc18-bc42-4ace-8bf3-012b6fad565e service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:44.573331 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85babc18-bc42-4ace-8bf3-012b6fad565e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:44.575005 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-85babc18-bc42-4ace-8bf3-012b6fad565e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:44.684779 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85babc18-bc42-4ace-8bf3-012b6fad565e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:25:44.686284 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85babc18-bc42-4ace-8bf3-012b6fad565e service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:25:44.705643 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 661/1332] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:25:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:25:46.979825 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f9393-5f9e-4a1e-a353-d2e2a6e0704c None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:46.980367 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f9393-5f9e-4a1e-a353-d2e2a6e0704c None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:46.980367 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f9393-5f9e-4a1e-a353-d2e2a6e0704c None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:46.981696 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 672/1333] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:25:46.987334 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4364e5-cce2-44ec-9f60-71631b9bb339 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:46.987769 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4364e5-cce2-44ec-9f60-71631b9bb339 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:46.987919 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4364e5-cce2-44ec-9f60-71631b9bb339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:47.056936 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-cd4364e5-cce2-44ec-9f60-71631b9bb339 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:25:47.058159 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-cd4364e5-cce2-44ec-9f60-71631b9bb339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:47.149746 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 662/1334] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:25:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:25:47.202443 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b72aa-e91c-43ec-8802-78e21eb67fb2 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:47.202729 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b72aa-e91c-43ec-8802-78e21eb67fb2 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:47.203007 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b72aa-e91c-43ec-8802-78e21eb67fb2 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:47.204355 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 673/1335] 10.222.0.60 () {54 vars in 964 bytes} [Thu May 12 09:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:25:47.209958 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde4614-0fb0-4651-acda-b01f41a2261d None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:47.210247 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde4614-0fb0-4651-acda-b01f41a2261d None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:47.210522 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde4614-0fb0-4651-acda-b01f41a2261d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:47.281002 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-3cde4614-0fb0-4651-acda-b01f41a2261d None None] MFA Rules not processed for user `bf7b793f84bd4a72a68d5ab65221e1a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:25:47.282656 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-3cde4614-0fb0-4651-acda-b01f41a2261d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:47.353916 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 663/1336] 10.222.0.60 () {58 vars in 1061 bytes} [Thu May 12 09:25:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:25:47.363643 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b72aa-e91c-43ec-8802-78e21eb67fb2 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:25:47.365208 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-307b72aa-e91c-43ec-8802-78e21eb67fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:47.462543 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b72aa-e91c-43ec-8802-78e21eb67fb2 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:25:47.531377 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbffa6-6274-44cf-a06d-b3f8fec5ec51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:25:47.531935 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbffa6-6274-44cf-a06d-b3f8fec5ec51 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:47.532737 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbffa6-6274-44cf-a06d-b3f8fec5ec51 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:47.533007 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbffa6-6274-44cf-a06d-b3f8fec5ec51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:47.534655 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-93fbffa6-6274-44cf-a06d-b3f8fec5ec51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:47.637754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbffa6-6274-44cf-a06d-b3f8fec5ec51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:25:47.639203 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbffa6-6274-44cf-a06d-b3f8fec5ec51 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:25:47.656586 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 674/1337] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:25:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:25:50.690146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2af07-1109-48a8-be7c-26871e5634fd None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:50.690595 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2af07-1109-48a8-be7c-26871e5634fd None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:50.690727 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2af07-1109-48a8-be7c-26871e5634fd None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:50.692105 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 664/1338] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:25:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:25:50.697142 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40330a2-412d-44de-824d-c7e497f16f95 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:50.697575 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40330a2-412d-44de-824d-c7e497f16f95 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:50.697672 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40330a2-412d-44de-824d-c7e497f16f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:50.759102 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-e40330a2-412d-44de-824d-c7e497f16f95 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:25:50.760281 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-e40330a2-412d-44de-824d-c7e497f16f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:50.850499 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 675/1339] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:25:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:25:50.886583 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2af07-1109-48a8-be7c-26871e5634fd None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:25:50.888102 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-bfa2af07-1109-48a8-be7c-26871e5634fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:50.985995 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2af07-1109-48a8-be7c-26871e5634fd None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:25:51.055381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e56837-ccb9-43d3-9fef-638e79b7a3b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:25:51.056020 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e56837-ccb9-43d3-9fef-638e79b7a3b1 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:51.056302 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e56837-ccb9-43d3-9fef-638e79b7a3b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:51.056580 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e56837-ccb9-43d3-9fef-638e79b7a3b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:51.058249 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-f2e56837-ccb9-43d3-9fef-638e79b7a3b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:51.162158 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e56837-ccb9-43d3-9fef-638e79b7a3b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:25:51.163611 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e56837-ccb9-43d3-9fef-638e79b7a3b1 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:25:51.181799 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 665/1340] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:25:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:25:55.505782 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a19a4-449d-4719-aa62-e0f1f1c4c12e None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:55.506339 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a19a4-449d-4719-aa62-e0f1f1c4c12e None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:55.506339 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a19a4-449d-4719-aa62-e0f1f1c4c12e None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:55.507708 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 676/1341] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:25:55.513001 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee0062-bc22-448d-9151-a60b81cbc6bb None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:55.513445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee0062-bc22-448d-9151-a60b81cbc6bb None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:55.513593 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee0062-bc22-448d-9151-a60b81cbc6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:55.581178 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-afee0062-bc22-448d-9151-a60b81cbc6bb None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:25:55.582311 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-afee0062-bc22-448d-9151-a60b81cbc6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:55.683784 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 666/1342] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:25:55.721728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a19a4-449d-4719-aa62-e0f1f1c4c12e None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:25:55.723931 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-cc9a19a4-449d-4719-aa62-e0f1f1c4c12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:55.816296 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a19a4-449d-4719-aa62-e0f1f1c4c12e None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:25:55.819756 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7b310-2bcc-43da-bff2-51d2eb5b7141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:25:55.820388 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7b310-2bcc-43da-bff2-51d2eb5b7141 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:55.820663 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7b310-2bcc-43da-bff2-51d2eb5b7141 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:55.820931 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7b310-2bcc-43da-bff2-51d2eb5b7141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:55.830272 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7b310-2bcc-43da-bff2-51d2eb5b7141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:25:55.831682 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7b310-2bcc-43da-bff2-51d2eb5b7141 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:25:55.840977 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 677/1343] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:25:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:25:58.646640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede482d3-bd71-4dee-999c-0c84660e67d6 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:58.647163 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede482d3-bd71-4dee-999c-0c84660e67d6 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:58.647163 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede482d3-bd71-4dee-999c-0c84660e67d6 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:58.648757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 667/1344] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:25:58.654296 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97978a48-72ce-4ec5-8cc5-0fd3faf9d40f None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:58.654860 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97978a48-72ce-4ec5-8cc5-0fd3faf9d40f None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:58.654860 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97978a48-72ce-4ec5-8cc5-0fd3faf9d40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:58.684137 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-97978a48-72ce-4ec5-8cc5-0fd3faf9d40f None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:25:58.685335 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-97978a48-72ce-4ec5-8cc5-0fd3faf9d40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:25:58.771693 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 678/1345] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:25:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:25:58.808780 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede482d3-bd71-4dee-999c-0c84660e67d6 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:25:58.819422 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede482d3-bd71-4dee-999c-0c84660e67d6 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:25:58.823096 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb7dda4-e050-4e39-bdd8-b85da8b8b72a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:25:58.823736 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7dda4-e050-4e39-bdd8-b85da8b8b72a service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:25:58.824020 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7dda4-e050-4e39-bdd8-b85da8b8b72a service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:25:58.824302 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7dda4-e050-4e39-bdd8-b85da8b8b72a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:25:58.833161 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb7dda4-e050-4e39-bdd8-b85da8b8b72a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:25:58.834619 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb7dda4-e050-4e39-bdd8-b85da8b8b72a service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:25:58.843765 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 668/1346] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:25:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:26:03.132630 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0c84b-2b74-4386-b272-7522da69b533 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:03.133125 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0c84b-2b74-4386-b272-7522da69b533 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:03.133125 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0c84b-2b74-4386-b272-7522da69b533 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:03.134500 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 679/1347] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:26:03.139909 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329f4aa-da7a-43a4-9f28-c204df0d74ef None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:03.140367 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329f4aa-da7a-43a4-9f28-c204df0d74ef None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:03.140521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329f4aa-da7a-43a4-9f28-c204df0d74ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:03.160221 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-9329f4aa-da7a-43a4-9f28-c204df0d74ef None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:26:03.161400 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-9329f4aa-da7a-43a4-9f28-c204df0d74ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:26:03.169409 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 669/1348] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:26:03.206918 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0c84b-2b74-4386-b272-7522da69b533 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:26:03.217356 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0c84b-2b74-4386-b272-7522da69b533 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:26:03.220897 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207097a-3ad8-4772-9a6a-5219086bb496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:26:03.221528 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207097a-3ad8-4772-9a6a-5219086bb496 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:03.221811 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207097a-3ad8-4772-9a6a-5219086bb496 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:03.222125 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207097a-3ad8-4772-9a6a-5219086bb496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:03.230798 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9207097a-3ad8-4772-9a6a-5219086bb496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:26:03.232229 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9207097a-3ad8-4772-9a6a-5219086bb496 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:26:03.241648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 680/1349] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:26:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:26:08.513527 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8584b-0488-4d3c-a523-5dd57c922a4d None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:08.514536 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8584b-0488-4d3c-a523-5dd57c922a4d None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:08.515033 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8584b-0488-4d3c-a523-5dd57c922a4d None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:08.517148 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 670/1350] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 12 09:26:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:26:08.522564 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dc83a-0073-4bf8-bc20-c12d7906c5be None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:08.523000 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dc83a-0073-4bf8-bc20-c12d7906c5be None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:08.523097 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dc83a-0073-4bf8-bc20-c12d7906c5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:08.598802 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-2f2dc83a-0073-4bf8-bc20-c12d7906c5be None None] MFA Rules not processed for user `525f4699878f461e82f7f06ef60c176a`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:26:08.600341 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-2f2dc83a-0073-4bf8-bc20-c12d7906c5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:26:08.684222 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 681/1351] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 12 09:26:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:26:13.008744 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e7b1c-ff57-4f82-af3d-cfaa8b3b10f6 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:13.009283 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e7b1c-ff57-4f82-af3d-cfaa8b3b10f6 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:13.009283 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e7b1c-ff57-4f82-af3d-cfaa8b3b10f6 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:13.010865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 671/1352] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 12 09:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:26:13.016139 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1d7c2-116d-4d42-9a6b-216a176f5d69 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:13.016600 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1d7c2-116d-4d42-9a6b-216a176f5d69 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:13.016926 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1d7c2-116d-4d42-9a6b-216a176f5d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:13.036712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-97e1d7c2-116d-4d42-9a6b-216a176f5d69 None None] MFA Rules not processed for user `525f4699878f461e82f7f06ef60c176a`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:26:13.037929 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-97e1d7c2-116d-4d42-9a6b-216a176f5d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:26:13.046798 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 682/1353] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 12 09:26:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:26:14.685662 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c074848-948a-461c-9315-33dacbff6bea None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:14.686250 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c074848-948a-461c-9315-33dacbff6bea None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:14.686250 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c074848-948a-461c-9315-33dacbff6bea None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:14.688198 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 672/1354] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 12 09:26:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:26:14.693467 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f359cdb-4017-4532-b018-51d8da69599a None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:14.693873 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f359cdb-4017-4532-b018-51d8da69599a None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:14.694057 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f359cdb-4017-4532-b018-51d8da69599a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:14.711589 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-7f359cdb-4017-4532-b018-51d8da69599a None None] MFA Rules not processed for user `525f4699878f461e82f7f06ef60c176a`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:26:14.712756 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-7f359cdb-4017-4532-b018-51d8da69599a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:26:14.721768 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 683/1355] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 12 09:26:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:26:18.544888 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184c5e5-e21b-4b9c-be4b-2ec4e2df3dd6 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:18.545466 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184c5e5-e21b-4b9c-be4b-2ec4e2df3dd6 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:18.545466 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184c5e5-e21b-4b9c-be4b-2ec4e2df3dd6 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:18.547555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 673/1356] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:26:18.552509 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4dbe7-96ba-41bf-9662-238c54203d3e None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:18.552937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4dbe7-96ba-41bf-9662-238c54203d3e None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:18.553034 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4dbe7-96ba-41bf-9662-238c54203d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:18.570524 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-24a4dbe7-96ba-41bf-9662-238c54203d3e None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:26:18.571684 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-24a4dbe7-96ba-41bf-9662-238c54203d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:26:18.594436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 684/1357] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:26:18.630283 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258acfc-baef-405b-ac2e-09736a6c85a3 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:18.630572 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258acfc-baef-405b-ac2e-09736a6c85a3 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:18.630846 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258acfc-baef-405b-ac2e-09736a6c85a3 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:18.632238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 674/1358] 10.222.0.60 () {54 vars in 961 bytes} [Thu May 12 09:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:26:18.639392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ecc53-8a22-4878-a015-3a38b33dde7b None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:18.639392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ecc53-8a22-4878-a015-3a38b33dde7b None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:18.639392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ecc53-8a22-4878-a015-3a38b33dde7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:18.691929 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-0d1ecc53-8a22-4878-a015-3a38b33dde7b None None] MFA Rules not processed for user `2915babd40aa42e8bf7cc85c5a97daa6`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:26:18.693220 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-0d1ecc53-8a22-4878-a015-3a38b33dde7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:26:18.774122 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 685/1359] 10.222.0.60 () {58 vars in 1058 bytes} [Thu May 12 09:26:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:26:18.782434 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258acfc-baef-405b-ac2e-09736a6c85a3 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:26:18.800327 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258acfc-baef-405b-ac2e-09736a6c85a3 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:26:18.807131 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f42a1c-fd86-45a9-834d-e1fd42c7c5a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:26:18.807850 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f42a1c-fd86-45a9-834d-e1fd42c7c5a6 service nova] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:18.808201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f42a1c-fd86-45a9-834d-e1fd42c7c5a6 service nova] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:18.808542 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f42a1c-fd86-45a9-834d-e1fd42c7c5a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:18.817617 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f42a1c-fd86-45a9-834d-e1fd42c7c5a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:26:18.819309 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f42a1c-fd86-45a9-834d-e1fd42c7c5a6 service nova] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:26:18.828714 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 675/1360] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:26:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:26:21.292328 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a8182-3d85-4f9c-b0ef-f54554a7b2c6 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:21.292844 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a8182-3d85-4f9c-b0ef-f54554a7b2c6 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:21.292844 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a8182-3d85-4f9c-b0ef-f54554a7b2c6 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:21.294337 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 686/1361] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:26:21.300054 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf10320-7eae-4731-bd7b-072b81e42d3b None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:21.300527 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf10320-7eae-4731-bd7b-072b81e42d3b None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:21.300876 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf10320-7eae-4731-bd7b-072b81e42d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:21.319323 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-5bf10320-7eae-4731-bd7b-072b81e42d3b None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:26:21.320634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-5bf10320-7eae-4731-bd7b-072b81e42d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:26:21.328637 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 676/1362] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:26:21.371439 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a8182-3d85-4f9c-b0ef-f54554a7b2c6 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:26:21.387211 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a8182-3d85-4f9c-b0ef-f54554a7b2c6 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:26:21.392825 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d7258-99de-4c6c-aa0f-9c1afdae5d65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:26:21.393627 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d7258-99de-4c6c-aa0f-9c1afdae5d65 service nova] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:21.394041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d7258-99de-4c6c-aa0f-9c1afdae5d65 service nova] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:21.394420 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d7258-99de-4c6c-aa0f-9c1afdae5d65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:21.403192 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d7258-99de-4c6c-aa0f-9c1afdae5d65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:26:21.404922 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d7258-99de-4c6c-aa0f-9c1afdae5d65 service nova] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:26:21.419142 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 687/1363] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:26:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:26:23.960279 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce66dff-7048-4e4f-b37e-0d695471a3b3 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:23.960848 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce66dff-7048-4e4f-b37e-0d695471a3b3 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:23.960848 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce66dff-7048-4e4f-b37e-0d695471a3b3 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:23.962471 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 677/1364] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:26:23.967880 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a879a48-4bef-4001-a156-e2a28f9658fd None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:23.968879 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a879a48-4bef-4001-a156-e2a28f9658fd None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:23.969009 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a879a48-4bef-4001-a156-e2a28f9658fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:23.987025 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-3a879a48-4bef-4001-a156-e2a28f9658fd None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:26:23.988195 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-3a879a48-4bef-4001-a156-e2a28f9658fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:26:23.996348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 688/1365] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:26:24.043701 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997fbfd-411e-46b2-b35a-d110c406121c None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:24.044192 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997fbfd-411e-46b2-b35a-d110c406121c None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:24.044609 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997fbfd-411e-46b2-b35a-d110c406121c None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:24.047350 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 678/1366] 10.222.0.60 () {54 vars in 961 bytes} [Thu May 12 09:26:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:26:24.053311 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcb3a0-8e2f-43b6-914b-6c7edd30d579 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:24.053781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcb3a0-8e2f-43b6-914b-6c7edd30d579 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:24.054259 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcb3a0-8e2f-43b6-914b-6c7edd30d579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:24.075031 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-81fcb3a0-8e2f-43b6-914b-6c7edd30d579 None None] MFA Rules not processed for user `2915babd40aa42e8bf7cc85c5a97daa6`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:26:24.076228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-81fcb3a0-8e2f-43b6-914b-6c7edd30d579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:26:24.086699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 689/1367] 10.222.0.60 () {58 vars in 1058 bytes} [Thu May 12 09:26:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:26:24.101829 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997fbfd-411e-46b2-b35a-d110c406121c None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:26:24.116186 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997fbfd-411e-46b2-b35a-d110c406121c None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:26:24.121606 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bf636-36c3-4482-adc0-f338affebc68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:26:24.122289 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bf636-36c3-4482-adc0-f338affebc68 service nova] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:24.122577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bf636-36c3-4482-adc0-f338affebc68 service nova] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:24.122852 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bf636-36c3-4482-adc0-f338affebc68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:24.131114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212bf636-36c3-4482-adc0-f338affebc68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:26:24.132683 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212bf636-36c3-4482-adc0-f338affebc68 service nova] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:26:24.142671 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 679/1368] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:26:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:26:26.432978 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb27c9-a96d-4e24-8c50-1a318d7b1f12 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:26.433524 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb27c9-a96d-4e24-8c50-1a318d7b1f12 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:26.433524 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb27c9-a96d-4e24-8c50-1a318d7b1f12 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:26.434892 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 690/1369] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:26:26.441215 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed3539-33de-40f8-ae0a-ccf822ca3515 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:26.441655 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed3539-33de-40f8-ae0a-ccf822ca3515 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:26.441880 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed3539-33de-40f8-ae0a-ccf822ca3515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:26.459714 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-85ed3539-33de-40f8-ae0a-ccf822ca3515 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:26:26.461020 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-85ed3539-33de-40f8-ae0a-ccf822ca3515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:26:26.469342 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 680/1370] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:26:26.513235 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb27c9-a96d-4e24-8c50-1a318d7b1f12 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:26:26.527424 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb27c9-a96d-4e24-8c50-1a318d7b1f12 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:26:26.532907 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c544bde-417e-4a1b-9f9f-20cd9a3fe085 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:26:26.533655 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c544bde-417e-4a1b-9f9f-20cd9a3fe085 service nova] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:26.534072 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c544bde-417e-4a1b-9f9f-20cd9a3fe085 service nova] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:26.534443 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c544bde-417e-4a1b-9f9f-20cd9a3fe085 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:26.542733 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c544bde-417e-4a1b-9f9f-20cd9a3fe085 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:26:26.544433 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c544bde-417e-4a1b-9f9f-20cd9a3fe085 service nova] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:26:26.554613 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 691/1371] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:26:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:26:26.766972 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af975a24-a98c-422c-aa7f-628dcca9cef6 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:26.767265 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af975a24-a98c-422c-aa7f-628dcca9cef6 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:26.767542 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af975a24-a98c-422c-aa7f-628dcca9cef6 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:26.768941 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 681/1372] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:26:26.775068 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe30cb2-32ba-4dea-b15b-5894d57228d0 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:26.775355 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe30cb2-32ba-4dea-b15b-5894d57228d0 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:26.775631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe30cb2-32ba-4dea-b15b-5894d57228d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:26.794986 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-afe30cb2-32ba-4dea-b15b-5894d57228d0 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:26:26.796778 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-afe30cb2-32ba-4dea-b15b-5894d57228d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:26:26.805354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 692/1373] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:26:27.133927 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f951641-4a86-4dc3-8c99-b6f958caf160 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:27.134199 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f951641-4a86-4dc3-8c99-b6f958caf160 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:27.134790 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f951641-4a86-4dc3-8c99-b6f958caf160 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:27.136155 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 682/1374] 10.222.0.60 () {54 vars in 963 bytes} [Thu May 12 09:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:26:27.141476 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa66da4-5fdd-4192-9f04-699ae0659099 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:27.141766 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa66da4-5fdd-4192-9f04-699ae0659099 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:27.142099 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa66da4-5fdd-4192-9f04-699ae0659099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:27.192936 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-7fa66da4-5fdd-4192-9f04-699ae0659099 None None] MFA Rules not processed for user `2e97d11fab3b4bb092f9623da4e40eb0`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:26:27.194406 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-7fa66da4-5fdd-4192-9f04-699ae0659099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:26:27.255053 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 693/1375] 10.222.0.60 () {58 vars in 1060 bytes} [Thu May 12 09:26:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:26:27.262827 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f951641-4a86-4dc3-8c99-b6f958caf160 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:26:27.273618 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f951641-4a86-4dc3-8c99-b6f958caf160 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:26:27.277403 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13061d-f240-4d5c-a354-ff4979bacbda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:26:27.278187 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13061d-f240-4d5c-a354-ff4979bacbda service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:27.278576 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13061d-f240-4d5c-a354-ff4979bacbda service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:27.279598 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13061d-f240-4d5c-a354-ff4979bacbda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:27.290067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13061d-f240-4d5c-a354-ff4979bacbda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:26:27.291609 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13061d-f240-4d5c-a354-ff4979bacbda service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:26:27.301958 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 683/1376] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:26:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 09:26:28.839367 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3670f7-1176-4c57-b7f4-5da2d2bb92d4 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:28.839972 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3670f7-1176-4c57-b7f4-5da2d2bb92d4 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:28.839972 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3670f7-1176-4c57-b7f4-5da2d2bb92d4 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:28.841235 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 694/1377] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:26:28.846982 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc055580-a9f9-4adf-ad4f-a64452f5cd42 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:28.847511 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc055580-a9f9-4adf-ad4f-a64452f5cd42 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:28.847511 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc055580-a9f9-4adf-ad4f-a64452f5cd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:28.866763 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-cc055580-a9f9-4adf-ad4f-a64452f5cd42 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:26:28.867962 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-cc055580-a9f9-4adf-ad4f-a64452f5cd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:26:28.876551 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 684/1378] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:26:28.920218 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3670f7-1176-4c57-b7f4-5da2d2bb92d4 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:26:28.936164 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3670f7-1176-4c57-b7f4-5da2d2bb92d4 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:26:28.942328 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424db003-034a-4878-a3d2-b986eed0e240 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:26:28.943014 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424db003-034a-4878-a3d2-b986eed0e240 service nova] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:28.943292 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424db003-034a-4878-a3d2-b986eed0e240 service nova] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:28.943562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424db003-034a-4878-a3d2-b986eed0e240 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:28.952450 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424db003-034a-4878-a3d2-b986eed0e240 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:26:28.954102 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424db003-034a-4878-a3d2-b986eed0e240 service nova] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:26:28.964481 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 695/1379] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:26:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:26:31.330029 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae25ac-f2a5-4e52-b6d0-e11e2941c3b4 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:31.331239 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae25ac-f2a5-4e52-b6d0-e11e2941c3b4 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:31.331720 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae25ac-f2a5-4e52-b6d0-e11e2941c3b4 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:31.333864 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 685/1380] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:26:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:26:31.338898 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2290220-3bf5-4148-b92b-da19227b8a52 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:31.339369 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2290220-3bf5-4148-b92b-da19227b8a52 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:31.339647 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2290220-3bf5-4148-b92b-da19227b8a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:31.359285 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-b2290220-3bf5-4148-b92b-da19227b8a52 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:26:31.360856 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-b2290220-3bf5-4148-b92b-da19227b8a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:26:31.369051 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 696/1381] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:26:31.413344 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae25ac-f2a5-4e52-b6d0-e11e2941c3b4 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:26:31.429810 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae25ac-f2a5-4e52-b6d0-e11e2941c3b4 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:26:31.438163 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2ccc4-e6ac-4b4b-a3c9-bf0ac5218862 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:26:31.439017 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2ccc4-e6ac-4b4b-a3c9-bf0ac5218862 service nova] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:31.439461 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2ccc4-e6ac-4b4b-a3c9-bf0ac5218862 service nova] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:31.439903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2ccc4-e6ac-4b4b-a3c9-bf0ac5218862 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:31.450770 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b2ccc4-e6ac-4b4b-a3c9-bf0ac5218862 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:26:31.453630 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b2ccc4-e6ac-4b4b-a3c9-bf0ac5218862 service nova] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:26:31.466232 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 686/1382] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:26:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:26:33.726968 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9d968-f1a9-49ef-8310-8f3bb2119575 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:33.727625 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9d968-f1a9-49ef-8310-8f3bb2119575 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:33.727625 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9d968-f1a9-49ef-8310-8f3bb2119575 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:33.728985 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 697/1383] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:26:33.735259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3838c-6314-4d44-b71b-7a911a071b0b None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:33.735857 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3838c-6314-4d44-b71b-7a911a071b0b None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:33.735857 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3838c-6314-4d44-b71b-7a911a071b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:33.755651 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-95d3838c-6314-4d44-b71b-7a911a071b0b None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:26:33.756883 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-95d3838c-6314-4d44-b71b-7a911a071b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:26:33.765792 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 687/1384] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:26:33.806610 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9d968-f1a9-49ef-8310-8f3bb2119575 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:26:33.822060 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9d968-f1a9-49ef-8310-8f3bb2119575 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:26:33.827668 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354f7f4-df8e-4ebf-b69e-9b0582e53644 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:26:33.828413 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354f7f4-df8e-4ebf-b69e-9b0582e53644 service nova] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:33.828778 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354f7f4-df8e-4ebf-b69e-9b0582e53644 service nova] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:33.829123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354f7f4-df8e-4ebf-b69e-9b0582e53644 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:33.838077 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354f7f4-df8e-4ebf-b69e-9b0582e53644 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:26:33.839743 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354f7f4-df8e-4ebf-b69e-9b0582e53644 service nova] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:26:33.849542 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 698/1385] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:26:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:26:36.115159 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4be1a-b095-4247-ab40-579bb1550d7d None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:36.115698 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4be1a-b095-4247-ab40-579bb1550d7d None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:36.115824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4be1a-b095-4247-ab40-579bb1550d7d None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:36.117509 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 688/1386] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:26:36.122943 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359cf7c-8207-4412-92d4-c0289e3c511b None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:36.123392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359cf7c-8207-4412-92d4-c0289e3c511b None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:36.123724 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359cf7c-8207-4412-92d4-c0289e3c511b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:36.152192 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-8359cf7c-8207-4412-92d4-c0289e3c511b None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:26:36.154049 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-8359cf7c-8207-4412-92d4-c0289e3c511b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:26:36.166177 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 699/1387] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:26:36.216880 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4be1a-b095-4247-ab40-579bb1550d7d None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:26:36.231685 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4be1a-b095-4247-ab40-579bb1550d7d None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:26:36.237249 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32066520-a22a-4116-8fb1-f9520ace83f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:26:36.237912 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32066520-a22a-4116-8fb1-f9520ace83f3 service nova] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:36.238330 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32066520-a22a-4116-8fb1-f9520ace83f3 service nova] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:36.238606 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32066520-a22a-4116-8fb1-f9520ace83f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:36.247210 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32066520-a22a-4116-8fb1-f9520ace83f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:26:36.248789 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32066520-a22a-4116-8fb1-f9520ace83f3 service nova] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:26:36.258657 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 689/1388] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:26:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:26:39.191731 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6519e-27d4-4816-bf3e-db746ea7cb7b None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:39.192294 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6519e-27d4-4816-bf3e-db746ea7cb7b None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:39.192294 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6519e-27d4-4816-bf3e-db746ea7cb7b None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:39.193656 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 700/1389] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:26:39.199118 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63464ff6-78cf-4ffb-bd27-11f7cf06e276 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:39.199554 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63464ff6-78cf-4ffb-bd27-11f7cf06e276 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:39.199675 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63464ff6-78cf-4ffb-bd27-11f7cf06e276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:39.218007 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-63464ff6-78cf-4ffb-bd27-11f7cf06e276 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:26:39.219210 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-63464ff6-78cf-4ffb-bd27-11f7cf06e276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:26:39.230686 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 690/1390] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:26:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:26:39.278860 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6519e-27d4-4816-bf3e-db746ea7cb7b None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:26:39.293429 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6519e-27d4-4816-bf3e-db746ea7cb7b None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:26:39.299537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88823a-7ce8-479a-bf8f-c642b0855a4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:26:39.300178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88823a-7ce8-479a-bf8f-c642b0855a4f service nova] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:39.300487 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88823a-7ce8-479a-bf8f-c642b0855a4f service nova] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:39.300763 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88823a-7ce8-479a-bf8f-c642b0855a4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:39.309118 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88823a-7ce8-479a-bf8f-c642b0855a4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:26:39.310762 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88823a-7ce8-479a-bf8f-c642b0855a4f service nova] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:26:39.320780 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 701/1391] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:26:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:26:41.585995 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d61c1-1da0-408f-8aa7-a07f58fe5a8c None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:41.586634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d61c1-1da0-408f-8aa7-a07f58fe5a8c None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:41.586634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d61c1-1da0-408f-8aa7-a07f58fe5a8c None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:41.587911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 691/1392] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:26:41.593646 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73cfa8-e538-455a-baf7-058a72d8a91d None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:41.594150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73cfa8-e538-455a-baf7-058a72d8a91d None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:41.594245 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73cfa8-e538-455a-baf7-058a72d8a91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:41.611855 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-fc73cfa8-e538-455a-baf7-058a72d8a91d None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:26:41.613014 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-fc73cfa8-e538-455a-baf7-058a72d8a91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:26:41.620696 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 702/1393] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:26:41.664691 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d61c1-1da0-408f-8aa7-a07f58fe5a8c None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:26:41.678603 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d61c1-1da0-408f-8aa7-a07f58fe5a8c None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:26:41.684215 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346a8fb-3172-4a79-b9b9-69d0750dade3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:26:41.684854 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346a8fb-3172-4a79-b9b9-69d0750dade3 service nova] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:41.685138 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346a8fb-3172-4a79-b9b9-69d0750dade3 service nova] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:41.685412 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346a8fb-3172-4a79-b9b9-69d0750dade3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:41.694014 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8346a8fb-3172-4a79-b9b9-69d0750dade3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:26:41.695577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8346a8fb-3172-4a79-b9b9-69d0750dade3 service nova] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:26:41.705263 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 692/1394] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:26:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:26:42.963234 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c3bf7-6a72-4b26-901e-eb329799dd92 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:42.963775 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c3bf7-6a72-4b26-901e-eb329799dd92 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:42.963775 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c3bf7-6a72-4b26-901e-eb329799dd92 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:42.965035 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 703/1395] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:26:42.971157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8e45c-8494-4ccb-97a4-3f1230de007b None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:42.971624 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8e45c-8494-4ccb-97a4-3f1230de007b None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:42.971826 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8e45c-8494-4ccb-97a4-3f1230de007b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:42.989446 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-6af8e45c-8494-4ccb-97a4-3f1230de007b None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:26:42.990643 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-6af8e45c-8494-4ccb-97a4-3f1230de007b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:26:42.998286 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 693/1396] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:26:43.053614 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba581510-57d9-4b02-af35-c9d4aa4dd9fa None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:43.053909 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba581510-57d9-4b02-af35-c9d4aa4dd9fa None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:43.054307 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba581510-57d9-4b02-af35-c9d4aa4dd9fa None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:43.055625 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 704/1397] 10.222.0.60 () {54 vars in 962 bytes} [Thu May 12 09:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:26:43.060435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89631262-7c07-43af-8d09-f988307119b1 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:43.060722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89631262-7c07-43af-8d09-f988307119b1 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:43.060994 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89631262-7c07-43af-8d09-f988307119b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:43.109473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-89631262-7c07-43af-8d09-f988307119b1 None None] MFA Rules not processed for user `0981a8c6d9ac413b99aae95a6cdd3be5`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:26:43.110965 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-89631262-7c07-43af-8d09-f988307119b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:26:43.170484 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 694/1398] 10.222.0.60 () {58 vars in 1059 bytes} [Thu May 12 09:26:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:26:43.178391 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba581510-57d9-4b02-af35-c9d4aa4dd9fa None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:26:43.190359 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba581510-57d9-4b02-af35-c9d4aa4dd9fa None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:26:43.193994 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f183107-65b2-46eb-885d-a8593adb73c2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0981a8c6d9ac413b99aae95a6cdd3be5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:26:43.194643 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f183107-65b2-46eb-885d-a8593adb73c2 service glance] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:43.195122 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f183107-65b2-46eb-885d-a8593adb73c2 service glance] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:43.195395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f183107-65b2-46eb-885d-a8593adb73c2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:43.205198 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f183107-65b2-46eb-885d-a8593adb73c2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:26:43.206675 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f183107-65b2-46eb-885d-a8593adb73c2 service glance] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:26:43.216727 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 705/1399] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:26:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:26:43.641775 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b24ce6-5b86-4387-8710-45b517ee5b86 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:43.642091 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b24ce6-5b86-4387-8710-45b517ee5b86 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:43.642365 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b24ce6-5b86-4387-8710-45b517ee5b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:43.688756 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-b6b24ce6-5b86-4387-8710-45b517ee5b86 None None] MFA Rules not processed for user `bd41f419750140268f4d4b77456065c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:26:43.689973 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-b6b24ce6-5b86-4387-8710-45b517ee5b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:26:43.751710 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 695/1400] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 12 09:26:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:26:43.795722 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b67d78-1d8e-4a4b-bd2a-091fbcae3778 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:43.796550 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b67d78-1d8e-4a4b-bd2a-091fbcae3778 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:43.796828 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b67d78-1d8e-4a4b-bd2a-091fbcae3778 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:43.798233 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 706/1401] 10.222.0.60 () {54 vars in 942 bytes} [Thu May 12 09:26:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:26:43.804533 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e69461-88ab-42ef-8084-bc9279c2ac86 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:43.804851 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e69461-88ab-42ef-8084-bc9279c2ac86 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:43.805124 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e69461-88ab-42ef-8084-bc9279c2ac86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:43.851004 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-90e69461-88ab-42ef-8084-bc9279c2ac86 None None] MFA Rules not processed for user `f7693a31911346f9bb2c01efcd8e16e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:26:43.852169 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-90e69461-88ab-42ef-8084-bc9279c2ac86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:26:43.920143 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 696/1402] 10.222.0.60 () {58 vars in 1039 bytes} [Thu May 12 09:26:43 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:26:43.930165 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b67d78-1d8e-4a4b-bd2a-091fbcae3778 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:26:43.942546 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac25e7-1ca2-47ac-a48c-36f664fafed8 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:43.942833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac25e7-1ca2-47ac-a48c-36f664fafed8 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:43.943110 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac25e7-1ca2-47ac-a48c-36f664fafed8 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:43.943972 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b67d78-1d8e-4a4b-bd2a-091fbcae3778 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:26:43.944454 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 697/1403] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:26:43.949316 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1d5d3-2779-4961-8845-0e0bec19ece7 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:43.949597 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1d5d3-2779-4961-8845-0e0bec19ece7 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:43.949916 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1d5d3-2779-4961-8845-0e0bec19ece7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:43.950680 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddc7a7-5c22-489e-8b16-e5e4dfee2d01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7693a31911346f9bb2c01efcd8e16e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:26:43.951321 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddc7a7-5c22-489e-8b16-e5e4dfee2d01 service swift] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:43.951606 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddc7a7-5c22-489e-8b16-e5e4dfee2d01 service swift] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:43.951910 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddc7a7-5c22-489e-8b16-e5e4dfee2d01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:43.961059 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddc7a7-5c22-489e-8b16-e5e4dfee2d01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:26:43.962692 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddc7a7-5c22-489e-8b16-e5e4dfee2d01 service swift] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:26:43.966996 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-92c1d5d3-2779-4961-8845-0e0bec19ece7 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:26:43.968696 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-92c1d5d3-2779-4961-8845-0e0bec19ece7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:26:43.975037 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 707/1404] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 12 09:26:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 09:26:43.977228 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 698/1405] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:26:44.025693 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddc7a7-5c22-489e-8b16-e5e4dfee2d01 service swift] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:26:44.037924 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddc7a7-5c22-489e-8b16-e5e4dfee2d01 service swift] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:26:44.043351 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b494f-0c07-4c3b-b341-47e1126d555c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:26:44.044293 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b494f-0c07-4c3b-b341-47e1126d555c service nova] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:44.044574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b494f-0c07-4c3b-b341-47e1126d555c service nova] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:44.044847 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b494f-0c07-4c3b-b341-47e1126d555c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:44.054140 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b494f-0c07-4c3b-b341-47e1126d555c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:26:44.055728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b494f-0c07-4c3b-b341-47e1126d555c service nova] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:26:44.065417 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 708/1406] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:26:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:26:46.340305 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188b14c-1362-47bc-8c68-a072eb3f598c None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:46.340862 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188b14c-1362-47bc-8c68-a072eb3f598c None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:46.340862 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188b14c-1362-47bc-8c68-a072eb3f598c None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:46.345927 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 699/1407] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:26:46.348144 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628bf24-fb1b-4ccc-ae90-40cfbb8a4328 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:46.348575 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628bf24-fb1b-4ccc-ae90-40cfbb8a4328 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:46.348760 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628bf24-fb1b-4ccc-ae90-40cfbb8a4328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:46.366291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-7628bf24-fb1b-4ccc-ae90-40cfbb8a4328 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:26:46.367404 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-7628bf24-fb1b-4ccc-ae90-40cfbb8a4328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:26:46.375747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 709/1408] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:26:46.419302 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188b14c-1362-47bc-8c68-a072eb3f598c None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:26:46.438506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188b14c-1362-47bc-8c68-a072eb3f598c None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:26:46.444661 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893c6ca-b2c4-491c-a49c-e713cb991e05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:26:46.445332 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893c6ca-b2c4-491c-a49c-e713cb991e05 service nova] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:26:46.445621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893c6ca-b2c4-491c-a49c-e713cb991e05 service nova] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:26:46.445919 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893c6ca-b2c4-491c-a49c-e713cb991e05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:26:46.454371 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893c6ca-b2c4-491c-a49c-e713cb991e05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:26:46.456598 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893c6ca-b2c4-491c-a49c-e713cb991e05 service nova] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:26:46.466530 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 700/1409] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:26:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:27:07.342269 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc190cb-e2c3-4484-aacd-6ffcb4f9fa28 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:07.343541 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc190cb-e2c3-4484-aacd-6ffcb4f9fa28 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:07.343541 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc190cb-e2c3-4484-aacd-6ffcb4f9fa28 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:07.344669 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 710/1410] 10.222.0.60 () {54 vars in 918 bytes} [Thu May 12 09:27:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:27:07.349830 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe98a4-d182-4438-a7ae-a5ff4724d202 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:07.350346 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe98a4-d182-4438-a7ae-a5ff4724d202 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:07.350346 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe98a4-d182-4438-a7ae-a5ff4724d202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:07.371877 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-4bbe98a4-d182-4438-a7ae-a5ff4724d202 None None] MFA Rules not processed for user `525f4699878f461e82f7f06ef60c176a`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:27:07.373106 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-4bbe98a4-d182-4438-a7ae-a5ff4724d202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:27:07.382197 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 701/1411] 10.222.0.60 () {58 vars in 1015 bytes} [Thu May 12 09:27:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:27:07.396369 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449e58f-1f0a-47b6-9247-e412d5847859 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:07.396660 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449e58f-1f0a-47b6-9247-e412d5847859 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:07.396943 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449e58f-1f0a-47b6-9247-e412d5847859 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:07.398321 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 711/1412] 10.222.0.60 () {54 vars in 918 bytes} [Thu May 12 09:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:27:07.402663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85154200-540c-4044-ba1d-f02ac85da551 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:07.402950 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85154200-540c-4044-ba1d-f02ac85da551 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:07.403227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85154200-540c-4044-ba1d-f02ac85da551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:07.421082 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-85154200-540c-4044-ba1d-f02ac85da551 None None] MFA Rules not processed for user `2915babd40aa42e8bf7cc85c5a97daa6`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:27:07.422778 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-85154200-540c-4044-ba1d-f02ac85da551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:27:07.431708 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 702/1413] 10.222.0.60 () {58 vars in 1015 bytes} [Thu May 12 09:27:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:27:10.093747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27087c2d-d657-4225-9f9f-483cb7dfbd38 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:10.094416 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27087c2d-d657-4225-9f9f-483cb7dfbd38 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:10.094416 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27087c2d-d657-4225-9f9f-483cb7dfbd38 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:10.095676 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 712/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 09:27:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:27:10.101202 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7eb759-e948-436f-8c59-33f4ce789c3f None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:10.101618 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7eb759-e948-436f-8c59-33f4ce789c3f None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:10.101730 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7eb759-e948-436f-8c59-33f4ce789c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:10.118697 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-ed7eb759-e948-436f-8c59-33f4ce789c3f None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:27:10.119871 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-ed7eb759-e948-436f-8c59-33f4ce789c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:27:10.130047 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 703/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 09:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:27:10.169219 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27087c2d-d657-4225-9f9f-483cb7dfbd38 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:27:10.183021 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27087c2d-d657-4225-9f9f-483cb7dfbd38 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:27:10.188722 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bddf0d-c175-410e-b1c9-e80b7a95513a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:27:10.189340 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bddf0d-c175-410e-b1c9-e80b7a95513a service nova] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:10.189615 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bddf0d-c175-410e-b1c9-e80b7a95513a service nova] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:10.189884 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bddf0d-c175-410e-b1c9-e80b7a95513a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:10.197605 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bddf0d-c175-410e-b1c9-e80b7a95513a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:27:10.199204 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bddf0d-c175-410e-b1c9-e80b7a95513a service nova] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:27:10.208852 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 713/1416] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:27:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:27:11.190008 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c0c94-ba61-49d2-a16a-ab51a32c19b6 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:11.190559 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c0c94-ba61-49d2-a16a-ab51a32c19b6 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:11.190559 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c0c94-ba61-49d2-a16a-ab51a32c19b6 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:11.191916 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 704/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 09:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:27:11.196964 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7150e9-b736-4660-9601-22081fd9c07c None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:11.197377 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7150e9-b736-4660-9601-22081fd9c07c None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:11.197523 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7150e9-b736-4660-9601-22081fd9c07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:11.215727 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-fe7150e9-b736-4660-9601-22081fd9c07c None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:27:11.216900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-fe7150e9-b736-4660-9601-22081fd9c07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:27:11.225266 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 714/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 09:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:27:11.378074 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c0c94-ba61-49d2-a16a-ab51a32c19b6 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:27:11.392089 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c0c94-ba61-49d2-a16a-ab51a32c19b6 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:27:11.397390 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9502a07-864d-4c31-b58c-7710fc1dbdb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:27:11.398059 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9502a07-864d-4c31-b58c-7710fc1dbdb8 service nova] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:11.398340 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9502a07-864d-4c31-b58c-7710fc1dbdb8 service nova] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:11.398611 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9502a07-864d-4c31-b58c-7710fc1dbdb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:11.406394 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9502a07-864d-4c31-b58c-7710fc1dbdb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:27:11.407953 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9502a07-864d-4c31-b58c-7710fc1dbdb8 service nova] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:27:11.417669 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 705/1419] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:27:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:27:12.365073 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7a549-51bf-41ad-9e5c-f4ba284ccbd0 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:12.365609 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7a549-51bf-41ad-9e5c-f4ba284ccbd0 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:12.365609 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7a549-51bf-41ad-9e5c-f4ba284ccbd0 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:12.367012 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 715/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 09:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:27:12.372178 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782cc89-c8ea-48b7-a744-1089e6306e71 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:12.372633 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782cc89-c8ea-48b7-a744-1089e6306e71 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:12.372748 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782cc89-c8ea-48b7-a744-1089e6306e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:12.390623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-8782cc89-c8ea-48b7-a744-1089e6306e71 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:27:12.391772 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-8782cc89-c8ea-48b7-a744-1089e6306e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:27:12.399449 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 706/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 09:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:27:12.547843 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7a549-51bf-41ad-9e5c-f4ba284ccbd0 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:27:12.562471 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7a549-51bf-41ad-9e5c-f4ba284ccbd0 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:27:12.567725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8c81f-a241-491a-9244-4b951df8edb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:27:12.568343 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8c81f-a241-491a-9244-4b951df8edb4 service nova] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:12.568621 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8c81f-a241-491a-9244-4b951df8edb4 service nova] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:12.568891 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8c81f-a241-491a-9244-4b951df8edb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:12.576619 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8c81f-a241-491a-9244-4b951df8edb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:27:12.578785 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8c81f-a241-491a-9244-4b951df8edb4 service nova] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:27:12.588044 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 716/1422] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:27:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:27:13.515446 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1365f32-7efc-4dc3-8fab-96c96c68a84a None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:13.516019 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1365f32-7efc-4dc3-8fab-96c96c68a84a None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:13.516019 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1365f32-7efc-4dc3-8fab-96c96c68a84a None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:13.517350 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 707/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 09:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:27:13.522232 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794d39b-f573-4cda-a823-b2a59180abee None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:13.522676 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794d39b-f573-4cda-a823-b2a59180abee None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:13.522778 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794d39b-f573-4cda-a823-b2a59180abee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:13.541061 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-1794d39b-f573-4cda-a823-b2a59180abee None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:27:13.542243 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-1794d39b-f573-4cda-a823-b2a59180abee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:27:13.550479 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 717/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 09:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:27:13.700263 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1365f32-7efc-4dc3-8fab-96c96c68a84a None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:27:13.714784 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1365f32-7efc-4dc3-8fab-96c96c68a84a None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:27:13.720612 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f172019-d0d7-47a4-9d36-5579f3aa825f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:27:13.721244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f172019-d0d7-47a4-9d36-5579f3aa825f service nova] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:13.721522 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f172019-d0d7-47a4-9d36-5579f3aa825f service nova] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:13.721792 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f172019-d0d7-47a4-9d36-5579f3aa825f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:13.729551 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f172019-d0d7-47a4-9d36-5579f3aa825f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:27:13.731154 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f172019-d0d7-47a4-9d36-5579f3aa825f service nova] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:27:13.740441 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 708/1425] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:27:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:27:14.658842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e10c09-39e8-4c44-aea3-7252ce45ea46 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:14.659393 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e10c09-39e8-4c44-aea3-7252ce45ea46 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:14.659393 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e10c09-39e8-4c44-aea3-7252ce45ea46 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:14.660733 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 718/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 09:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:27:14.665684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64646c0-ad60-4b26-a198-dc987c9f9d97 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:14.666116 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64646c0-ad60-4b26-a198-dc987c9f9d97 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:14.666265 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64646c0-ad60-4b26-a198-dc987c9f9d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:14.683454 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-a64646c0-ad60-4b26-a198-dc987c9f9d97 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:27:14.684612 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-a64646c0-ad60-4b26-a198-dc987c9f9d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:27:14.692643 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 709/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 09:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:27:14.841127 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e10c09-39e8-4c44-aea3-7252ce45ea46 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:27:14.856980 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e10c09-39e8-4c44-aea3-7252ce45ea46 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:27:14.862940 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67951cf0-c3e7-4d2a-a5da-edd5aca42865 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:27:14.863572 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67951cf0-c3e7-4d2a-a5da-edd5aca42865 service nova] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:14.863861 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67951cf0-c3e7-4d2a-a5da-edd5aca42865 service nova] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:14.864140 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67951cf0-c3e7-4d2a-a5da-edd5aca42865 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:14.872082 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67951cf0-c3e7-4d2a-a5da-edd5aca42865 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:27:14.873662 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67951cf0-c3e7-4d2a-a5da-edd5aca42865 service nova] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:27:14.883244 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 719/1428] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:27:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:27:15.753554 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829072ae-8746-498d-8e03-a8c507358b2d None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:15.754167 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829072ae-8746-498d-8e03-a8c507358b2d None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:15.754167 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829072ae-8746-498d-8e03-a8c507358b2d None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:15.755778 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 710/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 09:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:27:15.760937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9df3a-45a1-4780-8b43-0aa250d46000 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:15.761384 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9df3a-45a1-4780-8b43-0aa250d46000 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:15.761485 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9df3a-45a1-4780-8b43-0aa250d46000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:15.779094 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-6fe9df3a-45a1-4780-8b43-0aa250d46000 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:27:15.780792 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-6fe9df3a-45a1-4780-8b43-0aa250d46000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:27:15.798291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 720/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 09:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:27:15.946914 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829072ae-8746-498d-8e03-a8c507358b2d None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:27:15.961414 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829072ae-8746-498d-8e03-a8c507358b2d None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:27:15.971861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c849d6-c2d2-44b9-8de2-1e6e27673010 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:27:15.972513 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c849d6-c2d2-44b9-8de2-1e6e27673010 service nova] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:15.972800 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c849d6-c2d2-44b9-8de2-1e6e27673010 service nova] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:15.973065 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c849d6-c2d2-44b9-8de2-1e6e27673010 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:15.983602 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c849d6-c2d2-44b9-8de2-1e6e27673010 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:27:15.985162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c849d6-c2d2-44b9-8de2-1e6e27673010 service nova] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:27:15.995468 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 711/1431] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:27:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:27:16.977746 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb2429-58a0-4f8f-b358-8dcced34f5eb None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:16.978325 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb2429-58a0-4f8f-b358-8dcced34f5eb None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:16.978325 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb2429-58a0-4f8f-b358-8dcced34f5eb None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:16.979686 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 721/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 09:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:27:16.985182 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590906f0-7a83-4fe9-a8ec-5a3978852203 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:16.985619 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590906f0-7a83-4fe9-a8ec-5a3978852203 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:16.985725 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590906f0-7a83-4fe9-a8ec-5a3978852203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:17.002961 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-590906f0-7a83-4fe9-a8ec-5a3978852203 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:27:17.004122 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-590906f0-7a83-4fe9-a8ec-5a3978852203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:27:17.011975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 712/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 09:27:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:27:17.163687 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb2429-58a0-4f8f-b358-8dcced34f5eb None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:27:17.178544 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb2429-58a0-4f8f-b358-8dcced34f5eb None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:27:17.183896 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d426fe-abbf-4f5b-b109-940125369d4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:27:17.184530 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d426fe-abbf-4f5b-b109-940125369d4e service nova] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:17.184815 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d426fe-abbf-4f5b-b109-940125369d4e service nova] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:17.185094 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d426fe-abbf-4f5b-b109-940125369d4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:17.193134 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d426fe-abbf-4f5b-b109-940125369d4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:27:17.194761 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d426fe-abbf-4f5b-b109-940125369d4e service nova] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:27:17.204334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 722/1434] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:27:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:27:18.078585 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ada5d-89f7-4245-afc4-b57f9b9aa518 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:18.079153 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ada5d-89f7-4245-afc4-b57f9b9aa518 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:18.079153 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ada5d-89f7-4245-afc4-b57f9b9aa518 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:18.080496 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 713/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 09:27:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:27:18.085431 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f630c5-2d60-4ed5-8d32-310954371cdb None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:18.085856 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f630c5-2d60-4ed5-8d32-310954371cdb None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:18.086003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f630c5-2d60-4ed5-8d32-310954371cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:18.104724 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-90f630c5-2d60-4ed5-8d32-310954371cdb None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:27:18.105937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-90f630c5-2d60-4ed5-8d32-310954371cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:27:18.114064 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 723/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 09:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:27:18.263458 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ada5d-89f7-4245-afc4-b57f9b9aa518 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:27:18.278069 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ada5d-89f7-4245-afc4-b57f9b9aa518 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:27:18.283908 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63997795-6c2f-4ed1-b7bb-cf7a8eac9f11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:27:18.284541 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63997795-6c2f-4ed1-b7bb-cf7a8eac9f11 service nova] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:18.284824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63997795-6c2f-4ed1-b7bb-cf7a8eac9f11 service nova] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:18.285098 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63997795-6c2f-4ed1-b7bb-cf7a8eac9f11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:18.293055 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63997795-6c2f-4ed1-b7bb-cf7a8eac9f11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:27:18.294639 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63997795-6c2f-4ed1-b7bb-cf7a8eac9f11 service nova] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:27:18.303699 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 714/1437] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:27:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:27:19.197988 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cac42-3a14-4d05-870c-d5d2575665ff None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:19.198670 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cac42-3a14-4d05-870c-d5d2575665ff None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:19.198670 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cac42-3a14-4d05-870c-d5d2575665ff None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:19.199896 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 724/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 09:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:27:19.205478 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4af301-0b32-424f-aeb3-077989a785f7 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:19.205949 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4af301-0b32-424f-aeb3-077989a785f7 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:19.206071 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4af301-0b32-424f-aeb3-077989a785f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:19.223258 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-cf4af301-0b32-424f-aeb3-077989a785f7 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:27:19.224424 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-cf4af301-0b32-424f-aeb3-077989a785f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:27:19.232091 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 715/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 09:27:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:27:19.381464 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cac42-3a14-4d05-870c-d5d2575665ff None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:27:19.395566 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cac42-3a14-4d05-870c-d5d2575665ff None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:27:19.400900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324ad57-84ee-4056-a0fa-a5191e745570 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:27:19.401531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324ad57-84ee-4056-a0fa-a5191e745570 service nova] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:19.401816 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324ad57-84ee-4056-a0fa-a5191e745570 service nova] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:19.402125 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324ad57-84ee-4056-a0fa-a5191e745570 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:19.410567 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324ad57-84ee-4056-a0fa-a5191e745570 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:27:19.412136 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324ad57-84ee-4056-a0fa-a5191e745570 service nova] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:27:19.421883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 725/1440] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:27:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:27:21.505533 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3068c0-e635-48f3-8c47-55a6b30336d2 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:21.506123 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3068c0-e635-48f3-8c47-55a6b30336d2 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:21.506123 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3068c0-e635-48f3-8c47-55a6b30336d2 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:21.507463 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 716/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 09:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:27:21.512621 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b592e7-16bb-4ed6-97ef-15aba047d737 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:21.513039 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b592e7-16bb-4ed6-97ef-15aba047d737 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:21.513181 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b592e7-16bb-4ed6-97ef-15aba047d737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:21.530894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-74b592e7-16bb-4ed6-97ef-15aba047d737 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:27:21.532083 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-74b592e7-16bb-4ed6-97ef-15aba047d737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:27:21.539751 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 726/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 09:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:27:21.579261 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3068c0-e635-48f3-8c47-55a6b30336d2 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:27:21.589938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3068c0-e635-48f3-8c47-55a6b30336d2 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:27:21.593988 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b55d00-a543-472b-90ae-b80983aa3b96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:27:21.594654 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b55d00-a543-472b-90ae-b80983aa3b96 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:21.594929 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b55d00-a543-472b-90ae-b80983aa3b96 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:21.595195 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b55d00-a543-472b-90ae-b80983aa3b96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:21.604554 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b55d00-a543-472b-90ae-b80983aa3b96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:27:21.606027 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b55d00-a543-472b-90ae-b80983aa3b96 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:27:21.616090 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 717/1443] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:27:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:27:23.948569 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f60792-8703-4727-994d-ca84ad36aec5 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:23.949167 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f60792-8703-4727-994d-ca84ad36aec5 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:23.949167 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f60792-8703-4727-994d-ca84ad36aec5 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:23.950479 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 727/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 09:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:27:23.956336 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd1bde-8b1e-45ef-a272-da1a6931867d None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:23.956782 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd1bde-8b1e-45ef-a272-da1a6931867d None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:23.956891 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd1bde-8b1e-45ef-a272-da1a6931867d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:23.974674 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-49fd1bde-8b1e-45ef-a272-da1a6931867d None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:27:23.975880 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-49fd1bde-8b1e-45ef-a272-da1a6931867d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:27:23.984155 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 718/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 09:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:27:24.020531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f60792-8703-4727-994d-ca84ad36aec5 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:27:24.031388 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f60792-8703-4727-994d-ca84ad36aec5 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:27:24.034836 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1233c6f-989a-46f5-b59d-f21200f53f24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:27:24.035457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1233c6f-989a-46f5-b59d-f21200f53f24 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:24.035734 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1233c6f-989a-46f5-b59d-f21200f53f24 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:24.036005 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1233c6f-989a-46f5-b59d-f21200f53f24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:24.044502 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1233c6f-989a-46f5-b59d-f21200f53f24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:27:24.046514 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1233c6f-989a-46f5-b59d-f21200f53f24 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:27:24.055457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 728/1446] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:27:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:27:26.570669 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a9d3f-7b4e-409c-9892-40a40b7b6e1c None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:26.571231 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a9d3f-7b4e-409c-9892-40a40b7b6e1c None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:26.571231 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a9d3f-7b4e-409c-9892-40a40b7b6e1c None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:26.572607 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 719/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 09:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:27:26.578465 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41234b87-55d2-45d1-8bfa-0544b5a6437e None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:26.578941 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41234b87-55d2-45d1-8bfa-0544b5a6437e None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:26.579058 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41234b87-55d2-45d1-8bfa-0544b5a6437e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:26.596692 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-41234b87-55d2-45d1-8bfa-0544b5a6437e None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:27:26.597872 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-41234b87-55d2-45d1-8bfa-0544b5a6437e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:27:26.605669 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 729/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 09:27:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:27:26.643898 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a9d3f-7b4e-409c-9892-40a40b7b6e1c None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:27:26.654231 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a9d3f-7b4e-409c-9892-40a40b7b6e1c None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:27:26.658271 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f75a80-12e6-4e5e-8e9e-5fddee8fb346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:27:26.658900 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f75a80-12e6-4e5e-8e9e-5fddee8fb346 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:26.659178 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f75a80-12e6-4e5e-8e9e-5fddee8fb346 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:26.659450 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f75a80-12e6-4e5e-8e9e-5fddee8fb346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:26.667886 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f75a80-12e6-4e5e-8e9e-5fddee8fb346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:27:26.669281 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f75a80-12e6-4e5e-8e9e-5fddee8fb346 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:27:26.678238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 720/1449] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:27:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:27:28.997497 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc10a7-9afe-438a-940d-09dd397f4f1f None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:28.998106 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc10a7-9afe-438a-940d-09dd397f4f1f None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:28.998106 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc10a7-9afe-438a-940d-09dd397f4f1f None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:28.999891 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 730/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 09:27:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:27:29.005658 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d762cf-d004-4fc4-9a75-b02a2d064591 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:29.006132 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d762cf-d004-4fc4-9a75-b02a2d064591 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:29.006239 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d762cf-d004-4fc4-9a75-b02a2d064591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:29.023819 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-e3d762cf-d004-4fc4-9a75-b02a2d064591 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:27:29.024986 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-e3d762cf-d004-4fc4-9a75-b02a2d064591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:27:29.032712 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 721/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 09:27:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:27:29.069877 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc10a7-9afe-438a-940d-09dd397f4f1f None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:27:29.080982 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc10a7-9afe-438a-940d-09dd397f4f1f None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:27:29.084466 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f09748-b996-4250-9292-6b59a4f61585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:27:29.085084 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f09748-b996-4250-9292-6b59a4f61585 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:29.085361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f09748-b996-4250-9292-6b59a4f61585 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:29.085630 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f09748-b996-4250-9292-6b59a4f61585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:29.094227 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f09748-b996-4250-9292-6b59a4f61585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:27:29.096045 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f09748-b996-4250-9292-6b59a4f61585 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:27:29.105750 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 731/1452] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:27:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:27:31.370335 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8970f-76cc-461a-bf41-ef1a3178c4a4 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:31.370881 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8970f-76cc-461a-bf41-ef1a3178c4a4 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:31.370881 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8970f-76cc-461a-bf41-ef1a3178c4a4 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:31.372150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 722/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 09:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:27:31.377519 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5e03e-3f38-4bc9-8c5d-0f8a8cfb6650 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:31.378006 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5e03e-3f38-4bc9-8c5d-0f8a8cfb6650 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:31.378130 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5e03e-3f38-4bc9-8c5d-0f8a8cfb6650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:31.395922 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-72f5e03e-3f38-4bc9-8c5d-0f8a8cfb6650 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:27:31.397097 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-72f5e03e-3f38-4bc9-8c5d-0f8a8cfb6650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:27:31.404746 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 732/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 09:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:27:31.442405 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8970f-76cc-461a-bf41-ef1a3178c4a4 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:27:31.453103 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8970f-76cc-461a-bf41-ef1a3178c4a4 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:27:31.456562 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee43d54-de76-44a1-a7d2-fb22dd2abaa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:27:31.457189 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee43d54-de76-44a1-a7d2-fb22dd2abaa3 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:31.457467 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee43d54-de76-44a1-a7d2-fb22dd2abaa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:31.457737 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee43d54-de76-44a1-a7d2-fb22dd2abaa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:31.466328 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee43d54-de76-44a1-a7d2-fb22dd2abaa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:27:31.467692 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee43d54-de76-44a1-a7d2-fb22dd2abaa3 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:27:31.476584 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 723/1455] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:27:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:27:33.705209 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24c19c-6a0a-4d94-b8ba-3f100288609d None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:33.705762 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24c19c-6a0a-4d94-b8ba-3f100288609d None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:33.705762 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24c19c-6a0a-4d94-b8ba-3f100288609d None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:33.708035 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 733/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 09:27:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:27:33.713452 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f7c08-bf2d-49d9-b644-7fdb23d1f23f None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:33.713938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f7c08-bf2d-49d9-b644-7fdb23d1f23f None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:33.714054 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f7c08-bf2d-49d9-b644-7fdb23d1f23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:33.731530 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-be9f7c08-bf2d-49d9-b644-7fdb23d1f23f None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:27:33.732693 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-be9f7c08-bf2d-49d9-b644-7fdb23d1f23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:27:33.740965 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 724/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 09:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:27:33.777616 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24c19c-6a0a-4d94-b8ba-3f100288609d None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:27:33.788412 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24c19c-6a0a-4d94-b8ba-3f100288609d None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:27:33.791866 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80bf92-228c-4b5b-8de3-75c0a88fbf3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:27:33.792485 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80bf92-228c-4b5b-8de3-75c0a88fbf3c service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:33.792761 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80bf92-228c-4b5b-8de3-75c0a88fbf3c service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:33.793032 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80bf92-228c-4b5b-8de3-75c0a88fbf3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:33.802189 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80bf92-228c-4b5b-8de3-75c0a88fbf3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:27:33.803596 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80bf92-228c-4b5b-8de3-75c0a88fbf3c service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:27:33.812808 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 734/1458] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:27:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:27:36.084220 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132b83d-9f78-4a2b-a5fc-495caa4bdb09 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:36.084832 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132b83d-9f78-4a2b-a5fc-495caa4bdb09 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:36.084832 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132b83d-9f78-4a2b-a5fc-495caa4bdb09 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:36.086279 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 725/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 09:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:27:36.091608 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843af5e-8df0-45ad-b4ee-c1fb675d77ba None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:36.092029 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843af5e-8df0-45ad-b4ee-c1fb675d77ba None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:36.092148 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843af5e-8df0-45ad-b4ee-c1fb675d77ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:36.110589 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-a843af5e-8df0-45ad-b4ee-c1fb675d77ba None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:27:36.111758 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-a843af5e-8df0-45ad-b4ee-c1fb675d77ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:27:36.119519 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 735/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 09:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:27:36.156964 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132b83d-9f78-4a2b-a5fc-495caa4bdb09 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:27:36.167414 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132b83d-9f78-4a2b-a5fc-495caa4bdb09 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:27:36.171033 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c53372-3899-44c0-8872-b2247179e4c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:27:36.171667 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c53372-3899-44c0-8872-b2247179e4c8 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:36.171950 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c53372-3899-44c0-8872-b2247179e4c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:36.172228 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c53372-3899-44c0-8872-b2247179e4c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:36.181000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c53372-3899-44c0-8872-b2247179e4c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:27:36.182488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c53372-3899-44c0-8872-b2247179e4c8 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:27:36.191620 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 726/1461] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:27:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:27:38.525849 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7e842-ad17-4f12-b31f-4ddfa730d7d5 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:38.526464 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7e842-ad17-4f12-b31f-4ddfa730d7d5 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:38.526567 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7e842-ad17-4f12-b31f-4ddfa730d7d5 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:38.527907 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 736/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 09:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:27:38.533358 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d7bc2-6afc-40ab-9876-d985ea1bb408 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:38.533807 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d7bc2-6afc-40ab-9876-d985ea1bb408 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:38.533941 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d7bc2-6afc-40ab-9876-d985ea1bb408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:38.551363 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-c06d7bc2-6afc-40ab-9876-d985ea1bb408 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:27:38.552520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-c06d7bc2-6afc-40ab-9876-d985ea1bb408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:27:38.560145 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 727/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 09:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:27:38.596563 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7e842-ad17-4f12-b31f-4ddfa730d7d5 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:27:38.606966 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7e842-ad17-4f12-b31f-4ddfa730d7d5 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:27:38.610949 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52b809-ae5a-4cae-a5da-fa687ed7c4ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:27:38.611571 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52b809-ae5a-4cae-a5da-fa687ed7c4ab service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:38.611850 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52b809-ae5a-4cae-a5da-fa687ed7c4ab service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:38.612120 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52b809-ae5a-4cae-a5da-fa687ed7c4ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:38.620675 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52b809-ae5a-4cae-a5da-fa687ed7c4ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:27:38.622131 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52b809-ae5a-4cae-a5da-fa687ed7c4ab service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:27:38.631863 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 737/1464] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:27:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:27:40.858810 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28b932-52b1-4da4-aabf-abad61732093 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:40.859396 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28b932-52b1-4da4-aabf-abad61732093 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:40.859396 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28b932-52b1-4da4-aabf-abad61732093 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:40.860726 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 728/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 09:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:27:40.866130 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e2e66-f524-4ab6-8a40-3e5da71edee6 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:40.866622 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e2e66-f524-4ab6-8a40-3e5da71edee6 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:40.866730 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e2e66-f524-4ab6-8a40-3e5da71edee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:40.884743 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-cf9e2e66-f524-4ab6-8a40-3e5da71edee6 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:27:40.885952 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-cf9e2e66-f524-4ab6-8a40-3e5da71edee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:27:40.894198 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 738/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 09:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:27:40.929444 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28b932-52b1-4da4-aabf-abad61732093 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:27:40.940340 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28b932-52b1-4da4-aabf-abad61732093 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:27:40.943819 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ee5fb-68dc-48e5-91f0-7a8c862984c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:27:40.944448 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ee5fb-68dc-48e5-91f0-7a8c862984c7 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:40.944732 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ee5fb-68dc-48e5-91f0-7a8c862984c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:40.945008 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ee5fb-68dc-48e5-91f0-7a8c862984c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:40.954244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ee5fb-68dc-48e5-91f0-7a8c862984c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:27:40.955658 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ee5fb-68dc-48e5-91f0-7a8c862984c7 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:27:40.964773 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 729/1467] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:27:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:27:43.197569 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e7e96-552e-4ff1-aa0c-06deb9dbc212 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:43.198156 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e7e96-552e-4ff1-aa0c-06deb9dbc212 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:43.198156 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e7e96-552e-4ff1-aa0c-06deb9dbc212 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:43.199505 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 739/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 09:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:27:43.204797 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392e2de-f529-4e46-ade3-e788fa96c2f9 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:43.205219 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392e2de-f529-4e46-ade3-e788fa96c2f9 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:43.205373 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392e2de-f529-4e46-ade3-e788fa96c2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:43.222884 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-3392e2de-f529-4e46-ade3-e788fa96c2f9 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:27:43.224044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-3392e2de-f529-4e46-ade3-e788fa96c2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:27:43.231697 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 730/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 09:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:27:43.267551 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e7e96-552e-4ff1-aa0c-06deb9dbc212 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:27:43.277781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e7e96-552e-4ff1-aa0c-06deb9dbc212 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:27:43.281721 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80449e-5422-4d62-bd52-e4cab5ce9ead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:27:43.282381 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80449e-5422-4d62-bd52-e4cab5ce9ead service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:27:43.282657 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80449e-5422-4d62-bd52-e4cab5ce9ead service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:27:43.282923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80449e-5422-4d62-bd52-e4cab5ce9ead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:27:43.291390 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c80449e-5422-4d62-bd52-e4cab5ce9ead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:27:43.292803 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c80449e-5422-4d62-bd52-e4cab5ce9ead service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:27:43.302447 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 740/1470] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:27:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:28:16.257993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449b66b-a30a-4842-b315-64701ae5fae9 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:28:16.258624 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449b66b-a30a-4842-b315-64701ae5fae9 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:28:16.258624 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449b66b-a30a-4842-b315-64701ae5fae9 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:28:16.259896 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 731/1471] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:28:16.265133 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee6b91-3d67-4e55-9af9-123e59d8b7d0 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:28:16.265571 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee6b91-3d67-4e55-9af9-123e59d8b7d0 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:28:16.265685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee6b91-3d67-4e55-9af9-123e59d8b7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:28:16.283721 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-58ee6b91-3d67-4e55-9af9-123e59d8b7d0 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:28:16.284896 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-58ee6b91-3d67-4e55-9af9-123e59d8b7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:28:16.292551 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 741/1472] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:28:16.338273 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30844c5-e203-45c2-982b-8cd1d1517083 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:28:16.338557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30844c5-e203-45c2-982b-8cd1d1517083 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:28:16.338830 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30844c5-e203-45c2-982b-8cd1d1517083 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:28:16.340163 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 732/1473] 10.222.0.60 () {54 vars in 962 bytes} [Thu May 12 09:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:28:16.345451 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6280824-f29a-40d6-bcae-1693c535f18a None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:28:16.345736 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6280824-f29a-40d6-bcae-1693c535f18a None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:28:16.346046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6280824-f29a-40d6-bcae-1693c535f18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:28:16.363990 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-e6280824-f29a-40d6-bcae-1693c535f18a None None] MFA Rules not processed for user `0981a8c6d9ac413b99aae95a6cdd3be5`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:28:16.365099 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-e6280824-f29a-40d6-bcae-1693c535f18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:28:16.371414 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 742/1474] 10.222.0.60 () {58 vars in 1059 bytes} [Thu May 12 09:28:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:28:16.378226 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30844c5-e203-45c2-982b-8cd1d1517083 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:28:16.388761 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30844c5-e203-45c2-982b-8cd1d1517083 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:28:16.392236 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07fddb-2df7-4fc3-855b-68bea7f9ff70 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0981a8c6d9ac413b99aae95a6cdd3be5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:28:16.392850 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07fddb-2df7-4fc3-855b-68bea7f9ff70 service glance] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:28:16.393131 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07fddb-2df7-4fc3-855b-68bea7f9ff70 service glance] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:28:16.393404 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07fddb-2df7-4fc3-855b-68bea7f9ff70 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:28:16.402075 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07fddb-2df7-4fc3-855b-68bea7f9ff70 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:28:16.403468 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07fddb-2df7-4fc3-855b-68bea7f9ff70 service glance] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:28:16.413044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 733/1475] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:28:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:28:18.719503 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e1205-607a-4842-98b0-a1342fae9857 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:28:18.720096 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e1205-607a-4842-98b0-a1342fae9857 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:28:18.720096 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e1205-607a-4842-98b0-a1342fae9857 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:28:18.721408 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 743/1476] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:28:18.726956 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cafdd-7d64-43c3-aef2-3440715888d1 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:28:18.727351 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cafdd-7d64-43c3-aef2-3440715888d1 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:28:18.727503 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cafdd-7d64-43c3-aef2-3440715888d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:28:18.745857 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-a76cafdd-7d64-43c3-aef2-3440715888d1 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:28:18.747046 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-a76cafdd-7d64-43c3-aef2-3440715888d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:28:18.754631 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 734/1477] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:28:18.777467 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e1205-607a-4842-98b0-a1342fae9857 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:28:18.790112 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e1205-607a-4842-98b0-a1342fae9857 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:28:18.794514 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e9012-2559-4160-8da5-1c4cda89c957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:28:18.795147 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e9012-2559-4160-8da5-1c4cda89c957 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:28:18.796059 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e9012-2559-4160-8da5-1c4cda89c957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:28:18.796340 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e9012-2559-4160-8da5-1c4cda89c957 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:28:18.797069 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e9012-2559-4160-8da5-1c4cda89c957 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:28:18.798854 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: WARNING py.warnings [None req-c93e9012-2559-4160-8da5-1c4cda89c957 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 09:28:18.798854 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: warnings.warn(msg) May 12 09:28:18.798854 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: May 12 09:28:18.799979 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e9012-2559-4160-8da5-1c4cda89c957 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:28:18.818621 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 744/1478] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 12 09:28:18 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:28:21.070287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efa5df-173a-416f-9201-4a37e04a4af6 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:28:21.070825 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efa5df-173a-416f-9201-4a37e04a4af6 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:28:21.070825 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efa5df-173a-416f-9201-4a37e04a4af6 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:28:21.072132 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 735/1479] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:28:21.077522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae10da-c1b5-4b77-a059-c53220edbcd5 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:28:21.077956 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae10da-c1b5-4b77-a059-c53220edbcd5 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:28:21.078112 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae10da-c1b5-4b77-a059-c53220edbcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:28:21.095415 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-3aae10da-c1b5-4b77-a059-c53220edbcd5 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:28:21.096599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-3aae10da-c1b5-4b77-a059-c53220edbcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:28:21.104459 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 745/1480] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:28:21.149716 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efa5df-173a-416f-9201-4a37e04a4af6 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:28:21.164673 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efa5df-173a-416f-9201-4a37e04a4af6 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:28:21.170063 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a5f36-8bc7-4023-95bb-8f1e47ef4138 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:28:21.171195 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a5f36-8bc7-4023-95bb-8f1e47ef4138 service nova] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:28:21.171476 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a5f36-8bc7-4023-95bb-8f1e47ef4138 service nova] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:28:21.171749 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a5f36-8bc7-4023-95bb-8f1e47ef4138 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:28:21.179699 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a5f36-8bc7-4023-95bb-8f1e47ef4138 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:28:21.181266 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a5f36-8bc7-4023-95bb-8f1e47ef4138 service nova] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:28:21.190981 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 736/1481] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:28:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:28:23.579912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825e05b-4fa0-401b-a4da-0386b1b50acb None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:28:23.580488 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825e05b-4fa0-401b-a4da-0386b1b50acb None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:28:23.580488 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825e05b-4fa0-401b-a4da-0386b1b50acb None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:28:23.581816 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 746/1482] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:28:23.587409 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2e891-1e57-4f40-8a96-e95f2ee373fa None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:28:23.587826 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2e891-1e57-4f40-8a96-e95f2ee373fa None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:28:23.587984 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2e891-1e57-4f40-8a96-e95f2ee373fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:28:23.604981 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-23b2e891-1e57-4f40-8a96-e95f2ee373fa None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:28:23.606169 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-23b2e891-1e57-4f40-8a96-e95f2ee373fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:28:23.614301 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 737/1483] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:28:23.652074 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825e05b-4fa0-401b-a4da-0386b1b50acb None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:28:23.662370 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825e05b-4fa0-401b-a4da-0386b1b50acb None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:28:23.665818 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ee4db-199b-45bf-87c7-64db9e80c7fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:28:23.666468 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ee4db-199b-45bf-87c7-64db9e80c7fc service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:28:23.666746 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ee4db-199b-45bf-87c7-64db9e80c7fc service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:28:23.667016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ee4db-199b-45bf-87c7-64db9e80c7fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:28:23.676178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ee4db-199b-45bf-87c7-64db9e80c7fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:28:23.677864 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ee4db-199b-45bf-87c7-64db9e80c7fc service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:28:23.687397 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 747/1484] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:28:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:28:25.952836 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f161d-aace-4e08-8638-91d127fb5e7a None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:28:25.953301 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f161d-aace-4e08-8638-91d127fb5e7a None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:28:25.953420 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f161d-aace-4e08-8638-91d127fb5e7a None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:28:25.954773 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 738/1485] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:28:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:28:25.960039 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805be7a3-ac6f-4cc3-90c9-c23845d937c1 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:28:25.960521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805be7a3-ac6f-4cc3-90c9-c23845d937c1 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:28:25.960637 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805be7a3-ac6f-4cc3-90c9-c23845d937c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:28:25.978867 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-805be7a3-ac6f-4cc3-90c9-c23845d937c1 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:28:25.980067 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-805be7a3-ac6f-4cc3-90c9-c23845d937c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:28:25.988428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 748/1486] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:28:26.024697 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f161d-aace-4e08-8638-91d127fb5e7a None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:28:26.035846 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f161d-aace-4e08-8638-91d127fb5e7a None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:28:26.039402 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ed9ee-f1e1-48f5-a0e7-c49776b79082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:28:26.040036 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ed9ee-f1e1-48f5-a0e7-c49776b79082 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:28:26.040323 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ed9ee-f1e1-48f5-a0e7-c49776b79082 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:28:26.040597 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ed9ee-f1e1-48f5-a0e7-c49776b79082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:28:26.049878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ed9ee-f1e1-48f5-a0e7-c49776b79082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:28:26.051327 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ed9ee-f1e1-48f5-a0e7-c49776b79082 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:28:26.060477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 739/1487] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:28:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:28:28.351998 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad235996-dae7-4ca4-b02c-bcfa33478a57 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:28:28.352625 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad235996-dae7-4ca4-b02c-bcfa33478a57 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:28:28.352625 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad235996-dae7-4ca4-b02c-bcfa33478a57 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:28:28.353865 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 749/1488] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:28:28.359574 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ca6c4-6f5b-43e3-8c28-fdb6989a205e None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:28:28.359998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ca6c4-6f5b-43e3-8c28-fdb6989a205e None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:28:28.360104 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ca6c4-6f5b-43e3-8c28-fdb6989a205e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:28:28.377560 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-007ca6c4-6f5b-43e3-8c28-fdb6989a205e None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:28:28.378767 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-007ca6c4-6f5b-43e3-8c28-fdb6989a205e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:28:28.386628 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 740/1489] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:28:28.427023 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad235996-dae7-4ca4-b02c-bcfa33478a57 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:28:28.437396 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad235996-dae7-4ca4-b02c-bcfa33478a57 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:28:28.440883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76344bea-8692-4082-87f3-561937aa3bba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:28:28.441511 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76344bea-8692-4082-87f3-561937aa3bba service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:28:28.441792 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76344bea-8692-4082-87f3-561937aa3bba service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:28:28.442097 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76344bea-8692-4082-87f3-561937aa3bba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:28:28.450745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76344bea-8692-4082-87f3-561937aa3bba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:28:28.452165 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76344bea-8692-4082-87f3-561937aa3bba service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:28:28.461310 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 750/1490] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:28:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:28:31.019318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3dc34-767f-4559-8422-75e40a30b3d3 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:28:31.019872 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3dc34-767f-4559-8422-75e40a30b3d3 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:28:31.019872 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3dc34-767f-4559-8422-75e40a30b3d3 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:28:31.024783 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 741/1491] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 12 09:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:28:31.026821 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779bdc68-8975-4f77-8601-d55f59073d13 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:28:31.027384 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779bdc68-8975-4f77-8601-d55f59073d13 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:28:31.027384 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779bdc68-8975-4f77-8601-d55f59073d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:28:31.045409 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-779bdc68-8975-4f77-8601-d55f59073d13 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:28:31.046642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-779bdc68-8975-4f77-8601-d55f59073d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:28:31.054498 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 751/1492] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 12 09:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:28:31.093430 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3dc34-767f-4559-8422-75e40a30b3d3 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:28:31.104537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3dc34-767f-4559-8422-75e40a30b3d3 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:28:31.108206 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb0f3e-22a2-4eda-b343-a325d249dd98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:28:31.108842 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb0f3e-22a2-4eda-b343-a325d249dd98 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:28:31.109120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb0f3e-22a2-4eda-b343-a325d249dd98 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:28:31.109387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb0f3e-22a2-4eda-b343-a325d249dd98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:28:31.118217 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb0f3e-22a2-4eda-b343-a325d249dd98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:28:31.119653 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb0f3e-22a2-4eda-b343-a325d249dd98 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:28:31.130507 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 742/1493] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:28:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:29:58.647089 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100773b-d8e1-4ab0-b01e-428d6f9d2987 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:29:58.647708 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100773b-d8e1-4ab0-b01e-428d6f9d2987 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:29:58.647708 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100773b-d8e1-4ab0-b01e-428d6f9d2987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:29:58.666141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-5100773b-d8e1-4ab0-b01e-428d6f9d2987 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:29:58.667312 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-5100773b-d8e1-4ab0-b01e-428d6f9d2987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:29:58.675166 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 752/1494] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:29:58.684337 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e963d7-0d7e-4791-aa34-337df9af0592 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:29:58.685360 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e963d7-0d7e-4791-aa34-337df9af0592 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:29:58.685469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e963d7-0d7e-4791-aa34-337df9af0592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:29:58.703068 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-e8e963d7-0d7e-4791-aa34-337df9af0592 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:29:58.704233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-e8e963d7-0d7e-4791-aa34-337df9af0592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:29:58.711872 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 743/1495] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:29:58.716141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100773b-d8e1-4ab0-b01e-428d6f9d2987 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:29:58.725339 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100773b-d8e1-4ab0-b01e-428d6f9d2987 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:29:58.729670 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47574ce0-82b0-42ad-9a1d-96325c889339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:29:58.730343 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47574ce0-82b0-42ad-9a1d-96325c889339 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:29:58.730620 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47574ce0-82b0-42ad-9a1d-96325c889339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:29:58.730892 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47574ce0-82b0-42ad-9a1d-96325c889339 admin admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:29:58.731632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47574ce0-82b0-42ad-9a1d-96325c889339 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:29:58.731935 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47574ce0-82b0-42ad-9a1d-96325c889339 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:29:58.732937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: WARNING py.warnings [None req-47574ce0-82b0-42ad-9a1d-96325c889339 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 09:29:58.732937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: warnings.warn(msg) May 12 09:29:58.732937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: May 12 09:29:58.733792 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47574ce0-82b0-42ad-9a1d-96325c889339 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:29:58.745208 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 753/1496] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:29:58.753840 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e963d7-0d7e-4791-aa34-337df9af0592 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:29:58.763583 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e963d7-0d7e-4791-aa34-337df9af0592 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:29:58.768145 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c288b-437b-43da-be8e-103614aeeaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:29:58.768785 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c288b-437b-43da-be8e-103614aeeaf3 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:29:58.769066 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c288b-437b-43da-be8e-103614aeeaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:29:58.769339 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c288b-437b-43da-be8e-103614aeeaf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:29:58.770051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c288b-437b-43da-be8e-103614aeeaf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:29:58.771790 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: WARNING py.warnings [None req-f46c288b-437b-43da-be8e-103614aeeaf3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 09:29:58.771790 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: warnings.warn(msg) May 12 09:29:58.771790 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: May 12 09:29:58.772969 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c288b-437b-43da-be8e-103614aeeaf3 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:29:58.805783 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 744/1497] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:29:58 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:29:58.810498 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47574ce0-82b0-42ad-9a1d-96325c889339 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:29:58.820039 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47574ce0-82b0-42ad-9a1d-96325c889339 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:29:58.872543 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4eead-b14b-4c98-811d-ac7bf0e619b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:29:58.873198 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4eead-b14b-4c98-811d-ac7bf0e619b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:29:58.873477 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4eead-b14b-4c98-811d-ac7bf0e619b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:29:58.873747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4eead-b14b-4c98-811d-ac7bf0e619b2 admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:29:58.874476 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4eead-b14b-4c98-811d-ac7bf0e619b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:29:58.875484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: WARNING py.warnings [None req-61e4eead-b14b-4c98-811d-ac7bf0e619b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 09:29:58.875484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: warnings.warn(msg) May 12 09:29:58.875484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: May 12 09:29:58.876681 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4eead-b14b-4c98-811d-ac7bf0e619b2 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:29:58.896038 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 754/1498] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:29:58 2022] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:29:58.900253 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c288b-437b-43da-be8e-103614aeeaf3 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:29:58.910254 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c288b-437b-43da-be8e-103614aeeaf3 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:29:58.914949 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70a64f-3758-4cbe-a32b-46c9bbab15e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:29:58.915632 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70a64f-3758-4cbe-a32b-46c9bbab15e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:29:58.915917 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70a64f-3758-4cbe-a32b-46c9bbab15e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:29:58.916192 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70a64f-3758-4cbe-a32b-46c9bbab15e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:29:58.916911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70a64f-3758-4cbe-a32b-46c9bbab15e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:29:58.917926 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: WARNING py.warnings [None req-ef70a64f-3758-4cbe-a32b-46c9bbab15e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 09:29:58.917926 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: warnings.warn(msg) May 12 09:29:58.917926 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: May 12 09:29:58.918886 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70a64f-3758-4cbe-a32b-46c9bbab15e8 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:29:58.931194 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 745/1499] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:29:58.935606 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4eead-b14b-4c98-811d-ac7bf0e619b2 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:29:58.945051 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4eead-b14b-4c98-811d-ac7bf0e619b2 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:29:58.949534 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36636ca4-bd28-4269-8369-c468bb6df3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:29:58.950781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36636ca4-bd28-4269-8369-c468bb6df3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:29:58.951066 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36636ca4-bd28-4269-8369-c468bb6df3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:29:58.951336 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36636ca4-bd28-4269-8369-c468bb6df3b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:29:58.952052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36636ca4-bd28-4269-8369-c468bb6df3b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:29:58.953046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: WARNING py.warnings [None req-36636ca4-bd28-4269-8369-c468bb6df3b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 09:29:58.953046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: warnings.warn(msg) May 12 09:29:58.953046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: May 12 09:29:58.953946 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36636ca4-bd28-4269-8369-c468bb6df3b2 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:29:58.966699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 755/1500] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:29:58.970719 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70a64f-3758-4cbe-a32b-46c9bbab15e8 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:29:58.980215 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70a64f-3758-4cbe-a32b-46c9bbab15e8 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:29:58.985197 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdeaae-8e51-441e-a626-01ee27339933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:29:58.986104 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdeaae-8e51-441e-a626-01ee27339933 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:29:58.986388 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdeaae-8e51-441e-a626-01ee27339933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:29:58.986662 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdeaae-8e51-441e-a626-01ee27339933 admin admin] PATH_INFO: `/v3/projects/1b78ae406d624552ae9a38dbd2063cc6/users/52ef77dfd2e640258efb77e56c278f6b/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:29:59.001420 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdeaae-8e51-441e-a626-01ee27339933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b78ae406d624552ae9a38dbd2063cc6, user_id=52ef77dfd2e640258efb77e56c278f6b, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:29:59.002469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: WARNING py.warnings [None req-91fdeaae-8e51-441e-a626-01ee27339933 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 09:29:59.002469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: warnings.warn(msg) May 12 09:29:59.002469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: May 12 09:29:59.004390 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdeaae-8e51-441e-a626-01ee27339933 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:29:59.017033 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 746/1501] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:29:58 2022] PUT /identity/v3/projects/1b78ae406d624552ae9a38dbd2063cc6/users/52ef77dfd2e640258efb77e56c278f6b/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:29:59.028542 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ca3fd-109a-44e5-b466-e10dc9c67ab2 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:29:59.028934 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ca3fd-109a-44e5-b466-e10dc9c67ab2 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:29:59.029217 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ca3fd-109a-44e5-b466-e10dc9c67ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:29:59.054545 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-c77ca3fd-109a-44e5-b466-e10dc9c67ab2 None None] MFA Rules not processed for user `52ef77dfd2e640258efb77e56c278f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:29:59.055740 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-c77ca3fd-109a-44e5-b466-e10dc9c67ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:29:59.116266 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 756/1502] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:29:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:29:59.130016 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d50e23-7fe8-4653-b26d-69fecb4172ba None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:29:59.130305 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d50e23-7fe8-4653-b26d-69fecb4172ba None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:29:59.130581 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d50e23-7fe8-4653-b26d-69fecb4172ba None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:29:59.131930 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 747/1503] 10.222.0.60 () {54 vars in 963 bytes} [Thu May 12 09:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:29:59.137110 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276adfe-472b-4565-a332-11dfb8b8c7b3 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:29:59.137399 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276adfe-472b-4565-a332-11dfb8b8c7b3 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:29:59.137710 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276adfe-472b-4565-a332-11dfb8b8c7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:29:59.156432 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-0276adfe-472b-4565-a332-11dfb8b8c7b3 None None] MFA Rules not processed for user `2e97d11fab3b4bb092f9623da4e40eb0`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:29:59.157594 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-0276adfe-472b-4565-a332-11dfb8b8c7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:29:59.205533 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 757/1504] 10.222.0.60 () {58 vars in 1060 bytes} [Thu May 12 09:29:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:29:59.213013 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d50e23-7fe8-4653-b26d-69fecb4172ba None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:29:59.223307 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d50e23-7fe8-4653-b26d-69fecb4172ba None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:29:59.226834 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22ee46-4c24-4806-ac5d-eddd59ffd987 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:29:59.227457 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22ee46-4c24-4806-ac5d-eddd59ffd987 service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:29:59.227735 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22ee46-4c24-4806-ac5d-eddd59ffd987 service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:29:59.228005 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22ee46-4c24-4806-ac5d-eddd59ffd987 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:29:59.236472 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22ee46-4c24-4806-ac5d-eddd59ffd987 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:29:59.237867 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22ee46-4c24-4806-ac5d-eddd59ffd987 service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:29:59.246639 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 748/1505] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:29:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 09:29:59.288427 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605da48-ec33-42d0-a8c3-d7c06fe061a7 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:29:59.288716 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605da48-ec33-42d0-a8c3-d7c06fe061a7 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:29:59.288997 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605da48-ec33-42d0-a8c3-d7c06fe061a7 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:29:59.290296 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 758/1506] 10.222.0.60 () {52 vars in 829 bytes} [Thu May 12 09:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:29:59.294309 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22ee46-4c24-4806-ac5d-eddd59ffd987 service cinder] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:29:59.352857 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22ee46-4c24-4806-ac5d-eddd59ffd987 service cinder] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:29:59.358577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca837b4-eae8-4104-a072-6223b0c69444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:29:59.358750 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca837b4-eae8-4104-a072-6223b0c69444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:29:59.359021 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca837b4-eae8-4104-a072-6223b0c69444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:29:59.359287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca837b4-eae8-4104-a072-6223b0c69444 admin admin] PATH_INFO: `/v3/users/52ef77dfd2e640258efb77e56c278f6b` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:29:59.360467 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca837b4-eae8-4104-a072-6223b0c69444 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52ef77dfd2e640258efb77e56c278f6b)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:29:59.361463 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: WARNING py.warnings [None req-cca837b4-eae8-4104-a072-6223b0c69444 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 09:29:59.361463 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: warnings.warn(msg) May 12 09:29:59.361463 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: May 12 09:29:59.362681 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca837b4-eae8-4104-a072-6223b0c69444 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:29:59.424569 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-cca837b4-eae8-4104-a072-6223b0c69444 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52ef77dfd2e640258efb77e56c278f6b'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:29:59.442002 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-cca837b4-eae8-4104-a072-6223b0c69444 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52ef77dfd2e640258efb77e56c278f6b'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:29:59.442768 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-cca837b4-eae8-4104-a072-6223b0c69444 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52ef77dfd2e640258efb77e56c278f6b'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:29:59.452029 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-cca837b4-eae8-4104-a072-6223b0c69444 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52ef77dfd2e640258efb77e56c278f6b'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:29:59.463950 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-cca837b4-eae8-4104-a072-6223b0c69444 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52ef77dfd2e640258efb77e56c278f6b'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:29:59.470292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 749/1507] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:29:59 2022] DELETE /identity/v3/users/52ef77dfd2e640258efb77e56c278f6b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:29:59.474829 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6439b80-66ff-4081-94f4-261bf39a65a3 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:29:59.475116 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6439b80-66ff-4081-94f4-261bf39a65a3 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:29:59.475394 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6439b80-66ff-4081-94f4-261bf39a65a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:29:59.492587 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-c6439b80-66ff-4081-94f4-261bf39a65a3 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:29:59.493750 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-c6439b80-66ff-4081-94f4-261bf39a65a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:29:59.548836 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 759/1508] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:29:59.558194 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca837b4-eae8-4104-a072-6223b0c69444 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:29:59.559603 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-cca837b4-eae8-4104-a072-6223b0c69444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:29:59.619247 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca837b4-eae8-4104-a072-6223b0c69444 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:29:59.622924 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405301b-3f80-4d1e-8ca5-71f390e8faed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:29:59.623569 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405301b-3f80-4d1e-8ca5-71f390e8faed service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:29:59.623846 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405301b-3f80-4d1e-8ca5-71f390e8faed service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:29:59.624147 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405301b-3f80-4d1e-8ca5-71f390e8faed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:29:59.633254 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c405301b-3f80-4d1e-8ca5-71f390e8faed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:29:59.634690 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c405301b-3f80-4d1e-8ca5-71f390e8faed service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:29:59.643925 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 750/1509] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:29:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:29:59.964057 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6439b80-66ff-4081-94f4-261bf39a65a3 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:29:59.965646 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-c6439b80-66ff-4081-94f4-261bf39a65a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:29:59.978412 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6439b80-66ff-4081-94f4-261bf39a65a3 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:29:59.983965 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a7327-dd36-4159-bcfb-75e8e36f92f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:29:59.984825 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a7327-dd36-4159-bcfb-75e8e36f92f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:29:59.985674 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a7327-dd36-4159-bcfb-75e8e36f92f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:29:59.985674 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a7327-dd36-4159-bcfb-75e8e36f92f5 admin admin] PATH_INFO: `/v3/projects/1b78ae406d624552ae9a38dbd2063cc6` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:29:59.986541 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a7327-dd36-4159-bcfb-75e8e36f92f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b78ae406d624552ae9a38dbd2063cc6)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:29:59.988372 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: WARNING py.warnings [None req-133a7327-dd36-4159-bcfb-75e8e36f92f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 09:29:59.988372 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: warnings.warn(msg) May 12 09:29:59.988372 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: May 12 09:29:59.989577 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a7327-dd36-4159-bcfb-75e8e36f92f5 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:30:00.048948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-133a7327-dd36-4159-bcfb-75e8e36f92f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b78ae406d624552ae9a38dbd2063cc6', 'request_id': 'req-133a7327-dd36-4159-bcfb-75e8e36f92f5'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:30:00.054724 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-133a7327-dd36-4159-bcfb-75e8e36f92f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b78ae406d624552ae9a38dbd2063cc6', 'request_id': 'req-133a7327-dd36-4159-bcfb-75e8e36f92f5'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:30:00.063493 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-133a7327-dd36-4159-bcfb-75e8e36f92f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b78ae406d624552ae9a38dbd2063cc6', 'request_id': 'req-133a7327-dd36-4159-bcfb-75e8e36f92f5'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:30:00.081736 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-133a7327-dd36-4159-bcfb-75e8e36f92f5 admin admin] The token cache is being invalidate because project 1b78ae406d624552ae9a38dbd2063cc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:30:00.082060 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-133a7327-dd36-4159-bcfb-75e8e36f92f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:30:00.082690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-133a7327-dd36-4159-bcfb-75e8e36f92f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:30:00.084299 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 760/1510] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:29:59 2022] DELETE /identity/v3/projects/1b78ae406d624552ae9a38dbd2063cc6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:31:40.667769 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49729c-d5d8-4611-9b63-0c5bb2e51a19 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:31:40.668392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49729c-d5d8-4611-9b63-0c5bb2e51a19 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:31:40.668392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49729c-d5d8-4611-9b63-0c5bb2e51a19 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:31:40.669732 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 751/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 09:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:31:40.674628 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709a890-e020-416d-8019-423bf641c12b None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:31:40.675071 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709a890-e020-416d-8019-423bf641c12b None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:31:40.675182 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709a890-e020-416d-8019-423bf641c12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:31:40.693172 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-5709a890-e020-416d-8019-423bf641c12b None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:31:40.694390 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-5709a890-e020-416d-8019-423bf641c12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:31:40.753194 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 761/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 09:31:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:31:40.919641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49729c-d5d8-4611-9b63-0c5bb2e51a19 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:31:40.921228 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-9c49729c-d5d8-4611-9b63-0c5bb2e51a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:31:41.120601 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49729c-d5d8-4611-9b63-0c5bb2e51a19 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:31:41.126010 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2564a-0d5b-46d7-827d-84cddc6d15e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:31:41.126659 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2564a-0d5b-46d7-827d-84cddc6d15e4 service nova] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:31:41.126940 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2564a-0d5b-46d7-827d-84cddc6d15e4 service nova] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:31:41.127213 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2564a-0d5b-46d7-827d-84cddc6d15e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:31:41.135396 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2564a-0d5b-46d7-827d-84cddc6d15e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:31:41.136977 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2564a-0d5b-46d7-827d-84cddc6d15e4 service nova] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:31:41.146120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 752/1513] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:31:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:31:41.920175 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5674c65-85c2-4d5b-91df-48eb646710eb None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:31:41.920760 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5674c65-85c2-4d5b-91df-48eb646710eb None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:31:41.920760 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5674c65-85c2-4d5b-91df-48eb646710eb None None] PATH_INFO: `/v3` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:31:41.922172 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 762/1514] 10.222.0.65 () {54 vars in 925 bytes} [Thu May 12 09:31:41 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:31:41.928170 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fab010-dfbf-4b6a-9a8b-f2baf007197d None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:31:41.928587 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fab010-dfbf-4b6a-9a8b-f2baf007197d None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:31:41.928704 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fab010-dfbf-4b6a-9a8b-f2baf007197d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:31:41.949485 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-d0fab010-dfbf-4b6a-9a8b-f2baf007197d None None] MFA Rules not processed for user `525f4699878f461e82f7f06ef60c176a`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:31:41.950709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-d0fab010-dfbf-4b6a-9a8b-f2baf007197d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:31:42.019189 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 753/1515] 10.222.0.65 () {58 vars in 1015 bytes} [Thu May 12 09:31:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:31:42.074382 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d5305-ade0-4418-be20-c2c5a5779dd6 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:31:42.074667 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d5305-ade0-4418-be20-c2c5a5779dd6 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:31:42.074937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d5305-ade0-4418-be20-c2c5a5779dd6 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:31:42.076298 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 763/1516] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 09:31:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:31:42.081227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481e55d-bc27-44b8-b2ab-fa18eef0802a None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:31:42.081517 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481e55d-bc27-44b8-b2ab-fa18eef0802a None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:31:42.081795 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481e55d-bc27-44b8-b2ab-fa18eef0802a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:31:42.100171 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-4481e55d-bc27-44b8-b2ab-fa18eef0802a None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:31:42.101358 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-4481e55d-bc27-44b8-b2ab-fa18eef0802a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:31:42.109235 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 754/1517] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 09:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:31:42.263449 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d5305-ade0-4418-be20-c2c5a5779dd6 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:31:42.277309 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d5305-ade0-4418-be20-c2c5a5779dd6 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:31:42.282654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14cff8-a556-4ffe-8963-cb6b2e396711 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:31:42.283300 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14cff8-a556-4ffe-8963-cb6b2e396711 service nova] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:31:42.283580 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14cff8-a556-4ffe-8963-cb6b2e396711 service nova] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:31:42.283851 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14cff8-a556-4ffe-8963-cb6b2e396711 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:31:42.291938 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14cff8-a556-4ffe-8963-cb6b2e396711 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:31:42.293656 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14cff8-a556-4ffe-8963-cb6b2e396711 service nova] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:31:42.302986 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 764/1518] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:31:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:31:51.123131 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15940a-5f1e-407e-889d-134311717f5f None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:31:51.123620 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15940a-5f1e-407e-889d-134311717f5f None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:31:51.123719 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15940a-5f1e-407e-889d-134311717f5f None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:31:51.125020 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 755/1519] 10.222.0.60 () {54 vars in 960 bytes} [Thu May 12 09:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:31:51.130175 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c8b29-38a9-476c-9aa6-eb96489ed8b2 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:31:51.130611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c8b29-38a9-476c-9aa6-eb96489ed8b2 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:31:51.130761 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c8b29-38a9-476c-9aa6-eb96489ed8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:31:51.148328 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-548c8b29-38a9-476c-9aa6-eb96489ed8b2 None None] MFA Rules not processed for user `525f4699878f461e82f7f06ef60c176a`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:31:51.149507 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-548c8b29-38a9-476c-9aa6-eb96489ed8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:31:51.158452 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 765/1520] 10.222.0.60 () {58 vars in 1057 bytes} [Thu May 12 09:31:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:31:51.165737 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15940a-5f1e-407e-889d-134311717f5f None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:31:51.179161 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15940a-5f1e-407e-889d-134311717f5f None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:31:51.184036 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2069d-adb6-4456-8691-ba1de174ef70 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525f4699878f461e82f7f06ef60c176a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:31:51.184653 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2069d-adb6-4456-8691-ba1de174ef70 service placement] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:31:51.184932 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2069d-adb6-4456-8691-ba1de174ef70 service placement] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:31:51.185204 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2069d-adb6-4456-8691-ba1de174ef70 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:31:51.193193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d2069d-adb6-4456-8691-ba1de174ef70 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:31:51.194776 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d2069d-adb6-4456-8691-ba1de174ef70 service placement] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:31:51.204498 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 756/1521] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:31:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:31:53.637787 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a9a0d-be04-48f2-9f03-3da8ce64e216 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:31:53.638418 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a9a0d-be04-48f2-9f03-3da8ce64e216 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:31:53.638418 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a9a0d-be04-48f2-9f03-3da8ce64e216 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:31:53.639732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 766/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 09:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:31:53.644493 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d22f6-9635-404d-8966-686de82d2cb2 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:31:53.644951 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d22f6-9635-404d-8966-686de82d2cb2 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:31:53.645059 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d22f6-9635-404d-8966-686de82d2cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:31:53.662888 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-414d22f6-9635-404d-8966-686de82d2cb2 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:31:53.664079 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-414d22f6-9635-404d-8966-686de82d2cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:31:53.672428 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 757/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 09:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:31:53.824171 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a9a0d-be04-48f2-9f03-3da8ce64e216 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:31:53.838470 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a9a0d-be04-48f2-9f03-3da8ce64e216 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:31:53.844444 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f2764-5c90-4836-8b60-857b16afb0c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:31:53.845076 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f2764-5c90-4836-8b60-857b16afb0c6 service nova] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:31:53.845360 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f2764-5c90-4836-8b60-857b16afb0c6 service nova] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:31:53.845636 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f2764-5c90-4836-8b60-857b16afb0c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:31:53.853503 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f2764-5c90-4836-8b60-857b16afb0c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:31:53.855183 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f2764-5c90-4836-8b60-857b16afb0c6 service nova] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:31:53.864541 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 767/1524] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:31:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:31:54.771300 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9bb3e-3eac-4c7e-b60b-960fe388e82d None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:31:54.771867 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9bb3e-3eac-4c7e-b60b-960fe388e82d None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:31:54.771867 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9bb3e-3eac-4c7e-b60b-960fe388e82d None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:31:54.773231 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 758/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 09:31:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:31:54.778663 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe0e63-e547-421b-89f4-2a8052957ad5 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:31:54.779063 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe0e63-e547-421b-89f4-2a8052957ad5 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:31:54.779223 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe0e63-e547-421b-89f4-2a8052957ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:31:54.796567 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-1bbe0e63-e547-421b-89f4-2a8052957ad5 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:31:54.797743 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-1bbe0e63-e547-421b-89f4-2a8052957ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:31:54.805569 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 768/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 09:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:31:54.957161 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9bb3e-3eac-4c7e-b60b-960fe388e82d None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:31:54.971047 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9bb3e-3eac-4c7e-b60b-960fe388e82d None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:31:54.976247 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e559b29-31dd-4a72-8e45-d5e02c528adf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:31:54.976869 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e559b29-31dd-4a72-8e45-d5e02c528adf service nova] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:31:54.977143 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e559b29-31dd-4a72-8e45-d5e02c528adf service nova] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:31:54.977409 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e559b29-31dd-4a72-8e45-d5e02c528adf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:31:54.985133 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e559b29-31dd-4a72-8e45-d5e02c528adf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:31:54.986712 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e559b29-31dd-4a72-8e45-d5e02c528adf service nova] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:31:54.996302 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 759/1527] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:31:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 09:31:59.073214 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9be64d-24e1-4933-aec3-628141c5c6bc None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:31:59.073807 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9be64d-24e1-4933-aec3-628141c5c6bc None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:31:59.073807 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9be64d-24e1-4933-aec3-628141c5c6bc None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:31:59.075189 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 769/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 09:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:31:59.080349 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afb310-1dcc-486d-a05e-65e6a3b9381f None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:31:59.080803 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afb310-1dcc-486d-a05e-65e6a3b9381f None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:31:59.080913 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afb310-1dcc-486d-a05e-65e6a3b9381f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:31:59.098503 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-11afb310-1dcc-486d-a05e-65e6a3b9381f None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:31:59.099946 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-11afb310-1dcc-486d-a05e-65e6a3b9381f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:31:59.107945 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 760/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 09:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:31:59.143295 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9be64d-24e1-4933-aec3-628141c5c6bc None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:31:59.144922 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-1b9be64d-24e1-4933-aec3-628141c5c6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:31:59.200435 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9be64d-24e1-4933-aec3-628141c5c6bc None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:31:59.203963 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81334470-8907-4860-9323-f942e0ba9286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:31:59.204601 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81334470-8907-4860-9323-f942e0ba9286 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:31:59.204881 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81334470-8907-4860-9323-f942e0ba9286 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:31:59.205160 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81334470-8907-4860-9323-f942e0ba9286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:31:59.214114 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81334470-8907-4860-9323-f942e0ba9286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:31:59.215538 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81334470-8907-4860-9323-f942e0ba9286 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:31:59.224735 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 770/1530] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:31:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:32:01.412907 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83653702-2672-4508-a972-e1978cb50058 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:32:01.413461 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83653702-2672-4508-a972-e1978cb50058 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:32:01.413461 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83653702-2672-4508-a972-e1978cb50058 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:32:01.414882 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 761/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 09:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:32:01.420745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b81876-7ac2-4157-b9ea-b80b4bd3209b None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:32:01.421180 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b81876-7ac2-4157-b9ea-b80b4bd3209b None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:32:01.421288 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b81876-7ac2-4157-b9ea-b80b4bd3209b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:32:01.441020 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-e2b81876-7ac2-4157-b9ea-b80b4bd3209b None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:32:01.442244 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-e2b81876-7ac2-4157-b9ea-b80b4bd3209b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:32:01.449908 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 771/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 09:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:32:01.484173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83653702-2672-4508-a972-e1978cb50058 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:32:01.494645 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83653702-2672-4508-a972-e1978cb50058 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:32:01.498859 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0456f5-bbcc-4692-97d3-ff4f4cd331af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:32:01.499495 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0456f5-bbcc-4692-97d3-ff4f4cd331af service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:32:01.499778 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0456f5-bbcc-4692-97d3-ff4f4cd331af service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:32:01.500052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0456f5-bbcc-4692-97d3-ff4f4cd331af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:32:01.509039 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0456f5-bbcc-4692-97d3-ff4f4cd331af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:32:01.510492 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0456f5-bbcc-4692-97d3-ff4f4cd331af service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:32:01.519601 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 762/1533] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:32:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:32:05.277844 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3ae8b-5a76-4f44-99f8-930b307e2378 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:32:05.278486 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3ae8b-5a76-4f44-99f8-930b307e2378 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:32:05.278486 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3ae8b-5a76-4f44-99f8-930b307e2378 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:32:05.279811 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 772/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 09:32:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:32:05.284854 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42542390-b694-4e0c-87d6-2cd6d731645d None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:32:05.285281 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42542390-b694-4e0c-87d6-2cd6d731645d None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:32:05.285386 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42542390-b694-4e0c-87d6-2cd6d731645d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:32:05.302868 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-42542390-b694-4e0c-87d6-2cd6d731645d None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:32:05.304037 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-42542390-b694-4e0c-87d6-2cd6d731645d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:32:05.312194 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 763/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 09:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:32:05.580934 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3ae8b-5a76-4f44-99f8-930b307e2378 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:32:05.582760 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-6fc3ae8b-5a76-4f44-99f8-930b307e2378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:32:05.637544 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3ae8b-5a76-4f44-99f8-930b307e2378 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:32:05.641003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9cbc3-d254-4644-a3df-25ffb2edc52c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:32:05.641639 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9cbc3-d254-4644-a3df-25ffb2edc52c service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:32:05.641933 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9cbc3-d254-4644-a3df-25ffb2edc52c service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:32:05.642211 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9cbc3-d254-4644-a3df-25ffb2edc52c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:32:05.650831 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9cbc3-d254-4644-a3df-25ffb2edc52c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:32:05.652272 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9cbc3-d254-4644-a3df-25ffb2edc52c service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:32:05.661267 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 773/1536] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:32:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:32:07.974147 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c3385-f7ac-4e5c-9316-63bd842b02e6 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:32:07.974744 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c3385-f7ac-4e5c-9316-63bd842b02e6 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:32:07.974744 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c3385-f7ac-4e5c-9316-63bd842b02e6 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:32:07.976094 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 764/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 09:32:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:32:07.981376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4bcc0-cfa1-4a43-9432-c2beac08e9ed None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:32:07.981813 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4bcc0-cfa1-4a43-9432-c2beac08e9ed None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:32:07.982040 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4bcc0-cfa1-4a43-9432-c2beac08e9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:32:07.999603 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-d9a4bcc0-cfa1-4a43-9432-c2beac08e9ed None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:32:08.000779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-d9a4bcc0-cfa1-4a43-9432-c2beac08e9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:32:08.008783 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 774/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 09:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:32:08.288967 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c3385-f7ac-4e5c-9316-63bd842b02e6 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:32:08.290668 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-b31c3385-f7ac-4e5c-9316-63bd842b02e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:32:08.303244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c3385-f7ac-4e5c-9316-63bd842b02e6 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:32:08.306806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8235f21-6cba-4a46-9899-6d99e3a9d9da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:32:08.308139 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8235f21-6cba-4a46-9899-6d99e3a9d9da service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:32:08.308432 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8235f21-6cba-4a46-9899-6d99e3a9d9da service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:32:08.308709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8235f21-6cba-4a46-9899-6d99e3a9d9da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:32:08.317585 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8235f21-6cba-4a46-9899-6d99e3a9d9da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:32:08.319037 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8235f21-6cba-4a46-9899-6d99e3a9d9da service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:32:08.328926 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 765/1539] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:32:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:33:40.461267 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e13bf2-09c9-4900-80ce-7ce8fe162055 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:40.462392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e13bf2-09c9-4900-80ce-7ce8fe162055 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:40.462932 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e13bf2-09c9-4900-80ce-7ce8fe162055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:40.485047 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-93e13bf2-09c9-4900-80ce-7ce8fe162055 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:40.486278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-93e13bf2-09c9-4900-80ce-7ce8fe162055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:40.501587 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 775/1540] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:40.512006 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dd5df-4647-48e4-976e-b6da2c4a73e8 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:40.512578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dd5df-4647-48e4-976e-b6da2c4a73e8 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:40.512578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dd5df-4647-48e4-976e-b6da2c4a73e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:40.533886 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-eb4dd5df-4647-48e4-976e-b6da2c4a73e8 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:40.535113 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-eb4dd5df-4647-48e4-976e-b6da2c4a73e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:40.549936 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 766/1541] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:40.556269 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e13bf2-09c9-4900-80ce-7ce8fe162055 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:40.566912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e13bf2-09c9-4900-80ce-7ce8fe162055 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:40.576722 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf568e-387a-45dd-a83a-5faeea5fee7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:40.577406 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf568e-387a-45dd-a83a-5faeea5fee7b admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:40.577691 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf568e-387a-45dd-a83a-5faeea5fee7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:40.577992 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf568e-387a-45dd-a83a-5faeea5fee7b admin admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:40.578729 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf568e-387a-45dd-a83a-5faeea5fee7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:33:40.579037 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf568e-387a-45dd-a83a-5faeea5fee7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:40.580705 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf568e-387a-45dd-a83a-5faeea5fee7b admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:40.595724 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 776/1542] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:33:40.604755 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4dd5df-4647-48e4-976e-b6da2c4a73e8 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:40.619431 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4dd5df-4647-48e4-976e-b6da2c4a73e8 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:40.625361 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7ccb9-37a0-45a4-9a71-5b9bd2b099d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:40.626106 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7ccb9-37a0-45a4-9a71-5b9bd2b099d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:40.626407 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7ccb9-37a0-45a4-9a71-5b9bd2b099d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:40.626664 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7ccb9-37a0-45a4-9a71-5b9bd2b099d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:40.627389 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7ccb9-37a0-45a4-9a71-5b9bd2b099d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:40.629340 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7ccb9-37a0-45a4-9a71-5b9bd2b099d5 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:40.670489 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 767/1543] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:33:40 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:33:40.675184 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf568e-387a-45dd-a83a-5faeea5fee7b admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:40.687260 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf568e-387a-45dd-a83a-5faeea5fee7b admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:40.756938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ac66e-6acf-4abd-8537-95c71b71c012 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:40.756938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ac66e-6acf-4abd-8537-95c71b71c012 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:40.756938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ac66e-6acf-4abd-8537-95c71b71c012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:40.761719 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfae754-72d4-479b-b562-b652af0c9a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:40.763002 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfae754-72d4-479b-b562-b652af0c9a6f admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:40.763538 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfae754-72d4-479b-b562-b652af0c9a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:40.764035 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfae754-72d4-479b-b562-b652af0c9a6f admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:40.764970 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfae754-72d4-479b-b562-b652af0c9a6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:40.767295 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfae754-72d4-479b-b562-b652af0c9a6f admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:40.791221 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-ae5ac66e-6acf-4abd-8537-95c71b71c012 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:40.792457 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-ae5ac66e-6acf-4abd-8537-95c71b71c012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:40.800865 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 777/1544] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:33:40 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:33:40.809296 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfae754-72d4-479b-b562-b652af0c9a6f admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:40.810630 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 768/1545] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:40.826475 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfae754-72d4-479b-b562-b652af0c9a6f admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:40.832232 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45006f2f-c109-40e5-9b80-fa742cc67afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:40.833295 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45006f2f-c109-40e5-9b80-fa742cc67afc admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:40.833801 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45006f2f-c109-40e5-9b80-fa742cc67afc admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:40.834339 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45006f2f-c109-40e5-9b80-fa742cc67afc admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:40.835309 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45006f2f-c109-40e5-9b80-fa742cc67afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:40.837841 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45006f2f-c109-40e5-9b80-fa742cc67afc admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:40.844065 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e35a37-e39b-42c2-b035-b9dec4922e6e None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:40.844443 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e35a37-e39b-42c2-b035-b9dec4922e6e None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:40.844649 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e35a37-e39b-42c2-b035-b9dec4922e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:40.853314 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 778/1546] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 09:33:40.865615 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45006f2f-c109-40e5-9b80-fa742cc67afc admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:40.874684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-53e35a37-e39b-42c2-b035-b9dec4922e6e None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:40.875910 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-53e35a37-e39b-42c2-b035-b9dec4922e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:40.881629 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45006f2f-c109-40e5-9b80-fa742cc67afc admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:40.891996 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 769/1547] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:40.892634 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb87e3-ce18-4037-9962-1986c15db24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:40.893562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb87e3-ce18-4037-9962-1986c15db24f admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:40.894097 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb87e3-ce18-4037-9962-1986c15db24f admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:40.894604 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb87e3-ce18-4037-9962-1986c15db24f admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:40.895633 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb87e3-ce18-4037-9962-1986c15db24f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:40.896689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e35a37-e39b-42c2-b035-b9dec4922e6e None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:40.897858 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb87e3-ce18-4037-9962-1986c15db24f admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:40.913967 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e35a37-e39b-42c2-b035-b9dec4922e6e None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:40.915648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 779/1548] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:33:40.919450 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb87e3-ce18-4037-9962-1986c15db24f admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:40.927630 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3d6b7-a950-4f89-9ede-57dd126ea4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:40.928323 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3d6b7-a950-4f89-9ede-57dd126ea4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:40.928607 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3d6b7-a950-4f89-9ede-57dd126ea4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:40.928879 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3d6b7-a950-4f89-9ede-57dd126ea4f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:40.929650 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3d6b7-a950-4f89-9ede-57dd126ea4f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:33:40.929928 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3d6b7-a950-4f89-9ede-57dd126ea4f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:40.930977 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: WARNING py.warnings [None req-38f3d6b7-a950-4f89-9ede-57dd126ea4f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 09:33:40.930977 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: warnings.warn(msg) May 12 09:33:40.930977 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: May 12 09:33:40.931865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3d6b7-a950-4f89-9ede-57dd126ea4f0 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:40.933140 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb87e3-ce18-4037-9962-1986c15db24f admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:40.953214 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884eb89-499f-43f2-839d-9b2c0c1e2d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:40.953639 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 770/1549] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:33:40.954882 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884eb89-499f-43f2-839d-9b2c0c1e2d64 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:40.955394 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884eb89-499f-43f2-839d-9b2c0c1e2d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:40.955915 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884eb89-499f-43f2-839d-9b2c0c1e2d64 admin admin] PATH_INFO: `/v3/projects/b079fd0b329c4f1a856f71e0c8f98dde/users/6c8297034cfa40438000e7d94419a429/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:40.962452 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3d6b7-a950-4f89-9ede-57dd126ea4f0 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:40.973647 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884eb89-499f-43f2-839d-9b2c0c1e2d64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b079fd0b329c4f1a856f71e0c8f98dde, user_id=6c8297034cfa40438000e7d94419a429, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:40.975501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: WARNING py.warnings [None req-8884eb89-499f-43f2-839d-9b2c0c1e2d64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 09:33:40.975501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: warnings.warn(msg) May 12 09:33:40.975501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: May 12 09:33:40.977446 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3d6b7-a950-4f89-9ede-57dd126ea4f0 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:40.978355 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884eb89-499f-43f2-839d-9b2c0c1e2d64 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:40.986188 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1b753-0493-4530-869b-6a136cc89220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:40.986872 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1b753-0493-4530-869b-6a136cc89220 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:40.987198 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1b753-0493-4530-869b-6a136cc89220 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:40.987478 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1b753-0493-4530-869b-6a136cc89220 admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:40.988309 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1b753-0493-4530-869b-6a136cc89220 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:40.990382 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1b753-0493-4530-869b-6a136cc89220 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:40.999583 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 780/1550] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:33:40 2022] PUT /identity/v3/projects/b079fd0b329c4f1a856f71e0c8f98dde/users/6c8297034cfa40438000e7d94419a429/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:33:41.001185 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862abf4a-87d6-4d30-b287-f78eb2eb377c None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:41.001688 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862abf4a-87d6-4d30-b287-f78eb2eb377c None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:41.002192 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862abf4a-87d6-4d30-b287-f78eb2eb377c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:41.023297 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-862abf4a-87d6-4d30-b287-f78eb2eb377c None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:41.025387 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-862abf4a-87d6-4d30-b287-f78eb2eb377c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:41.031532 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 771/1551] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:33:40 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:33:41.032804 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311c82c-0c78-4558-bc75-4f07f307cd3f None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:41.033261 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311c82c-0c78-4558-bc75-4f07f307cd3f None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:41.033547 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311c82c-0c78-4558-bc75-4f07f307cd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:41.053111 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-d311c82c-0c78-4558-bc75-4f07f307cd3f None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:41.055137 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-d311c82c-0c78-4558-bc75-4f07f307cd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:41.087992 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 781/1552] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:41.089283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11622c1-b505-4c9a-9bf3-3a49044286a9 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:41.089577 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11622c1-b505-4c9a-9bf3-3a49044286a9 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:41.089887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11622c1-b505-4c9a-9bf3-3a49044286a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:41.113500 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-c11622c1-b505-4c9a-9bf3-3a49044286a9 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:41.114752 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-c11622c1-b505-4c9a-9bf3-3a49044286a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:41.120406 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 772/1553] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:41.121508 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d25ff6-0c05-49af-8aa2-9cb428f3b582 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:41.121792 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d25ff6-0c05-49af-8aa2-9cb428f3b582 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:41.122094 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d25ff6-0c05-49af-8aa2-9cb428f3b582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:41.129155 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 782/1554] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:41.130493 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc26404-9f16-422f-a0ff-6db749c5baab None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:41.130782 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc26404-9f16-422f-a0ff-6db749c5baab None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:41.131056 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc26404-9f16-422f-a0ff-6db749c5baab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:41.144261 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-79d25ff6-0c05-49af-8aa2-9cb428f3b582 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:41.145470 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-79d25ff6-0c05-49af-8aa2-9cb428f3b582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:41.149539 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-5fc26404-9f16-422f-a0ff-6db749c5baab None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:41.150725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-5fc26404-9f16-422f-a0ff-6db749c5baab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:41.154052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 773/1555] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:41.154847 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d25ff6-0c05-49af-8aa2-9cb428f3b582 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:41.162168 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 783/1556] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:41.162944 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d4935-29a7-4da6-87e2-dfd6d7aef737 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:41.163378 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d4935-29a7-4da6-87e2-dfd6d7aef737 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:41.163535 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d4935-29a7-4da6-87e2-dfd6d7aef737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:41.167606 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d25ff6-0c05-49af-8aa2-9cb428f3b582 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:41.172135 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c16e4-2451-4ac4-b04d-f7c205a58a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:41.172806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c16e4-2451-4ac4-b04d-f7c205a58a92 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:41.173087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c16e4-2451-4ac4-b04d-f7c205a58a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:41.173359 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c16e4-2451-4ac4-b04d-f7c205a58a92 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:41.174140 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c16e4-2451-4ac4-b04d-f7c205a58a92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:41.175182 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: WARNING py.warnings [None req-dd5c16e4-2451-4ac4-b04d-f7c205a58a92 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 09:33:41.175182 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: warnings.warn(msg) May 12 09:33:41.175182 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: May 12 09:33:41.176375 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c16e4-2451-4ac4-b04d-f7c205a58a92 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:41.181380 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-2d9d4935-29a7-4da6-87e2-dfd6d7aef737 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:41.182633 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-2d9d4935-29a7-4da6-87e2-dfd6d7aef737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:41.201444 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 784/1557] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:41.201444 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffdc94-128a-4058-b0c2-86da38571afe None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:41.201444 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffdc94-128a-4058-b0c2-86da38571afe None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:41.201444 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffdc94-128a-4058-b0c2-86da38571afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:41.201953 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 774/1558] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:33:41 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:33:41.201953 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d154fa-dbbc-4db7-b287-685d524ce761 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:41.201953 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d154fa-dbbc-4db7-b287-685d524ce761 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:41.201953 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d154fa-dbbc-4db7-b287-685d524ce761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:41.214106 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-21ffdc94-128a-4058-b0c2-86da38571afe None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:41.215299 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-21ffdc94-128a-4058-b0c2-86da38571afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:41.219005 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-37d154fa-dbbc-4db7-b287-685d524ce761 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:41.220138 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-37d154fa-dbbc-4db7-b287-685d524ce761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:41.223431 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 785/1559] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:41.224474 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a1406-31ff-4bdf-a0b0-2d0687037b88 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:41.224761 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a1406-31ff-4bdf-a0b0-2d0687037b88 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:41.225035 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a1406-31ff-4bdf-a0b0-2d0687037b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:41.229723 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 775/1560] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:41.230823 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9ef30-138b-42fe-b61f-f55a70aae11c None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:41.231110 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9ef30-138b-42fe-b61f-f55a70aae11c None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:41.231359 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9ef30-138b-42fe-b61f-f55a70aae11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:41.249985 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-c5a9ef30-138b-42fe-b61f-f55a70aae11c None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:41.251326 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-b90a1406-31ff-4bdf-a0b0-2d0687037b88 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:41.251459 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-c5a9ef30-138b-42fe-b61f-f55a70aae11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:41.252495 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-b90a1406-31ff-4bdf-a0b0-2d0687037b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:41.259992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 776/1561] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:41.261194 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5cefe-eddc-4183-b4cd-be59672ca52f None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:41.262693 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 786/1562] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:41.262830 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5cefe-eddc-4183-b4cd-be59672ca52f None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:41.262830 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5cefe-eddc-4183-b4cd-be59672ca52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:41.263022 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a1406-31ff-4bdf-a0b0-2d0687037b88 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:41.280572 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-7ea5cefe-eddc-4183-b4cd-be59672ca52f None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:41.281697 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-7ea5cefe-eddc-4183-b4cd-be59672ca52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:41.293430 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 777/1563] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:41.293430 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5cefe-eddc-4183-b4cd-be59672ca52f None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:41.299751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5cefe-eddc-4183-b4cd-be59672ca52f None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:41.304184 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e513710-112f-4501-9a77-7aa4cc13a3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:41.304819 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e513710-112f-4501-9a77-7aa4cc13a3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:41.305616 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e513710-112f-4501-9a77-7aa4cc13a3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:41.305886 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e513710-112f-4501-9a77-7aa4cc13a3b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:41.306664 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e513710-112f-4501-9a77-7aa4cc13a3b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:41.308236 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e513710-112f-4501-9a77-7aa4cc13a3b2 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:41.317789 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 778/1564] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:33:41.319006 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a588bc-c6a5-48b4-9f53-156f148b411c None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:41.319291 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a588bc-c6a5-48b4-9f53-156f148b411c None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:41.319566 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a588bc-c6a5-48b4-9f53-156f148b411c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:41.324674 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a1406-31ff-4bdf-a0b0-2d0687037b88 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:41.328382 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d3929-ea99-4ab3-8316-a17460189a65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:41.329083 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d3929-ea99-4ab3-8316-a17460189a65 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:41.329369 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d3929-ea99-4ab3-8316-a17460189a65 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:41.329645 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d3929-ea99-4ab3-8316-a17460189a65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:41.337162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-14a588bc-c6a5-48b4-9f53-156f148b411c None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:41.338390 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-14a588bc-c6a5-48b4-9f53-156f148b411c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:41.338972 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d3929-ea99-4ab3-8316-a17460189a65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:41.340401 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d3929-ea99-4ab3-8316-a17460189a65 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:41.346203 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 779/1565] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:41.347391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3c8cf-b13c-477b-a2b7-358bc91eb7e6 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:41.347682 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3c8cf-b13c-477b-a2b7-358bc91eb7e6 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:41.347949 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3c8cf-b13c-477b-a2b7-358bc91eb7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:41.349925 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 787/1566] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:33:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:33:41.350622 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d3929-ea99-4ab3-8316-a17460189a65 service neutron] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:41.359548 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d3929-ea99-4ab3-8316-a17460189a65 service neutron] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:41.364314 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb5d97-05b5-4f98-aafb-dc325b9d814e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:41.364965 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb5d97-05b5-4f98-aafb-dc325b9d814e admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:41.365247 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb5d97-05b5-4f98-aafb-dc325b9d814e admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:41.365520 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb5d97-05b5-4f98-aafb-dc325b9d814e admin admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:41.365642 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-eee3c8cf-b13c-477b-a2b7-358bc91eb7e6 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:41.366370 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb5d97-05b5-4f98-aafb-dc325b9d814e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:33:41.366707 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb5d97-05b5-4f98-aafb-dc325b9d814e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:41.366840 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-eee3c8cf-b13c-477b-a2b7-358bc91eb7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:41.368893 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb5d97-05b5-4f98-aafb-dc325b9d814e admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:41.378213 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 780/1567] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:41.382517 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3c8cf-b13c-477b-a2b7-358bc91eb7e6 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:41.390883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 788/1568] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:33:41.390883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb5d97-05b5-4f98-aafb-dc325b9d814e admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:41.392897 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3c8cf-b13c-477b-a2b7-358bc91eb7e6 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:41.398634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57078632-1195-4569-95b0-011fb5ecea75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:41.399336 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57078632-1195-4569-95b0-011fb5ecea75 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:41.399621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57078632-1195-4569-95b0-011fb5ecea75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:41.399897 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57078632-1195-4569-95b0-011fb5ecea75 admin admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:41.400618 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57078632-1195-4569-95b0-011fb5ecea75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:33:41.400920 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57078632-1195-4569-95b0-011fb5ecea75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:41.401153 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb5d97-05b5-4f98-aafb-dc325b9d814e admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:41.402567 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57078632-1195-4569-95b0-011fb5ecea75 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:41.406437 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebebf9-128b-419b-b27e-124698b41cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:41.407203 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebebf9-128b-419b-b27e-124698b41cfb admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:41.407559 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebebf9-128b-419b-b27e-124698b41cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:41.408019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebebf9-128b-419b-b27e-124698b41cfb admin admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:41.408736 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baebebf9-128b-419b-b27e-124698b41cfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:33:41.409083 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baebebf9-128b-419b-b27e-124698b41cfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:41.410811 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baebebf9-128b-419b-b27e-124698b41cfb admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:41.414755 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 781/1569] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:33:41.422721 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57078632-1195-4569-95b0-011fb5ecea75 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:41.431440 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 789/1570] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:33:41.431440 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebebf9-128b-419b-b27e-124698b41cfb admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:41.439038 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57078632-1195-4569-95b0-011fb5ecea75 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:41.439238 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebebf9-128b-419b-b27e-124698b41cfb admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:41.446378 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e03ea3-b580-457d-a7e5-b9ce8bd7b143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:41.447164 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87c476-7f69-4a71-bd13-9df8f55cf859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:41.447330 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e03ea3-b580-457d-a7e5-b9ce8bd7b143 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:41.447581 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e03ea3-b580-457d-a7e5-b9ce8bd7b143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:41.447923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e03ea3-b580-457d-a7e5-b9ce8bd7b143 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:41.448089 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87c476-7f69-4a71-bd13-9df8f55cf859 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:41.448433 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87c476-7f69-4a71-bd13-9df8f55cf859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:41.448768 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87c476-7f69-4a71-bd13-9df8f55cf859 admin admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:41.448879 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e03ea3-b580-457d-a7e5-b9ce8bd7b143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:41.449619 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87c476-7f69-4a71-bd13-9df8f55cf859 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:33:41.450019 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87c476-7f69-4a71-bd13-9df8f55cf859 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:41.450728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e03ea3-b580-457d-a7e5-b9ce8bd7b143 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:41.451715 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87c476-7f69-4a71-bd13-9df8f55cf859 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:41.461567 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 790/1571] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:33:41.462469 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e03ea3-b580-457d-a7e5-b9ce8bd7b143 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:41.469117 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 782/1572] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:33:41.470324 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87c476-7f69-4a71-bd13-9df8f55cf859 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:41.480213 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e03ea3-b580-457d-a7e5-b9ce8bd7b143 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:41.480770 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87c476-7f69-4a71-bd13-9df8f55cf859 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:41.485601 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936276dd-16b1-4c08-900a-f971870b506f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:41.485829 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577b8ba-4f6b-41df-aac7-5f6a94bffdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:41.486300 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936276dd-16b1-4c08-900a-f971870b506f admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:41.486586 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936276dd-16b1-4c08-900a-f971870b506f admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:41.486695 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577b8ba-4f6b-41df-aac7-5f6a94bffdfb admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:41.486860 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936276dd-16b1-4c08-900a-f971870b506f admin admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:41.487063 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577b8ba-4f6b-41df-aac7-5f6a94bffdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:41.487398 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577b8ba-4f6b-41df-aac7-5f6a94bffdfb admin admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:41.487585 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936276dd-16b1-4c08-900a-f971870b506f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:33:41.487887 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936276dd-16b1-4c08-900a-f971870b506f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:41.488284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577b8ba-4f6b-41df-aac7-5f6a94bffdfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:33:41.488649 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577b8ba-4f6b-41df-aac7-5f6a94bffdfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:41.489584 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936276dd-16b1-4c08-900a-f971870b506f admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:41.490451 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577b8ba-4f6b-41df-aac7-5f6a94bffdfb admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:41.503347 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 783/1573] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:33:41.504360 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936276dd-16b1-4c08-900a-f971870b506f admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:41.518830 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936276dd-16b1-4c08-900a-f971870b506f admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:41.523101 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b2bac-e903-4185-8d65-0ce08daad371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:41.523889 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b2bac-e903-4185-8d65-0ce08daad371 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:41.524416 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b2bac-e903-4185-8d65-0ce08daad371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:41.524901 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b2bac-e903-4185-8d65-0ce08daad371 admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:41.525632 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b2bac-e903-4185-8d65-0ce08daad371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:41.529004 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b2bac-e903-4185-8d65-0ce08daad371 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:41.537328 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 791/1574] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:33:41.537328 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577b8ba-4f6b-41df-aac7-5f6a94bffdfb admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:41.546968 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577b8ba-4f6b-41df-aac7-5f6a94bffdfb admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:41.552193 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a543bd-8991-4c9c-adeb-f1edd43280dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:41.552847 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a543bd-8991-4c9c-adeb-f1edd43280dd admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:41.553127 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a543bd-8991-4c9c-adeb-f1edd43280dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:41.553398 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a543bd-8991-4c9c-adeb-f1edd43280dd admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:41.554118 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a543bd-8991-4c9c-adeb-f1edd43280dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:41.555676 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: WARNING py.warnings [None req-b7a543bd-8991-4c9c-adeb-f1edd43280dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 09:33:41.555676 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: warnings.warn(msg) May 12 09:33:41.555676 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: May 12 09:33:41.556855 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a543bd-8991-4c9c-adeb-f1edd43280dd admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:41.572295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 784/1575] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:33:41 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:33:41.572295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b2bac-e903-4185-8d65-0ce08daad371 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:41.589467 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 792/1576] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:33:41 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:33:41.590654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a543bd-8991-4c9c-adeb-f1edd43280dd admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:41.643702 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b2bac-e903-4185-8d65-0ce08daad371 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:41.663400 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a543bd-8991-4c9c-adeb-f1edd43280dd admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:41.670082 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fe089-e89c-46c6-87e9-090941320020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:41.671470 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fe089-e89c-46c6-87e9-090941320020 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:41.672032 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fe089-e89c-46c6-87e9-090941320020 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:41.672406 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fe089-e89c-46c6-87e9-090941320020 admin admin] PATH_INFO: `/v3/projects/48c6ab5a0a864171975aad8723b3ede8/users/b5b210bfb3f645348f521d7e2aee6bd1/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:41.699478 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fe089-e89c-46c6-87e9-090941320020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48c6ab5a0a864171975aad8723b3ede8, user_id=b5b210bfb3f645348f521d7e2aee6bd1, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:41.703964 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fe089-e89c-46c6-87e9-090941320020 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:41.723918 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 793/1577] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:33:41 2022] PUT /identity/v3/projects/48c6ab5a0a864171975aad8723b3ede8/users/b5b210bfb3f645348f521d7e2aee6bd1/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:33:41.725189 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fe089-e89c-46c6-87e9-090941320020 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:41.739263 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65ca14-9379-4cdd-a428-2845a9bf1619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:41.740795 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65ca14-9379-4cdd-a428-2845a9bf1619 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:41.741443 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65ca14-9379-4cdd-a428-2845a9bf1619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:41.742495 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65ca14-9379-4cdd-a428-2845a9bf1619 admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:41.743373 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65ca14-9379-4cdd-a428-2845a9bf1619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:41.752559 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65ca14-9379-4cdd-a428-2845a9bf1619 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:41.788881 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 785/1578] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:33:41 2022] POST /identity/v3/projects => generated 375 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:33:41.790687 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65ca14-9379-4cdd-a428-2845a9bf1619 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:41.813199 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fe089-e89c-46c6-87e9-090941320020 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:41.870743 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65ca14-9379-4cdd-a428-2845a9bf1619 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:41.876282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b78a0c-5be3-4389-bfb6-9a080f87b0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:41.877170 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b78a0c-5be3-4389-bfb6-9a080f87b0e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:41.877486 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b78a0c-5be3-4389-bfb6-9a080f87b0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:41.877841 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b78a0c-5be3-4389-bfb6-9a080f87b0e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:41.878621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b78a0c-5be3-4389-bfb6-9a080f87b0e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:41.878979 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5eaeca-14dc-4acd-92cb-ebf659b296fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:41.879795 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5eaeca-14dc-4acd-92cb-ebf659b296fb admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:41.880076 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5eaeca-14dc-4acd-92cb-ebf659b296fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:41.880351 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5eaeca-14dc-4acd-92cb-ebf659b296fb admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:41.880854 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b78a0c-5be3-4389-bfb6-9a080f87b0e1 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:41.881038 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5eaeca-14dc-4acd-92cb-ebf659b296fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:41.882975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5eaeca-14dc-4acd-92cb-ebf659b296fb admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:41.907657 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 786/1579] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:33:41 2022] POST /identity/v3/projects => generated 369 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:33:41.908539 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b78a0c-5be3-4389-bfb6-9a080f87b0e1 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:41.913000 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 794/1580] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:33:41 2022] POST /identity/v3/projects => generated 391 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:33:41.913000 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5eaeca-14dc-4acd-92cb-ebf659b296fb admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:41.977979 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5eaeca-14dc-4acd-92cb-ebf659b296fb admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:41.981620 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb518102-c2b3-4478-a7d1-4a34b8075188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:41.982355 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb518102-c2b3-4478-a7d1-4a34b8075188 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:41.982761 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb518102-c2b3-4478-a7d1-4a34b8075188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:41.983785 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb518102-c2b3-4478-a7d1-4a34b8075188 admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:41.983785 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb518102-c2b3-4478-a7d1-4a34b8075188 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:41.985667 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb518102-c2b3-4478-a7d1-4a34b8075188 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:41.987764 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b78a0c-5be3-4389-bfb6-9a080f87b0e1 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:41.994087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18acdf50-2fc7-4f04-9003-f8e7717659a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:41.994257 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acdf50-2fc7-4f04-9003-f8e7717659a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:41.994526 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acdf50-2fc7-4f04-9003-f8e7717659a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:41.994895 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acdf50-2fc7-4f04-9003-f8e7717659a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:41.995502 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18acdf50-2fc7-4f04-9003-f8e7717659a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:41.997778 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18acdf50-2fc7-4f04-9003-f8e7717659a4 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:42.015937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 795/1581] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:33:41 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:33:42.016844 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb518102-c2b3-4478-a7d1-4a34b8075188 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:42.031933 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb518102-c2b3-4478-a7d1-4a34b8075188 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:42.034115 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 787/1582] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:33:41 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:33:42.036081 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac63364-96b1-4bd6-a0fb-28876572ff5e None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:42.036532 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac63364-96b1-4bd6-a0fb-28876572ff5e None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:42.037156 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac63364-96b1-4bd6-a0fb-28876572ff5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:42.080478 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-2ac63364-96b1-4bd6-a0fb-28876572ff5e None None] MFA Rules not processed for user `b5b210bfb3f645348f521d7e2aee6bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:42.082713 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-2ac63364-96b1-4bd6-a0fb-28876572ff5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:42.100985 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf8e95-27ab-46b9-9669-37fbb7764a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:42.104070 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf8e95-27ab-46b9-9669-37fbb7764a2a admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:42.105534 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf8e95-27ab-46b9-9669-37fbb7764a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:42.107035 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf8e95-27ab-46b9-9669-37fbb7764a2a admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:42.109424 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf8e95-27ab-46b9-9669-37fbb7764a2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:42.112005 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf8e95-27ab-46b9-9669-37fbb7764a2a admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:42.137090 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 796/1583] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:33:42 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:33:42.138077 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf8e95-27ab-46b9-9669-37fbb7764a2a admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:42.149696 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf8e95-27ab-46b9-9669-37fbb7764a2a admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:42.154041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb2db0-c605-4b21-bf38-7f3fe46e468c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:42.154827 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb2db0-c605-4b21-bf38-7f3fe46e468c admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:42.155202 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb2db0-c605-4b21-bf38-7f3fe46e468c admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:42.155583 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb2db0-c605-4b21-bf38-7f3fe46e468c admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:42.156493 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb2db0-c605-4b21-bf38-7f3fe46e468c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:42.159319 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb2db0-c605-4b21-bf38-7f3fe46e468c admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:42.183613 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 797/1584] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:33:42 2022] POST /identity/v3/users => generated 288 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:33:42.184674 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb2db0-c605-4b21-bf38-7f3fe46e468c admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:42.196325 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb2db0-c605-4b21-bf38-7f3fe46e468c admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:42.202158 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 788/1585] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:42.202459 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da082154-2101-4aad-bef2-e3b84171accf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:42.203264 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da082154-2101-4aad-bef2-e3b84171accf admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:42.203510 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac63364-96b1-4bd6-a0fb-28876572ff5e None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:42.203730 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da082154-2101-4aad-bef2-e3b84171accf admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:42.204102 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da082154-2101-4aad-bef2-e3b84171accf admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:42.204892 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da082154-2101-4aad-bef2-e3b84171accf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:42.207260 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da082154-2101-4aad-bef2-e3b84171accf admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:42.234650 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac63364-96b1-4bd6-a0fb-28876572ff5e None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:42.239916 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 798/1586] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:33:42 2022] POST /identity/v3/users => generated 285 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:33:42.240539 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176e4cb-5d7f-4af9-b424-d539f1a8a5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:42.241480 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176e4cb-5d7f-4af9-b424-d539f1a8a5bd admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:42.241784 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da082154-2101-4aad-bef2-e3b84171accf admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:42.242115 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176e4cb-5d7f-4af9-b424-d539f1a8a5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:42.242605 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176e4cb-5d7f-4af9-b424-d539f1a8a5bd admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:42.243631 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176e4cb-5d7f-4af9-b424-d539f1a8a5bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:42.246068 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176e4cb-5d7f-4af9-b424-d539f1a8a5bd admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:42.257250 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da082154-2101-4aad-bef2-e3b84171accf admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:42.264528 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe2b70-217a-41b0-b4c8-d7768b7a9386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:42.265322 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe2b70-217a-41b0-b4c8-d7768b7a9386 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:42.265827 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe2b70-217a-41b0-b4c8-d7768b7a9386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:42.266240 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe2b70-217a-41b0-b4c8-d7768b7a9386 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:42.267085 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe2b70-217a-41b0-b4c8-d7768b7a9386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:42.268969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe2b70-217a-41b0-b4c8-d7768b7a9386 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:42.274783 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 789/1587] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:33:42 2022] POST /identity/v3/users => generated 296 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:33:42.276537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176e4cb-5d7f-4af9-b424-d539f1a8a5bd admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:42.280615 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 799/1588] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:33:42.285050 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe2b70-217a-41b0-b4c8-d7768b7a9386 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:42.289288 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176e4cb-5d7f-4af9-b424-d539f1a8a5bd admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:42.296355 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a96b3-075f-4f53-9374-c9fa2d30637a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:42.297325 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a96b3-075f-4f53-9374-c9fa2d30637a admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:42.297522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe2b70-217a-41b0-b4c8-d7768b7a9386 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:42.297958 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a96b3-075f-4f53-9374-c9fa2d30637a admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:42.298503 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a96b3-075f-4f53-9374-c9fa2d30637a admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:42.299646 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a96b3-075f-4f53-9374-c9fa2d30637a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:42.302574 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a96b3-075f-4f53-9374-c9fa2d30637a admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:42.303619 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffffe5-0abb-4bee-ad1d-b9ad48ee5090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:42.304781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffffe5-0abb-4bee-ad1d-b9ad48ee5090 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:42.305038 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffffe5-0abb-4bee-ad1d-b9ad48ee5090 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:42.305318 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffffe5-0abb-4bee-ad1d-b9ad48ee5090 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:42.306082 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ffffe5-0abb-4bee-ad1d-b9ad48ee5090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:42.308060 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ffffe5-0abb-4bee-ad1d-b9ad48ee5090 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:42.320232 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 800/1589] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:33:42.321377 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffffe5-0abb-4bee-ad1d-b9ad48ee5090 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:42.333451 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 790/1590] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:33:42 2022] POST /identity/v3/users => generated 290 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:33:42.334849 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7ae80-fd2b-4268-b7f0-4e1738f104fc None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:42.335133 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7ae80-fd2b-4268-b7f0-4e1738f104fc None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:42.335397 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7ae80-fd2b-4268-b7f0-4e1738f104fc None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:42.337392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 791/1591] 10.222.0.60 () {54 vars in 961 bytes} [Thu May 12 09:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:33:42.341443 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffffe5-0abb-4bee-ad1d-b9ad48ee5090 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:42.343403 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7ae80-fd2b-4268-b7f0-4e1738f104fc None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:42.348591 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805463f-c6b0-4140-bf5a-54fa3d363946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:42.349427 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805463f-c6b0-4140-bf5a-54fa3d363946 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:42.349808 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805463f-c6b0-4140-bf5a-54fa3d363946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:42.350240 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805463f-c6b0-4140-bf5a-54fa3d363946 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:42.351117 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805463f-c6b0-4140-bf5a-54fa3d363946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:42.353779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805463f-c6b0-4140-bf5a-54fa3d363946 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:42.358807 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7ae80-fd2b-4268-b7f0-4e1738f104fc None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:42.364134 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c105f36-207a-42ea-bc3a-dee031e496ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:42.364784 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c105f36-207a-42ea-bc3a-dee031e496ad admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:42.365063 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c105f36-207a-42ea-bc3a-dee031e496ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:42.365337 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c105f36-207a-42ea-bc3a-dee031e496ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:42.366516 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c105f36-207a-42ea-bc3a-dee031e496ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:42.367824 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 801/1592] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:33:42.367966 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c105f36-207a-42ea-bc3a-dee031e496ad admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:42.368900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805463f-c6b0-4140-bf5a-54fa3d363946 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:42.379350 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805463f-c6b0-4140-bf5a-54fa3d363946 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:42.383768 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 792/1593] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:33:42.383768 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c105f36-207a-42ea-bc3a-dee031e496ad admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:42.385212 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e746340-cc6b-4cef-9694-3a81ed1bd075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:42.386054 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e746340-cc6b-4cef-9694-3a81ed1bd075 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:42.386435 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e746340-cc6b-4cef-9694-3a81ed1bd075 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:42.386808 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e746340-cc6b-4cef-9694-3a81ed1bd075 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:42.387636 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e746340-cc6b-4cef-9694-3a81ed1bd075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:42.389336 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e746340-cc6b-4cef-9694-3a81ed1bd075 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:42.394048 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c105f36-207a-42ea-bc3a-dee031e496ad admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:42.400799 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff3846-edde-4cfe-bada-6ae51815a729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:42.401328 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 802/1594] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:33:42.401457 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff3846-edde-4cfe-bada-6ae51815a729 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:42.401716 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff3846-edde-4cfe-bada-6ae51815a729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:42.402016 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff3846-edde-4cfe-bada-6ae51815a729 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:42.402799 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e746340-cc6b-4cef-9694-3a81ed1bd075 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:42.403034 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff3846-edde-4cfe-bada-6ae51815a729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:42.404886 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff3846-edde-4cfe-bada-6ae51815a729 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:42.413763 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e746340-cc6b-4cef-9694-3a81ed1bd075 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:42.416001 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 793/1595] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:33:42.416666 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff3846-edde-4cfe-bada-6ae51815a729 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:42.423000 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362328d-ac52-4653-aa7e-96bba94a94e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:42.423753 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362328d-ac52-4653-aa7e-96bba94a94e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:42.424106 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362328d-ac52-4653-aa7e-96bba94a94e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:42.424585 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362328d-ac52-4653-aa7e-96bba94a94e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:42.425467 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362328d-ac52-4653-aa7e-96bba94a94e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:42.427116 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362328d-ac52-4653-aa7e-96bba94a94e9 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:42.430200 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff3846-edde-4cfe-bada-6ae51815a729 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:42.436313 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e0b9c-3a4a-4e91-b30b-6abb946dbfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:42.436985 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e0b9c-3a4a-4e91-b30b-6abb946dbfda admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:42.437314 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e0b9c-3a4a-4e91-b30b-6abb946dbfda admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:42.437589 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e0b9c-3a4a-4e91-b30b-6abb946dbfda admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:42.438344 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e0b9c-3a4a-4e91-b30b-6abb946dbfda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:42.442291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 803/1596] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:33:42.442438 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e0b9c-3a4a-4e91-b30b-6abb946dbfda admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:42.442557 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1ef2a-97ed-4635-9564-5ea7314f66a9 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:42.442557 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1ef2a-97ed-4635-9564-5ea7314f66a9 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:42.442557 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1ef2a-97ed-4635-9564-5ea7314f66a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:42.454574 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 794/1597] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:33:42.455496 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e0b9c-3a4a-4e91-b30b-6abb946dbfda admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:42.467023 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-e2b1ef2a-97ed-4635-9564-5ea7314f66a9 None None] MFA Rules not processed for user `2915babd40aa42e8bf7cc85c5a97daa6`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:42.468727 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e0b9c-3a4a-4e91-b30b-6abb946dbfda admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:42.469207 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-e2b1ef2a-97ed-4635-9564-5ea7314f66a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:42.474585 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95c5a9-9913-49b5-b851-24a32129e9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:42.475352 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95c5a9-9913-49b5-b851-24a32129e9bf admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:42.475697 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95c5a9-9913-49b5-b851-24a32129e9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:42.476353 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95c5a9-9913-49b5-b851-24a32129e9bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:42.476840 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95c5a9-9913-49b5-b851-24a32129e9bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:42.478826 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95c5a9-9913-49b5-b851-24a32129e9bf admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:42.491909 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 795/1598] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:33:42.493074 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95c5a9-9913-49b5-b851-24a32129e9bf admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:42.504221 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95c5a9-9913-49b5-b851-24a32129e9bf admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:42.515572 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a07d14-4025-4f97-a3d3-46bfc2a68d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:42.516507 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a07d14-4025-4f97-a3d3-46bfc2a68d5d admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:42.517655 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a07d14-4025-4f97-a3d3-46bfc2a68d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:42.518079 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a07d14-4025-4f97-a3d3-46bfc2a68d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:42.519022 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a07d14-4025-4f97-a3d3-46bfc2a68d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:42.521284 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a07d14-4025-4f97-a3d3-46bfc2a68d5d admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:42.537068 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 796/1599] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:33:42.538129 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a07d14-4025-4f97-a3d3-46bfc2a68d5d admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:42.560036 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a07d14-4025-4f97-a3d3-46bfc2a68d5d admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:42.565745 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b9742-cad6-4482-91fe-0a684fec0f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:42.565967 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 804/1600] 10.222.0.60 () {58 vars in 1058 bytes} [Thu May 12 09:33:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:42.566885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1ef2a-97ed-4635-9564-5ea7314f66a9 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:42.567792 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b9742-cad6-4482-91fe-0a684fec0f05 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:42.568055 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b9742-cad6-4482-91fe-0a684fec0f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:42.568333 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b9742-cad6-4482-91fe-0a684fec0f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:42.569205 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b9742-cad6-4482-91fe-0a684fec0f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:42.571509 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b9742-cad6-4482-91fe-0a684fec0f05 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:42.583387 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1ef2a-97ed-4635-9564-5ea7314f66a9 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:42.584483 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 797/1601] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:33:42.585381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b9742-cad6-4482-91fe-0a684fec0f05 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:42.593840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa117bc-69b2-4e1f-a81c-2b599b789933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:42.594913 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa117bc-69b2-4e1f-a81c-2b599b789933 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:42.595315 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa117bc-69b2-4e1f-a81c-2b599b789933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:42.595687 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa117bc-69b2-4e1f-a81c-2b599b789933 admin admin] PATH_INFO: `/v3/projects/e24c3b4bb7dd44c68884a021507f7e5e/users/d2a7bfec6c8140e2bd633d6184ad4716/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:42.597474 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b9742-cad6-4482-91fe-0a684fec0f05 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:42.603600 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451df56-2293-49e5-b31e-0a67ea928b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:42.604503 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451df56-2293-49e5-b31e-0a67ea928b75 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:42.604785 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451df56-2293-49e5-b31e-0a67ea928b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:42.605059 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451df56-2293-49e5-b31e-0a67ea928b75 admin admin] PATH_INFO: `/v3/projects/1c9a6b59c9c04ea9ae9175d560f79471/users/5198751821904f849fea5424aa8f16ed/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:42.615324 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa117bc-69b2-4e1f-a81c-2b599b789933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e24c3b4bb7dd44c68884a021507f7e5e, user_id=d2a7bfec6c8140e2bd633d6184ad4716, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:42.618413 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa117bc-69b2-4e1f-a81c-2b599b789933 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:42.622453 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451df56-2293-49e5-b31e-0a67ea928b75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c9a6b59c9c04ea9ae9175d560f79471, user_id=5198751821904f849fea5424aa8f16ed, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:42.626215 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451df56-2293-49e5-b31e-0a67ea928b75 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:42.653941 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 805/1602] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:33:42 2022] PUT /identity/v3/projects/e24c3b4bb7dd44c68884a021507f7e5e/users/d2a7bfec6c8140e2bd633d6184ad4716/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:33:42.653941 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa117bc-69b2-4e1f-a81c-2b599b789933 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:42.673087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 798/1603] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:33:42 2022] PUT /identity/v3/projects/1c9a6b59c9c04ea9ae9175d560f79471/users/5198751821904f849fea5424aa8f16ed/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:33:42.674392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451df56-2293-49e5-b31e-0a67ea928b75 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:42.764928 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451df56-2293-49e5-b31e-0a67ea928b75 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:42.770483 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa117bc-69b2-4e1f-a81c-2b599b789933 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:42.775682 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0593b3a-2492-4c70-bf67-aea0d1d3c3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:42.776500 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0593b3a-2492-4c70-bf67-aea0d1d3c3aa admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:42.776911 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0593b3a-2492-4c70-bf67-aea0d1d3c3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:42.777289 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0593b3a-2492-4c70-bf67-aea0d1d3c3aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:42.778691 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0593b3a-2492-4c70-bf67-aea0d1d3c3aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:42.780143 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0593b3a-2492-4c70-bf67-aea0d1d3c3aa admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:42.781612 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d121e2-ee7e-44bf-b7ff-7c66d1c4d799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:42.782879 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d121e2-ee7e-44bf-b7ff-7c66d1c4d799 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:42.782879 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d121e2-ee7e-44bf-b7ff-7c66d1c4d799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:42.783123 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d121e2-ee7e-44bf-b7ff-7c66d1c4d799 admin admin] PATH_INFO: `/v3/projects/da5b9f41ad6b4506872df6cb86ae9f73/users/2efdff1c390f4271963e932af8abd473/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:42.794427 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 806/1604] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:33:42.795554 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0593b3a-2492-4c70-bf67-aea0d1d3c3aa admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:42.810258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0593b3a-2492-4c70-bf67-aea0d1d3c3aa admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:42.817706 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7718d2-48d9-4e22-a608-2f6787a32950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:42.817952 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d121e2-ee7e-44bf-b7ff-7c66d1c4d799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da5b9f41ad6b4506872df6cb86ae9f73, user_id=2efdff1c390f4271963e932af8abd473, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:42.818901 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7718d2-48d9-4e22-a608-2f6787a32950 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:42.819251 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7718d2-48d9-4e22-a608-2f6787a32950 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:42.819623 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7718d2-48d9-4e22-a608-2f6787a32950 admin admin] PATH_INFO: `/v3/projects/41d0e0ef37804da4be700d34a3bcf7fd/users/29301accbeba4ea3b468aa59fcc3eab4/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:42.823438 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d121e2-ee7e-44bf-b7ff-7c66d1c4d799 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:42.846787 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 799/1605] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:33:42 2022] PUT /identity/v3/projects/da5b9f41ad6b4506872df6cb86ae9f73/users/2efdff1c390f4271963e932af8abd473/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:33:42.848285 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d121e2-ee7e-44bf-b7ff-7c66d1c4d799 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:42.862688 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7718d2-48d9-4e22-a608-2f6787a32950 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41d0e0ef37804da4be700d34a3bcf7fd, user_id=29301accbeba4ea3b468aa59fcc3eab4, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:42.866195 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7718d2-48d9-4e22-a608-2f6787a32950 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:42.882570 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 807/1606] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:33:42 2022] PUT /identity/v3/projects/41d0e0ef37804da4be700d34a3bcf7fd/users/29301accbeba4ea3b468aa59fcc3eab4/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:33:42.883526 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7718d2-48d9-4e22-a608-2f6787a32950 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:42.959328 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d121e2-ee7e-44bf-b7ff-7c66d1c4d799 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:42.959519 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7718d2-48d9-4e22-a608-2f6787a32950 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:42.965141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05f7ef-bbbe-4c57-97ee-026327d06473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:42.966395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05f7ef-bbbe-4c57-97ee-026327d06473 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:42.966676 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05f7ef-bbbe-4c57-97ee-026327d06473 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:42.966948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05f7ef-bbbe-4c57-97ee-026327d06473 admin admin] PATH_INFO: `/v3/projects/c54669eadc784d4aac5d1a40d18858b1/users/0b01be56426e4ff1a09577f30fb79f0b/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:42.983862 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05f7ef-bbbe-4c57-97ee-026327d06473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c54669eadc784d4aac5d1a40d18858b1, user_id=0b01be56426e4ff1a09577f30fb79f0b, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:42.987845 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05f7ef-bbbe-4c57-97ee-026327d06473 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:43.015422 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 808/1607] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:33:42 2022] PUT /identity/v3/projects/c54669eadc784d4aac5d1a40d18858b1/users/0b01be56426e4ff1a09577f30fb79f0b/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:33:43.015422 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc5a42-8d33-4eaf-85ea-2b26a5fb1a87 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:43.015422 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc5a42-8d33-4eaf-85ea-2b26a5fb1a87 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:43.015422 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc5a42-8d33-4eaf-85ea-2b26a5fb1a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:43.085027 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-8afc5a42-8d33-4eaf-85ea-2b26a5fb1a87 None None] MFA Rules not processed for user `d2a7bfec6c8140e2bd633d6184ad4716`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:43.087202 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-8afc5a42-8d33-4eaf-85ea-2b26a5fb1a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:43.110137 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c4bd4-97af-49fe-bc95-206ef67987f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:43.110812 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c4bd4-97af-49fe-bc95-206ef67987f6 service nova] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:43.111094 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c4bd4-97af-49fe-bc95-206ef67987f6 service nova] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:43.111368 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c4bd4-97af-49fe-bc95-206ef67987f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:43.182490 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 809/1608] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:43.186850 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173381b-b541-46c9-83c4-ecc4ad41407c None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:43.187435 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173381b-b541-46c9-83c4-ecc4ad41407c None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:43.192042 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173381b-b541-46c9-83c4-ecc4ad41407c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:43.194198 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c4bd4-97af-49fe-bc95-206ef67987f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:43.197217 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c4bd4-97af-49fe-bc95-206ef67987f6 service nova] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:43.210942 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 800/1609] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:33:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:33:43.212989 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c4bd4-97af-49fe-bc95-206ef67987f6 service nova] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:43.223779 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c4bd4-97af-49fe-bc95-206ef67987f6 service nova] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:43.228478 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-7173381b-b541-46c9-83c4-ecc4ad41407c None None] MFA Rules not processed for user `5198751821904f849fea5424aa8f16ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:43.229692 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-7173381b-b541-46c9-83c4-ecc4ad41407c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:43.302554 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b6e81-fbce-470b-a876-1ff8439a99fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:43.305330 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b6e81-fbce-470b-a876-1ff8439a99fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:43.305750 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b6e81-fbce-470b-a876-1ff8439a99fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:43.306151 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b6e81-fbce-470b-a876-1ff8439a99fa admin admin] PATH_INFO: `/v3/projects/2de1508e265140e5801827175c7da941/users/ded41aae383242789d1e468372767efb/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:43.317101 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 810/1610] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:43.317101 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4fb1d-0ee8-46e9-b583-d956481eac95 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:43.317101 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4fb1d-0ee8-46e9-b583-d956481eac95 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:43.317101 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4fb1d-0ee8-46e9-b583-d956481eac95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:43.325133 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b6e81-fbce-470b-a876-1ff8439a99fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2de1508e265140e5801827175c7da941, user_id=ded41aae383242789d1e468372767efb, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:43.327926 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b6e81-fbce-470b-a876-1ff8439a99fa admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:43.340584 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-31d4fb1d-0ee8-46e9-b583-d956481eac95 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:43.343110 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-31d4fb1d-0ee8-46e9-b583-d956481eac95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:43.346429 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 801/1611] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:33:43 2022] PUT /identity/v3/projects/2de1508e265140e5801827175c7da941/users/ded41aae383242789d1e468372767efb/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:33:43.348661 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35510cf2-80ee-4cc4-a6ab-1abeb4424cfe None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:43.349060 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35510cf2-80ee-4cc4-a6ab-1abeb4424cfe None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:43.349703 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35510cf2-80ee-4cc4-a6ab-1abeb4424cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:43.388595 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-35510cf2-80ee-4cc4-a6ab-1abeb4424cfe None None] MFA Rules not processed for user `29301accbeba4ea3b468aa59fcc3eab4`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:43.390517 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-35510cf2-80ee-4cc4-a6ab-1abeb4424cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:43.442825 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 811/1612] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:43.444083 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e2d89-9296-46f8-8b6d-1567597ebc8d None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:43.444377 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e2d89-9296-46f8-8b6d-1567597ebc8d None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:43.444652 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e2d89-9296-46f8-8b6d-1567597ebc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:43.476179 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-f86e2d89-9296-46f8-8b6d-1567597ebc8d None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:43.477568 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-f86e2d89-9296-46f8-8b6d-1567597ebc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:43.488275 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 812/1613] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:43.489958 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9762d89-df99-40ab-ad12-15220fb243b6 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:43.490459 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9762d89-df99-40ab-ad12-15220fb243b6 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:43.491010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9762d89-df99-40ab-ad12-15220fb243b6 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:43.492954 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 813/1614] 10.222.0.60 () {54 vars in 961 bytes} [Thu May 12 09:33:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:33:43.493844 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9762d89-df99-40ab-ad12-15220fb243b6 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:43.500815 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 802/1615] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:43.502114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6dbf7-6448-4163-977f-16511b5668b8 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:43.502883 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6dbf7-6448-4163-977f-16511b5668b8 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:43.502883 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6dbf7-6448-4163-977f-16511b5668b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:43.507496 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9762d89-df99-40ab-ad12-15220fb243b6 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:43.512880 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f31d7a-8f39-4a90-b64f-919db24f5e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:43.513537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f31d7a-8f39-4a90-b64f-919db24f5e9f admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:43.513821 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f31d7a-8f39-4a90-b64f-919db24f5e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:43.514143 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f31d7a-8f39-4a90-b64f-919db24f5e9f admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:43.514837 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f31d7a-8f39-4a90-b64f-919db24f5e9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:43.516803 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f31d7a-8f39-4a90-b64f-919db24f5e9f admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:43.520982 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-45c6dbf7-6448-4163-977f-16511b5668b8 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:43.522708 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-45c6dbf7-6448-4163-977f-16511b5668b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:43.534501 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 803/1616] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:43.534501 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6dbf7-6448-4163-977f-16511b5668b8 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:43.534501 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-45c6dbf7-6448-4163-977f-16511b5668b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:43.550383 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 814/1617] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:33:43 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:33:43.551801 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d053b8d-ccec-4367-a8f2-83e05bf97c91 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:43.552155 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d053b8d-ccec-4367-a8f2-83e05bf97c91 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:43.552497 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d053b8d-ccec-4367-a8f2-83e05bf97c91 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:43.559908 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 815/1618] 10.222.0.60 () {54 vars in 912 bytes} [Thu May 12 09:33:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:33:43.560915 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d053b8d-ccec-4367-a8f2-83e05bf97c91 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:43.562750 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-5d053b8d-ccec-4367-a8f2-83e05bf97c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:43.602771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6dbf7-6448-4163-977f-16511b5668b8 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:43.648505 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d053b8d-ccec-4367-a8f2-83e05bf97c91 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:43.654142 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ce9fc-38e9-4b43-aaf0-af2f9517c2c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:43.655946 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ce9fc-38e9-4b43-aaf0-af2f9517c2c0 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:43.656357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ce9fc-38e9-4b43-aaf0-af2f9517c2c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:43.656834 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ce9fc-38e9-4b43-aaf0-af2f9517c2c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:43.660718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282efcc3-cef0-425f-87dc-33ee83349738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:43.661436 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282efcc3-cef0-425f-87dc-33ee83349738 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:43.661719 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282efcc3-cef0-425f-87dc-33ee83349738 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:43.662101 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282efcc3-cef0-425f-87dc-33ee83349738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:43.734691 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ce9fc-38e9-4b43-aaf0-af2f9517c2c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:43.736354 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282efcc3-cef0-425f-87dc-33ee83349738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:43.736561 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ce9fc-38e9-4b43-aaf0-af2f9517c2c0 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:43.737811 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282efcc3-cef0-425f-87dc-33ee83349738 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:43.750656 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 816/1619] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:33:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:33:43.751494 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 804/1620] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:33:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:33:43.751799 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7bc8a-c452-449c-8f40-da22b389fa74 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:43.752086 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7bc8a-c452-449c-8f40-da22b389fa74 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:43.752358 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7bc8a-c452-449c-8f40-da22b389fa74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:43.753153 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282efcc3-cef0-425f-87dc-33ee83349738 service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:43.766915 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282efcc3-cef0-425f-87dc-33ee83349738 service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:43.771542 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-1dc7bc8a-c452-449c-8f40-da22b389fa74 None None] MFA Rules not processed for user `2915babd40aa42e8bf7cc85c5a97daa6`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:43.773984 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-1dc7bc8a-c452-449c-8f40-da22b389fa74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:43.774714 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc620315-c7f5-4cab-8c0c-964069f43533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:43.775472 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc620315-c7f5-4cab-8c0c-964069f43533 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:43.775822 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc620315-c7f5-4cab-8c0c-964069f43533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:43.776159 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc620315-c7f5-4cab-8c0c-964069f43533 admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:43.776928 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc620315-c7f5-4cab-8c0c-964069f43533 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:43.779180 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc620315-c7f5-4cab-8c0c-964069f43533 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:43.831059 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 805/1621] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:33:43 2022] POST /identity/v3/projects => generated 369 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:33:43.835545 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc620315-c7f5-4cab-8c0c-964069f43533 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:43.881239 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 817/1622] 10.222.0.60 () {58 vars in 1058 bytes} [Thu May 12 09:33:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:43.882385 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7bc8a-c452-449c-8f40-da22b389fa74 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:43.902663 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7bc8a-c452-449c-8f40-da22b389fa74 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:43.936741 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc620315-c7f5-4cab-8c0c-964069f43533 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:43.941072 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b5f08-3ffd-49b6-93c1-a967dd3409ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:43.941829 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b5f08-3ffd-49b6-93c1-a967dd3409ca service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:43.942141 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b5f08-3ffd-49b6-93c1-a967dd3409ca service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:43.942629 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b5f08-3ffd-49b6-93c1-a967dd3409ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:44.006166 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44898d37-e4a3-4de3-93b4-9cde4037ec74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:44.007586 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44898d37-e4a3-4de3-93b4-9cde4037ec74 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:44.009236 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44898d37-e4a3-4de3-93b4-9cde4037ec74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:44.009734 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44898d37-e4a3-4de3-93b4-9cde4037ec74 admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:44.010876 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44898d37-e4a3-4de3-93b4-9cde4037ec74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:44.014125 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44898d37-e4a3-4de3-93b4-9cde4037ec74 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:44.032730 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b5f08-3ffd-49b6-93c1-a967dd3409ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:44.034666 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b5f08-3ffd-49b6-93c1-a967dd3409ca service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:44.044693 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 818/1623] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:33:43 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:33:44.046324 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd081cb-abc4-4a54-93c9-60347190e466 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:44.046618 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd081cb-abc4-4a54-93c9-60347190e466 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:44.046897 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd081cb-abc4-4a54-93c9-60347190e466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:44.064029 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 806/1624] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:33:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:33:44.065205 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b5f08-3ffd-49b6-93c1-a967dd3409ca service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:44.082637 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b5f08-3ffd-49b6-93c1-a967dd3409ca service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:44.091488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51be37-c407-4cb5-99ea-57363118f0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:44.092327 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51be37-c407-4cb5-99ea-57363118f0ac admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:44.092761 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-dcd081cb-abc4-4a54-93c9-60347190e466 None None] MFA Rules not processed for user `2915babd40aa42e8bf7cc85c5a97daa6`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:44.093115 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51be37-c407-4cb5-99ea-57363118f0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:44.093614 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51be37-c407-4cb5-99ea-57363118f0ac admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:44.094027 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-dcd081cb-abc4-4a54-93c9-60347190e466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:44.099007 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51be37-c407-4cb5-99ea-57363118f0ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:44.104312 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51be37-c407-4cb5-99ea-57363118f0ac admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:44.146757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 807/1625] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:33:44 2022] POST /identity/v3/users => generated 291 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:33:44.148057 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51be37-c407-4cb5-99ea-57363118f0ac admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:44.202960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 819/1626] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 12 09:33:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:44.203738 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd081cb-abc4-4a54-93c9-60347190e466 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:44.226898 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd081cb-abc4-4a54-93c9-60347190e466 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:44.237869 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa39cd-1ef0-4047-9dcb-89f35467f91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:44.239008 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa39cd-1ef0-4047-9dcb-89f35467f91a admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:44.239154 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa39cd-1ef0-4047-9dcb-89f35467f91a admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:44.239483 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa39cd-1ef0-4047-9dcb-89f35467f91a admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:44.240230 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa39cd-1ef0-4047-9dcb-89f35467f91a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:44.242117 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa39cd-1ef0-4047-9dcb-89f35467f91a admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:44.266044 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 820/1627] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:33:44.267735 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa39cd-1ef0-4047-9dcb-89f35467f91a admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:44.288506 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa39cd-1ef0-4047-9dcb-89f35467f91a admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:44.292430 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51be37-c407-4cb5-99ea-57363118f0ac admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:44.299350 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4668d-4c5e-44d7-8c80-6e9b664220fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:44.300032 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4668d-4c5e-44d7-8c80-6e9b664220fa admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:44.300343 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4668d-4c5e-44d7-8c80-6e9b664220fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:44.300611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4668d-4c5e-44d7-8c80-6e9b664220fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:44.301321 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e4668d-4c5e-44d7-8c80-6e9b664220fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:44.302964 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e4668d-4c5e-44d7-8c80-6e9b664220fa admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:44.307201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb88557-6525-45f1-8b27-1216a8f2fc76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:44.307828 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb88557-6525-45f1-8b27-1216a8f2fc76 service nova] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:44.308114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb88557-6525-45f1-8b27-1216a8f2fc76 service nova] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:44.308388 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb88557-6525-45f1-8b27-1216a8f2fc76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:44.322776 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 821/1628] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:33:44.333548 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4668d-4c5e-44d7-8c80-6e9b664220fa admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:44.415412 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb88557-6525-45f1-8b27-1216a8f2fc76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:44.417405 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb88557-6525-45f1-8b27-1216a8f2fc76 service nova] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:44.420092 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4668d-4c5e-44d7-8c80-6e9b664220fa admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:44.427357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20662df3-18d8-4345-a388-7f528be78978 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:44.428139 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20662df3-18d8-4345-a388-7f528be78978 service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:44.428600 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20662df3-18d8-4345-a388-7f528be78978 service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:44.428942 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20662df3-18d8-4345-a388-7f528be78978 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:44.429228 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 808/1629] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:33:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:33:44.430821 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb88557-6525-45f1-8b27-1216a8f2fc76 service nova] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:44.459171 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb88557-6525-45f1-8b27-1216a8f2fc76 service nova] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:44.465357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20662df3-18d8-4345-a388-7f528be78978 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:44.467121 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20662df3-18d8-4345-a388-7f528be78978 service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:44.475178 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706319cb-0c8d-43b2-a699-a49500f6d074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:44.481678 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706319cb-0c8d-43b2-a699-a49500f6d074 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:44.482485 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706319cb-0c8d-43b2-a699-a49500f6d074 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:44.482943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706319cb-0c8d-43b2-a699-a49500f6d074 admin admin] PATH_INFO: `/v3/projects/2aa59333ca2a45128ad19eadf45bdeaf/users/25f8dbecb14a4cb68b94043191744430/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:44.494341 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 822/1630] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:33:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:33:44.495294 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20662df3-18d8-4345-a388-7f528be78978 service cinder] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:44.522834 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20662df3-18d8-4345-a388-7f528be78978 service cinder] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:44.532438 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706319cb-0c8d-43b2-a699-a49500f6d074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aa59333ca2a45128ad19eadf45bdeaf, user_id=25f8dbecb14a4cb68b94043191744430, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:44.532982 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239faaf-f904-49e2-8f33-60c8c73216fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:44.533707 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239faaf-f904-49e2-8f33-60c8c73216fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:44.534093 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239faaf-f904-49e2-8f33-60c8c73216fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:44.534438 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239faaf-f904-49e2-8f33-60c8c73216fc admin admin] PATH_INFO: `/v3/projects/fab190a9e4e54d22af5be0d8a8df03dd/users/391d08cff23c4be7bbb4dc4e5c940903/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:44.547327 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706319cb-0c8d-43b2-a699-a49500f6d074 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:44.551598 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8239faaf-f904-49e2-8f33-60c8c73216fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fab190a9e4e54d22af5be0d8a8df03dd, user_id=391d08cff23c4be7bbb4dc4e5c940903, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:44.554750 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8239faaf-f904-49e2-8f33-60c8c73216fc admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:44.579088 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 823/1631] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:33:44 2022] PUT /identity/v3/projects/fab190a9e4e54d22af5be0d8a8df03dd/users/391d08cff23c4be7bbb4dc4e5c940903/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:33:44.584782 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239faaf-f904-49e2-8f33-60c8c73216fc admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:44.604810 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 809/1632] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:33:44 2022] PUT /identity/v3/projects/2aa59333ca2a45128ad19eadf45bdeaf/users/25f8dbecb14a4cb68b94043191744430/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:33:44.605727 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706319cb-0c8d-43b2-a699-a49500f6d074 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:44.783214 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706319cb-0c8d-43b2-a699-a49500f6d074 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:44.794553 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239faaf-f904-49e2-8f33-60c8c73216fc admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:44.796352 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f4b76-8141-4baa-b281-2c025a325847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:44.797053 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f4b76-8141-4baa-b281-2c025a325847 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:44.797337 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f4b76-8141-4baa-b281-2c025a325847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:44.797612 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f4b76-8141-4baa-b281-2c025a325847 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:44.800739 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f4b76-8141-4baa-b281-2c025a325847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:44.811079 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84480dca-6b53-4d49-9eae-3305b3bd9a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:44.811774 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84480dca-6b53-4d49-9eae-3305b3bd9a46 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:44.812052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84480dca-6b53-4d49-9eae-3305b3bd9a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:44.812321 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84480dca-6b53-4d49-9eae-3305b3bd9a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:44.813059 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84480dca-6b53-4d49-9eae-3305b3bd9a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:44.814754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84480dca-6b53-4d49-9eae-3305b3bd9a46 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:44.815569 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f4b76-8141-4baa-b281-2c025a325847 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:44.848373 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 824/1633] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 09:33:44.849110 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84480dca-6b53-4d49-9eae-3305b3bd9a46 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:44.854032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 810/1634] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:33:44.855402 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f4b76-8141-4baa-b281-2c025a325847 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:44.873658 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84480dca-6b53-4d49-9eae-3305b3bd9a46 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:44.881939 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f4b76-8141-4baa-b281-2c025a325847 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:44.894541 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b0e79-fc08-4823-904d-0ff8e3b24aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:44.894828 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22033c-2a1b-40d9-bcbc-351510380f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:44.895812 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22033c-2a1b-40d9-bcbc-351510380f8f admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:44.897528 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22033c-2a1b-40d9-bcbc-351510380f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:44.899157 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b0e79-fc08-4823-904d-0ff8e3b24aa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:44.899295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22033c-2a1b-40d9-bcbc-351510380f8f admin admin] PATH_INFO: `/v3/projects/2aa59333ca2a45128ad19eadf45bdeaf/users/25f8dbecb14a4cb68b94043191744430/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:44.899469 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b0e79-fc08-4823-904d-0ff8e3b24aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:44.899754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b0e79-fc08-4823-904d-0ff8e3b24aa3 admin admin] PATH_INFO: `/v3/projects/fab190a9e4e54d22af5be0d8a8df03dd/users/391d08cff23c4be7bbb4dc4e5c940903/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:44.903612 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22033c-2a1b-40d9-bcbc-351510380f8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aa59333ca2a45128ad19eadf45bdeaf, user_id=25f8dbecb14a4cb68b94043191744430, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:44.905591 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b0e79-fc08-4823-904d-0ff8e3b24aa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fab190a9e4e54d22af5be0d8a8df03dd, user_id=391d08cff23c4be7bbb4dc4e5c940903, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:44.910654 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22033c-2a1b-40d9-bcbc-351510380f8f admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:44.917192 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b0e79-fc08-4823-904d-0ff8e3b24aa3 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:44.950205 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 825/1635] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:33:44 2022] PUT /identity/v3/projects/fab190a9e4e54d22af5be0d8a8df03dd/users/391d08cff23c4be7bbb4dc4e5c940903/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:33:44.952372 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 811/1636] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:33:44 2022] PUT /identity/v3/projects/2aa59333ca2a45128ad19eadf45bdeaf/users/25f8dbecb14a4cb68b94043191744430/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:33:44.953769 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb046d0e-1357-4394-a4d1-36193554c51e None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:44.954080 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb046d0e-1357-4394-a4d1-36193554c51e None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:44.954352 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb046d0e-1357-4394-a4d1-36193554c51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:44.955677 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142ff1e-7530-40bf-aaab-581b64a7d0fa None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:44.956836 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142ff1e-7530-40bf-aaab-581b64a7d0fa None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:44.957212 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142ff1e-7530-40bf-aaab-581b64a7d0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:45.014515 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-cb046d0e-1357-4394-a4d1-36193554c51e None None] MFA Rules not processed for user `25f8dbecb14a4cb68b94043191744430`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:45.015732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-cb046d0e-1357-4394-a4d1-36193554c51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:45.029088 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-1142ff1e-7530-40bf-aaab-581b64a7d0fa None None] MFA Rules not processed for user `391d08cff23c4be7bbb4dc4e5c940903`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:45.031523 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-1142ff1e-7530-40bf-aaab-581b64a7d0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:45.227766 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 812/1637] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:44 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:45.240197 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142ff1e-7530-40bf-aaab-581b64a7d0fa None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:45.279603 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 826/1638] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:45.281368 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38045473-b6f9-42e0-b86a-90b9b6be139b None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:45.282134 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38045473-b6f9-42e0-b86a-90b9b6be139b None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:45.282417 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38045473-b6f9-42e0-b86a-90b9b6be139b None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:45.285941 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 827/1639] 10.222.0.60 () {54 vars in 912 bytes} [Thu May 12 09:33:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:33:45.294185 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733eb34a-089a-461c-ae0c-556fc01cdd4c None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:45.294519 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733eb34a-089a-461c-ae0c-556fc01cdd4c None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:45.294725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733eb34a-089a-461c-ae0c-556fc01cdd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:45.327960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-733eb34a-089a-461c-ae0c-556fc01cdd4c None None] MFA Rules not processed for user `2915babd40aa42e8bf7cc85c5a97daa6`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:45.331193 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-733eb34a-089a-461c-ae0c-556fc01cdd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:45.431846 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142ff1e-7530-40bf-aaab-581b64a7d0fa None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:45.446032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c6754-8844-42bc-95d8-31195f6c4078 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:45.446764 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c6754-8844-42bc-95d8-31195f6c4078 service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:45.447050 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c6754-8844-42bc-95d8-31195f6c4078 service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:45.447325 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c6754-8844-42bc-95d8-31195f6c4078 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:45.474592 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 828/1640] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 12 09:33:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:33:45.487194 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c6754-8844-42bc-95d8-31195f6c4078 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:45.488666 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c6754-8844-42bc-95d8-31195f6c4078 service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:45.513617 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 813/1641] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:33:45 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:33:45.679186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733eb34a-089a-461c-ae0c-556fc01cdd4c None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:45.694870 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733eb34a-089a-461c-ae0c-556fc01cdd4c None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:45.705829 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d11633-feb9-41a4-8938-5986c2a5809e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:45.708529 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d11633-feb9-41a4-8938-5986c2a5809e service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:45.708880 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d11633-feb9-41a4-8938-5986c2a5809e service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:45.709157 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d11633-feb9-41a4-8938-5986c2a5809e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:45.755552 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d11633-feb9-41a4-8938-5986c2a5809e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:45.764633 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d11633-feb9-41a4-8938-5986c2a5809e service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:45.810110 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 829/1642] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:33:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 09:33:45.843697 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c6754-8844-42bc-95d8-31195f6c4078 service cinder] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:45.855705 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c6754-8844-42bc-95d8-31195f6c4078 service cinder] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:45.863107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d11633-feb9-41a4-8938-5986c2a5809e service cinder] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:45.867156 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc9528-5e61-4c06-a769-48e54ad83d1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:45.868369 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc9528-5e61-4c06-a769-48e54ad83d1f service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:45.868699 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc9528-5e61-4c06-a769-48e54ad83d1f service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:45.869001 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc9528-5e61-4c06-a769-48e54ad83d1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:45.874227 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d11633-feb9-41a4-8938-5986c2a5809e service cinder] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:45.879720 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c01b7-09fc-4d39-a03a-f789a335c923 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:45.880810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c01b7-09fc-4d39-a03a-f789a335c923 service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:45.881265 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c01b7-09fc-4d39-a03a-f789a335c923 service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:45.881725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c01b7-09fc-4d39-a03a-f789a335c923 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:45.911220 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fc9528-5e61-4c06-a769-48e54ad83d1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:45.912734 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fc9528-5e61-4c06-a769-48e54ad83d1f service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:45.937954 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 814/1643] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:33:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:33:46.101131 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c01b7-09fc-4d39-a03a-f789a335c923 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:46.104191 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c01b7-09fc-4d39-a03a-f789a335c923 service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:46.124766 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 830/1644] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:33:45 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 09:33:46.429570 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc9528-5e61-4c06-a769-48e54ad83d1f service cinder] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:46.441123 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc9528-5e61-4c06-a769-48e54ad83d1f service cinder] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:46.453410 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3555ff-a2d6-4dc7-8e97-fb0a3193f7e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:46.454100 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3555ff-a2d6-4dc7-8e97-fb0a3193f7e0 service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:46.454386 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3555ff-a2d6-4dc7-8e97-fb0a3193f7e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:46.454660 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3555ff-a2d6-4dc7-8e97-fb0a3193f7e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:46.598648 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3555ff-a2d6-4dc7-8e97-fb0a3193f7e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:46.602963 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3555ff-a2d6-4dc7-8e97-fb0a3193f7e0 service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:46.636935 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 815/1645] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:33:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:33:47.173716 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c01b7-09fc-4d39-a03a-f789a335c923 service cinder] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:47.372865 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c01b7-09fc-4d39-a03a-f789a335c923 service cinder] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:47.384913 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d3694-9288-4d71-ba70-a373e39db092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:47.386018 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d3694-9288-4d71-ba70-a373e39db092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:47.387640 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d3694-9288-4d71-ba70-a373e39db092 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:47.388154 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d3694-9288-4d71-ba70-a373e39db092 admin admin] PATH_INFO: `/v3/users/d2a7bfec6c8140e2bd633d6184ad4716` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:47.390096 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d3694-9288-4d71-ba70-a373e39db092 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2a7bfec6c8140e2bd633d6184ad4716)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:47.391689 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: WARNING py.warnings [None req-8d8d3694-9288-4d71-ba70-a373e39db092 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 09:33:47.391689 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: warnings.warn(msg) May 12 09:33:47.391689 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: May 12 09:33:47.394327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d3694-9288-4d71-ba70-a373e39db092 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:47.557770 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-8d8d3694-9288-4d71-ba70-a373e39db092 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2a7bfec6c8140e2bd633d6184ad4716'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:33:47.626130 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-8d8d3694-9288-4d71-ba70-a373e39db092 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2a7bfec6c8140e2bd633d6184ad4716'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:33:47.628719 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-8d8d3694-9288-4d71-ba70-a373e39db092 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2a7bfec6c8140e2bd633d6184ad4716'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:33:47.642101 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-8d8d3694-9288-4d71-ba70-a373e39db092 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2a7bfec6c8140e2bd633d6184ad4716'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:33:47.660500 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-8d8d3694-9288-4d71-ba70-a373e39db092 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2a7bfec6c8140e2bd633d6184ad4716'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:33:47.680269 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 831/1646] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:33:47 2022] DELETE /identity/v3/users/d2a7bfec6c8140e2bd633d6184ad4716 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:33:47.684773 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cfac4-69e5-4d99-a073-82935daf38cc None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:47.685855 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cfac4-69e5-4d99-a073-82935daf38cc None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:47.686407 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cfac4-69e5-4d99-a073-82935daf38cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:47.702622 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb1146-2347-49ff-aeae-0b0df298cd63 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:47.702913 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb1146-2347-49ff-aeae-0b0df298cd63 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:47.703188 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb1146-2347-49ff-aeae-0b0df298cd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:47.731049 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-539cfac4-69e5-4d99-a073-82935daf38cc None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:47.734948 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-539cfac4-69e5-4d99-a073-82935daf38cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:47.761041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-20fb1146-2347-49ff-aeae-0b0df298cd63 None None] MFA Rules not processed for user `ded41aae383242789d1e468372767efb`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:47.762321 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-20fb1146-2347-49ff-aeae-0b0df298cd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:47.953168 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 832/1647] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:47.957006 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c19c9c-c149-4fb2-a91b-ae6dcc79bc2b None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:47.957297 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c19c9c-c149-4fb2-a91b-ae6dcc79bc2b None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:47.957576 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c19c9c-c149-4fb2-a91b-ae6dcc79bc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:47.958241 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 816/1648] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:47.998669 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-97c19c9c-c149-4fb2-a91b-ae6dcc79bc2b None None] MFA Rules not processed for user `ded41aae383242789d1e468372767efb`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:47.999892 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-97c19c9c-c149-4fb2-a91b-ae6dcc79bc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:48.010286 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539cfac4-69e5-4d99-a073-82935daf38cc None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:48.013107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-539cfac4-69e5-4d99-a073-82935daf38cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:48.020700 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 833/1649] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:33:48.032835 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c19c9c-c149-4fb2-a91b-ae6dcc79bc2b None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:48.034386 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-97c19c9c-c149-4fb2-a91b-ae6dcc79bc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:48.235708 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c19c9c-c149-4fb2-a91b-ae6dcc79bc2b None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:48.243050 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37790fe8-daf2-48a6-a740-ac30783cf83f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:48.243780 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37790fe8-daf2-48a6-a740-ac30783cf83f service nova] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:48.244058 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37790fe8-daf2-48a6-a740-ac30783cf83f service nova] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:48.246708 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37790fe8-daf2-48a6-a740-ac30783cf83f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:48.302631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37790fe8-daf2-48a6-a740-ac30783cf83f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:48.306020 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37790fe8-daf2-48a6-a740-ac30783cf83f service nova] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:48.319945 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 834/1650] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:33:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:33:48.342412 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539cfac4-69e5-4d99-a073-82935daf38cc None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:48.358657 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e834a6d-a40c-4dfa-bf8e-711a65431c13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:48.359711 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e834a6d-a40c-4dfa-bf8e-711a65431c13 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:48.360241 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e834a6d-a40c-4dfa-bf8e-711a65431c13 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:48.360725 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e834a6d-a40c-4dfa-bf8e-711a65431c13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:48.375498 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e834a6d-a40c-4dfa-bf8e-711a65431c13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:48.378085 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e834a6d-a40c-4dfa-bf8e-711a65431c13 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:48.419724 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 817/1651] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:33:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 09:33:49.581507 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467780a-af07-4e44-9c48-fcb00b6c0a56 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:49.582461 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467780a-af07-4e44-9c48-fcb00b6c0a56 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:49.582931 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467780a-af07-4e44-9c48-fcb00b6c0a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:49.644102 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-e467780a-af07-4e44-9c48-fcb00b6c0a56 None None] MFA Rules not processed for user `6c8297034cfa40438000e7d94419a429`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:49.645788 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-e467780a-af07-4e44-9c48-fcb00b6c0a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:49.689287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e834a6d-a40c-4dfa-bf8e-711a65431c13 service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:49.690806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-0e834a6d-a40c-4dfa-bf8e-711a65431c13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:49.720918 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e834a6d-a40c-4dfa-bf8e-711a65431c13 service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:49.730251 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654c264-ab24-469c-85db-6c581daee1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:49.731278 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654c264-ab24-469c-85db-6c581daee1af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:49.731468 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654c264-ab24-469c-85db-6c581daee1af admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:49.731762 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654c264-ab24-469c-85db-6c581daee1af admin admin] PATH_INFO: `/v3/projects/e24c3b4bb7dd44c68884a021507f7e5e` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:49.733033 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654c264-ab24-469c-85db-6c581daee1af admin admin] RBAC: Authorizing `identity:delete_project(project_id=e24c3b4bb7dd44c68884a021507f7e5e)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:49.734145 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: WARNING py.warnings [None req-6654c264-ab24-469c-85db-6c581daee1af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 09:33:49.734145 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: warnings.warn(msg) May 12 09:33:49.734145 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: May 12 09:33:49.735991 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654c264-ab24-469c-85db-6c581daee1af admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:49.848699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 835/1652] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:49.855847 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467780a-af07-4e44-9c48-fcb00b6c0a56 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:49.857304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-e467780a-af07-4e44-9c48-fcb00b6c0a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:49.862741 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-6654c264-ab24-469c-85db-6c581daee1af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e24c3b4bb7dd44c68884a021507f7e5e', 'request_id': 'req-6654c264-ab24-469c-85db-6c581daee1af'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:33:49.889267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-6654c264-ab24-469c-85db-6c581daee1af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e24c3b4bb7dd44c68884a021507f7e5e', 'request_id': 'req-6654c264-ab24-469c-85db-6c581daee1af'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:33:49.899517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467780a-af07-4e44-9c48-fcb00b6c0a56 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:49.905849 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-6654c264-ab24-469c-85db-6c581daee1af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e24c3b4bb7dd44c68884a021507f7e5e', 'request_id': 'req-6654c264-ab24-469c-85db-6c581daee1af'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:33:49.956214 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-6654c264-ab24-469c-85db-6c581daee1af admin admin] The token cache is being invalidate because project e24c3b4bb7dd44c68884a021507f7e5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:33:49.957064 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-6654c264-ab24-469c-85db-6c581daee1af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:33:49.959632 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-6654c264-ab24-469c-85db-6c581daee1af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:33:49.961843 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 818/1653] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:33:49 2022] DELETE /identity/v3/projects/e24c3b4bb7dd44c68884a021507f7e5e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:33:49.977478 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c1825-e2fa-4f37-9874-2650a19e1461 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:49.977849 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c1825-e2fa-4f37-9874-2650a19e1461 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:49.981208 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c1825-e2fa-4f37-9874-2650a19e1461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:50.022572 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-bb1c1825-e2fa-4f37-9874-2650a19e1461 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:50.023871 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-bb1c1825-e2fa-4f37-9874-2650a19e1461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:50.084936 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114b6a0-f0ac-40d1-bc5d-c20ffc0c6e4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:50.085616 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b6a0-f0ac-40d1-bc5d-c20ffc0c6e4b service nova] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:50.085921 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b6a0-f0ac-40d1-bc5d-c20ffc0c6e4b service nova] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:50.086254 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b6a0-f0ac-40d1-bc5d-c20ffc0c6e4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:50.088087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-3114b6a0-f0ac-40d1-bc5d-c20ffc0c6e4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:50.161473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 819/1654] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:33:50.170115 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5d20f-354c-489b-8d25-90a59103acd8 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:50.170697 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5d20f-354c-489b-8d25-90a59103acd8 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:50.171682 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5d20f-354c-489b-8d25-90a59103acd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:50.194319 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114b6a0-f0ac-40d1-bc5d-c20ffc0c6e4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:50.196363 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114b6a0-f0ac-40d1-bc5d-c20ffc0c6e4b service nova] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:50.202481 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-77e5d20f-354c-489b-8d25-90a59103acd8 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:50.203999 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-77e5d20f-354c-489b-8d25-90a59103acd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:50.212655 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 836/1655] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:33:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:33:50.236448 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 820/1656] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:33:50.240237 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114b6a0-f0ac-40d1-bc5d-c20ffc0c6e4b service nova] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:50.277261 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114b6a0-f0ac-40d1-bc5d-c20ffc0c6e4b service nova] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:50.288398 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11c37c-6268-417c-bae4-3b4950e5f36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:50.289656 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11c37c-6268-417c-bae4-3b4950e5f36b admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:50.292158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11c37c-6268-417c-bae4-3b4950e5f36b admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:50.292526 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11c37c-6268-417c-bae4-3b4950e5f36b admin admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:50.294452 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11c37c-6268-417c-bae4-3b4950e5f36b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:33:50.294840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11c37c-6268-417c-bae4-3b4950e5f36b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:50.296536 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11c37c-6268-417c-bae4-3b4950e5f36b admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:50.301872 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c077f-89a2-43aa-85cc-b473d7efdb0b None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:50.302194 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c077f-89a2-43aa-85cc-b473d7efdb0b None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:50.302475 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c077f-89a2-43aa-85cc-b473d7efdb0b None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:50.305736 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 821/1657] 10.222.0.60 () {54 vars in 912 bytes} [Thu May 12 09:33:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:33:50.312879 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 837/1658] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:33:50.314853 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c077f-89a2-43aa-85cc-b473d7efdb0b None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:50.332913 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854fe77-4be8-4cd1-b2fe-02b351e0aafc None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:50.333350 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854fe77-4be8-4cd1-b2fe-02b351e0aafc None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:50.337494 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854fe77-4be8-4cd1-b2fe-02b351e0aafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:50.355177 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c077f-89a2-43aa-85cc-b473d7efdb0b None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:50.370609 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf34962-5376-4995-8055-d6683ca74bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:50.373110 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf34962-5376-4995-8055-d6683ca74bac admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:50.374057 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf34962-5376-4995-8055-d6683ca74bac admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:50.374057 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf34962-5376-4995-8055-d6683ca74bac admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:50.375363 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf34962-5376-4995-8055-d6683ca74bac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:50.381519 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf34962-5376-4995-8055-d6683ca74bac admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:50.434901 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-0854fe77-4be8-4cd1-b2fe-02b351e0aafc None None] MFA Rules not processed for user `bf7b793f84bd4a72a68d5ab65221e1a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:50.439927 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-0854fe77-4be8-4cd1-b2fe-02b351e0aafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:50.448247 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 822/1659] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:33:50 2022] POST /identity/v3/projects => generated 363 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:33:50.450108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf34962-5376-4995-8055-d6683ca74bac admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:50.569099 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 838/1660] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 12 09:33:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:33:50.634704 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854fe77-4be8-4cd1-b2fe-02b351e0aafc None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:50.637407 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-0854fe77-4be8-4cd1-b2fe-02b351e0aafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:50.654524 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854fe77-4be8-4cd1-b2fe-02b351e0aafc None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:50.663432 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a61ffa-cc0e-442c-9423-7e31cd4506d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:50.664855 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a61ffa-cc0e-442c-9423-7e31cd4506d7 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:50.665141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a61ffa-cc0e-442c-9423-7e31cd4506d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:50.666562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a61ffa-cc0e-442c-9423-7e31cd4506d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:50.692639 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf34962-5376-4995-8055-d6683ca74bac admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:50.702526 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a61ffa-cc0e-442c-9423-7e31cd4506d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:50.704597 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a61ffa-cc0e-442c-9423-7e31cd4506d7 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:50.723533 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6aab45-499c-42f6-bc37-981ae8933aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:50.724265 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6aab45-499c-42f6-bc37-981ae8933aef admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:50.724549 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6aab45-499c-42f6-bc37-981ae8933aef admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:50.724823 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6aab45-499c-42f6-bc37-981ae8933aef admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:50.725294 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 839/1661] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:33:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 09:33:50.726233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6aab45-499c-42f6-bc37-981ae8933aef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:50.728509 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6aab45-499c-42f6-bc37-981ae8933aef admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:50.772372 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 823/1662] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:33:50 2022] POST /identity/v3/users => generated 282 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:33:50.777437 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a61ffa-cc0e-442c-9423-7e31cd4506d7 service neutron] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:50.796002 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a61ffa-cc0e-442c-9423-7e31cd4506d7 service neutron] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:50.809101 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e0f9e-cbee-4885-a1cf-5a62cee4bddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:50.809784 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e0f9e-cbee-4885-a1cf-5a62cee4bddc admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:50.810083 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e0f9e-cbee-4885-a1cf-5a62cee4bddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:50.810358 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e0f9e-cbee-4885-a1cf-5a62cee4bddc admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:50.814353 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e0f9e-cbee-4885-a1cf-5a62cee4bddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:50.816228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e0f9e-cbee-4885-a1cf-5a62cee4bddc admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:50.842172 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 840/1663] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:33:50.843650 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6aab45-499c-42f6-bc37-981ae8933aef admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:50.861205 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6aab45-499c-42f6-bc37-981ae8933aef admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:50.880451 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ba50e-930f-4f6d-ab9e-7251f3dbaab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:50.881262 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ba50e-930f-4f6d-ab9e-7251f3dbaab4 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:50.881564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ba50e-930f-4f6d-ab9e-7251f3dbaab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:50.882011 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ba50e-930f-4f6d-ab9e-7251f3dbaab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:50.884212 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ba50e-930f-4f6d-ab9e-7251f3dbaab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:50.889842 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ba50e-930f-4f6d-ab9e-7251f3dbaab4 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:50.931796 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 824/1664] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:33:50.933103 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e0f9e-cbee-4885-a1cf-5a62cee4bddc admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:50.947224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e0f9e-cbee-4885-a1cf-5a62cee4bddc admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:50.964778 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df82ed-a397-4e99-980e-b91c98bc8668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:50.966073 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df82ed-a397-4e99-980e-b91c98bc8668 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:50.968347 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df82ed-a397-4e99-980e-b91c98bc8668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:50.968791 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df82ed-a397-4e99-980e-b91c98bc8668 admin admin] PATH_INFO: `/v3/projects/9df3a5df9f9045bc94bdc3ce3e833c43/users/4d61640a3fc84c7aa0d5c70556c6112d/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:51.000837 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df82ed-a397-4e99-980e-b91c98bc8668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9df3a5df9f9045bc94bdc3ce3e833c43, user_id=4d61640a3fc84c7aa0d5c70556c6112d, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:51.005355 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df82ed-a397-4e99-980e-b91c98bc8668 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:51.052991 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 841/1665] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:33:50 2022] PUT /identity/v3/projects/9df3a5df9f9045bc94bdc3ce3e833c43/users/4d61640a3fc84c7aa0d5c70556c6112d/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:33:51.055701 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858493b-a24a-4c02-be0b-4468083b98cb None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:51.055960 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858493b-a24a-4c02-be0b-4468083b98cb None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:51.056233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858493b-a24a-4c02-be0b-4468083b98cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:51.121326 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-4858493b-a24a-4c02-be0b-4468083b98cb None None] MFA Rules not processed for user `4d61640a3fc84c7aa0d5c70556c6112d`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:51.123201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-4858493b-a24a-4c02-be0b-4468083b98cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:51.324894 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 825/1666] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:51 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:51.329686 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df82ed-a397-4e99-980e-b91c98bc8668 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:51.515748 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df82ed-a397-4e99-980e-b91c98bc8668 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:51.535051 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a011f26-75c7-432a-9b0d-d4361f9b8d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:51.537790 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a011f26-75c7-432a-9b0d-d4361f9b8d32 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:51.538140 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a011f26-75c7-432a-9b0d-d4361f9b8d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:51.549640 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a011f26-75c7-432a-9b0d-d4361f9b8d32 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:51.554396 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a011f26-75c7-432a-9b0d-d4361f9b8d32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:51.560033 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a011f26-75c7-432a-9b0d-d4361f9b8d32 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:51.657719 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 842/1667] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:33:51 2022] POST /identity/v3/projects => generated 361 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:33:51.660070 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858493b-a24a-4c02-be0b-4468083b98cb None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:51.681344 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858493b-a24a-4c02-be0b-4468083b98cb None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:51.735223 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a011f26-75c7-432a-9b0d-d4361f9b8d32 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:51.737235 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-3a011f26-75c7-432a-9b0d-d4361f9b8d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:51.856418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63f532-40f9-4058-8a76-f329515041a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:51.858079 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63f532-40f9-4058-8a76-f329515041a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:51.858499 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63f532-40f9-4058-8a76-f329515041a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:51.858927 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63f532-40f9-4058-8a76-f329515041a8 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:51.859902 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63f532-40f9-4058-8a76-f329515041a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:51.862014 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63f532-40f9-4058-8a76-f329515041a8 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:51.897170 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a011f26-75c7-432a-9b0d-d4361f9b8d32 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:51.910240 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 826/1668] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:33:51 2022] POST /identity/v3/users => generated 287 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:33:51.913650 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63f532-40f9-4058-8a76-f329515041a8 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:51.916615 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba90f1-c5de-4384-a14f-935f45802833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:51.917695 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba90f1-c5de-4384-a14f-935f45802833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:51.918185 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba90f1-c5de-4384-a14f-935f45802833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:51.918603 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba90f1-c5de-4384-a14f-935f45802833 admin admin] PATH_INFO: `/v3/users/29301accbeba4ea3b468aa59fcc3eab4` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:51.920223 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba90f1-c5de-4384-a14f-935f45802833 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29301accbeba4ea3b468aa59fcc3eab4)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:51.922681 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba90f1-c5de-4384-a14f-935f45802833 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:51.966189 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63f532-40f9-4058-8a76-f329515041a8 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:51.991813 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e6b5c-729b-47d5-bb59-78130dd5682c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:51.994390 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e6b5c-729b-47d5-bb59-78130dd5682c admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:51.997282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e6b5c-729b-47d5-bb59-78130dd5682c admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:51.999404 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e6b5c-729b-47d5-bb59-78130dd5682c admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:52.000966 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e6b5c-729b-47d5-bb59-78130dd5682c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:52.008354 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e6b5c-729b-47d5-bb59-78130dd5682c admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:52.021152 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-c0ba90f1-c5de-4384-a14f-935f45802833 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29301accbeba4ea3b468aa59fcc3eab4'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:33:52.034556 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 827/1669] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:33:52.037053 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e6b5c-729b-47d5-bb59-78130dd5682c admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:52.043816 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-c0ba90f1-c5de-4384-a14f-935f45802833 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29301accbeba4ea3b468aa59fcc3eab4'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:33:52.049825 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-c0ba90f1-c5de-4384-a14f-935f45802833 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29301accbeba4ea3b468aa59fcc3eab4'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:33:52.058301 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e6b5c-729b-47d5-bb59-78130dd5682c admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:52.063559 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-c0ba90f1-c5de-4384-a14f-935f45802833 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29301accbeba4ea3b468aa59fcc3eab4'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:33:52.082289 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-c0ba90f1-c5de-4384-a14f-935f45802833 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29301accbeba4ea3b468aa59fcc3eab4'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:33:52.084401 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b71d2-5da2-4b32-8a85-fc1d710b5769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:52.085370 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b71d2-5da2-4b32-8a85-fc1d710b5769 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:52.085654 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b71d2-5da2-4b32-8a85-fc1d710b5769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:52.089518 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b71d2-5da2-4b32-8a85-fc1d710b5769 admin admin] PATH_INFO: `/v3/projects/f0b6c24c864646dd9f1ab0ebdb4b885d/users/1ed8d19376544b228804a24be0a2bdcc/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:52.098690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 843/1670] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:33:51 2022] DELETE /identity/v3/users/29301accbeba4ea3b468aa59fcc3eab4 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:33:52.100189 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f21c87-e618-4ecf-8351-64d5cf52aa81 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:52.100619 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f21c87-e618-4ecf-8351-64d5cf52aa81 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:52.101021 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f21c87-e618-4ecf-8351-64d5cf52aa81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:52.128233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b71d2-5da2-4b32-8a85-fc1d710b5769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b6c24c864646dd9f1ab0ebdb4b885d, user_id=1ed8d19376544b228804a24be0a2bdcc, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:52.131476 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b71d2-5da2-4b32-8a85-fc1d710b5769 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:52.139396 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-25f21c87-e618-4ecf-8351-64d5cf52aa81 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:52.142006 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-25f21c87-e618-4ecf-8351-64d5cf52aa81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:52.157751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 828/1671] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:33:52 2022] PUT /identity/v3/projects/f0b6c24c864646dd9f1ab0ebdb4b885d/users/1ed8d19376544b228804a24be0a2bdcc/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:33:52.159062 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119dd52-3a6f-4d44-bb40-7c0458a7aa98 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:52.160626 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119dd52-3a6f-4d44-bb40-7c0458a7aa98 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:52.161258 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119dd52-3a6f-4d44-bb40-7c0458a7aa98 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:52.171763 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 829/1672] 10.222.0.60 () {54 vars in 960 bytes} [Thu May 12 09:33:52 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:33:52.172638 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119dd52-3a6f-4d44-bb40-7c0458a7aa98 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:52.176792 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-3119dd52-3a6f-4d44-bb40-7c0458a7aa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:52.328161 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 844/1673] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:52.332013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a07551-cbd2-4723-ae48-1436892e787e None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:52.332013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a07551-cbd2-4723-ae48-1436892e787e None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:52.333997 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a07551-cbd2-4723-ae48-1436892e787e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:52.338567 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119dd52-3a6f-4d44-bb40-7c0458a7aa98 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:52.352156 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0c0c1-9d7b-45f8-bf16-bd5467c3db13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:52.353169 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0c0c1-9d7b-45f8-bf16-bd5467c3db13 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:52.353595 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0c0c1-9d7b-45f8-bf16-bd5467c3db13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:52.354039 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0c0c1-9d7b-45f8-bf16-bd5467c3db13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:52.357486 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa0c0c1-9d7b-45f8-bf16-bd5467c3db13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:52.361148 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa0c0c1-9d7b-45f8-bf16-bd5467c3db13 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:52.386033 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-23a07551-cbd2-4723-ae48-1436892e787e None None] MFA Rules not processed for user `525f4699878f461e82f7f06ef60c176a`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:52.387883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-23a07551-cbd2-4723-ae48-1436892e787e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:52.389515 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 830/1674] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:33:52.390556 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0c0c1-9d7b-45f8-bf16-bd5467c3db13 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:52.397802 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-6fa0c0c1-9d7b-45f8-bf16-bd5467c3db13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:52.482120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0c0c1-9d7b-45f8-bf16-bd5467c3db13 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:52.487930 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26f898-59dc-448d-8e3b-cddf7e5aa7bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:52.488756 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26f898-59dc-448d-8e3b-cddf7e5aa7bc service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:52.489044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26f898-59dc-448d-8e3b-cddf7e5aa7bc service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:52.489322 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26f898-59dc-448d-8e3b-cddf7e5aa7bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:52.507451 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26f898-59dc-448d-8e3b-cddf7e5aa7bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:52.510372 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26f898-59dc-448d-8e3b-cddf7e5aa7bc service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:52.525404 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 845/1675] 10.222.0.60 () {58 vars in 1057 bytes} [Thu May 12 09:33:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:52.526439 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a07551-cbd2-4723-ae48-1436892e787e None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:52.535164 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 831/1676] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:33:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:33:52.539485 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26f898-59dc-448d-8e3b-cddf7e5aa7bc service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:52.549538 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a07551-cbd2-4723-ae48-1436892e787e None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:52.558855 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26f898-59dc-448d-8e3b-cddf7e5aa7bc service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:52.560560 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8b778-fe96-404e-a5c5-6ce932308ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:52.561627 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8b778-fe96-404e-a5c5-6ce932308ae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:52.564085 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8b778-fe96-404e-a5c5-6ce932308ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:52.564517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8b778-fe96-404e-a5c5-6ce932308ae3 admin admin] PATH_INFO: `/v3/projects/f0b6c24c864646dd9f1ab0ebdb4b885d/users/1ed8d19376544b228804a24be0a2bdcc/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:52.566310 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8fef8-0516-4d15-99c6-d6e945183213 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525f4699878f461e82f7f06ef60c176a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:52.567101 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8fef8-0516-4d15-99c6-d6e945183213 service placement] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:52.567932 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8fef8-0516-4d15-99c6-d6e945183213 service placement] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:52.567932 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8fef8-0516-4d15-99c6-d6e945183213 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:52.569688 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8b778-fe96-404e-a5c5-6ce932308ae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b6c24c864646dd9f1ab0ebdb4b885d, user_id=1ed8d19376544b228804a24be0a2bdcc, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:52.569803 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-f1c8fef8-0516-4d15-99c6-d6e945183213 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:52.577477 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8b778-fe96-404e-a5c5-6ce932308ae3 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:52.584867 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8fef8-0516-4d15-99c6-d6e945183213 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:52.587207 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8fef8-0516-4d15-99c6-d6e945183213 service placement] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:52.600381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 832/1677] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:33:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:33:52.602722 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 846/1678] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:33:52 2022] PUT /identity/v3/projects/f0b6c24c864646dd9f1ab0ebdb4b885d/users/1ed8d19376544b228804a24be0a2bdcc/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:33:52.614823 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf7129-092f-4997-a404-8f12c68f731f None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:52.614823 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf7129-092f-4997-a404-8f12c68f731f None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:52.615085 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf7129-092f-4997-a404-8f12c68f731f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:52.654732 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-ffdf7129-092f-4997-a404-8f12c68f731f None None] MFA Rules not processed for user `1ed8d19376544b228804a24be0a2bdcc`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:52.656526 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-ffdf7129-092f-4997-a404-8f12c68f731f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:52.763884 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 833/1679] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:52 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:52.771760 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8b778-fe96-404e-a5c5-6ce932308ae3 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:52.777245 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-ffa8b778-fe96-404e-a5c5-6ce932308ae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:52.889062 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8b778-fe96-404e-a5c5-6ce932308ae3 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:52.901229 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa58a27-7481-4773-84c9-3080e9bfe5d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:52.901951 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa58a27-7481-4773-84c9-3080e9bfe5d3 service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:52.902736 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa58a27-7481-4773-84c9-3080e9bfe5d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:52.903019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa58a27-7481-4773-84c9-3080e9bfe5d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:52.914174 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa58a27-7481-4773-84c9-3080e9bfe5d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:52.916443 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa58a27-7481-4773-84c9-3080e9bfe5d3 service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:52.955186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 847/1680] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:33:52 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:33:53.160563 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf7129-092f-4997-a404-8f12c68f731f None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:53.172999 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf7129-092f-4997-a404-8f12c68f731f None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:53.182437 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725806ed-f205-4f9d-85de-761b02344a5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:53.183138 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725806ed-f205-4f9d-85de-761b02344a5c service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:53.183382 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725806ed-f205-4f9d-85de-761b02344a5c service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:53.183661 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725806ed-f205-4f9d-85de-761b02344a5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:53.190605 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-725806ed-f205-4f9d-85de-761b02344a5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:53.372886 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725806ed-f205-4f9d-85de-761b02344a5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:53.375549 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725806ed-f205-4f9d-85de-761b02344a5c service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:53.410080 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 834/1681] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:33:53 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:33:53.519754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef434799-d581-4129-999a-acb11507cbdb None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:53.520139 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef434799-d581-4129-999a-acb11507cbdb None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:53.520493 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef434799-d581-4129-999a-acb11507cbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:53.582915 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-ef434799-d581-4129-999a-acb11507cbdb None None] MFA Rules not processed for user `6c8297034cfa40438000e7d94419a429`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:53.587106 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-ef434799-d581-4129-999a-acb11507cbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:53.723353 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 848/1682] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:55.147577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725806ed-f205-4f9d-85de-761b02344a5c service cinder] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:55.152920 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-725806ed-f205-4f9d-85de-761b02344a5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:55.332717 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725806ed-f205-4f9d-85de-761b02344a5c service cinder] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:55.350670 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91beaf8-c4c2-426d-8c4a-a13f400344bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:55.352299 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91beaf8-c4c2-426d-8c4a-a13f400344bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:55.352746 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91beaf8-c4c2-426d-8c4a-a13f400344bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:55.353191 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91beaf8-c4c2-426d-8c4a-a13f400344bf admin admin] PATH_INFO: `/v3/projects/41d0e0ef37804da4be700d34a3bcf7fd` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:55.355194 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91beaf8-c4c2-426d-8c4a-a13f400344bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=41d0e0ef37804da4be700d34a3bcf7fd)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:55.360578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91beaf8-c4c2-426d-8c4a-a13f400344bf admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:55.506930 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-a91beaf8-c4c2-426d-8c4a-a13f400344bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41d0e0ef37804da4be700d34a3bcf7fd', 'request_id': 'req-a91beaf8-c4c2-426d-8c4a-a13f400344bf'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:33:55.528822 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-a91beaf8-c4c2-426d-8c4a-a13f400344bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41d0e0ef37804da4be700d34a3bcf7fd', 'request_id': 'req-a91beaf8-c4c2-426d-8c4a-a13f400344bf'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:33:55.553146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-a91beaf8-c4c2-426d-8c4a-a13f400344bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41d0e0ef37804da4be700d34a3bcf7fd', 'request_id': 'req-a91beaf8-c4c2-426d-8c4a-a13f400344bf'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:33:55.573965 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-a91beaf8-c4c2-426d-8c4a-a13f400344bf admin admin] The token cache is being invalidate because project 41d0e0ef37804da4be700d34a3bcf7fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:33:55.574525 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-a91beaf8-c4c2-426d-8c4a-a13f400344bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:33:55.575373 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-a91beaf8-c4c2-426d-8c4a-a13f400344bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:33:55.577591 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 835/1683] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:33:55 2022] DELETE /identity/v3/projects/41d0e0ef37804da4be700d34a3bcf7fd => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:33:55.581876 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef434799-d581-4129-999a-acb11507cbdb None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:55.595679 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef434799-d581-4129-999a-acb11507cbdb None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:55.744072 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc31c1e-bd0b-423e-b099-8141a57b106d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:55.745072 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc31c1e-bd0b-423e-b099-8141a57b106d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:55.749477 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc31c1e-bd0b-423e-b099-8141a57b106d admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:55.751540 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc31c1e-bd0b-423e-b099-8141a57b106d admin admin] PATH_INFO: `/v3/users/391d08cff23c4be7bbb4dc4e5c940903` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:55.755226 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc31c1e-bd0b-423e-b099-8141a57b106d admin admin] RBAC: Authorizing `identity:delete_user(user_id=391d08cff23c4be7bbb4dc4e5c940903)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:55.758740 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc31c1e-bd0b-423e-b099-8141a57b106d admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:55.902338 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-bbc31c1e-bd0b-423e-b099-8141a57b106d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '391d08cff23c4be7bbb4dc4e5c940903'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:33:55.969351 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-bbc31c1e-bd0b-423e-b099-8141a57b106d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '391d08cff23c4be7bbb4dc4e5c940903'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:33:55.970842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-bbc31c1e-bd0b-423e-b099-8141a57b106d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '391d08cff23c4be7bbb4dc4e5c940903'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:33:55.983511 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-bbc31c1e-bd0b-423e-b099-8141a57b106d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '391d08cff23c4be7bbb4dc4e5c940903'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:33:56.001172 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-bbc31c1e-bd0b-423e-b099-8141a57b106d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '391d08cff23c4be7bbb4dc4e5c940903'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:33:56.025743 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 849/1684] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:33:55 2022] DELETE /identity/v3/users/391d08cff23c4be7bbb4dc4e5c940903 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:33:56.025821 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0c1f1-cd09-4167-9a87-c17ba5f50f33 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:56.025821 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0c1f1-cd09-4167-9a87-c17ba5f50f33 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:56.025821 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0c1f1-cd09-4167-9a87-c17ba5f50f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:56.085200 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-8cf0c1f1-cd09-4167-9a87-c17ba5f50f33 None None] MFA Rules not processed for user `bd41f419750140268f4d4b77456065c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:56.087734 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-8cf0c1f1-cd09-4167-9a87-c17ba5f50f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:56.222455 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 836/1685] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 12 09:33:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:56.422751 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc31c1e-bd0b-423e-b099-8141a57b106d admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:56.425422 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-bbc31c1e-bd0b-423e-b099-8141a57b106d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:56.656815 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc31c1e-bd0b-423e-b099-8141a57b106d admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:56.692292 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b65ae9-48fb-4d44-bddb-d9342c9b9a35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7693a31911346f9bb2c01efcd8e16e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:56.693544 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b65ae9-48fb-4d44-bddb-d9342c9b9a35 service swift] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:56.693544 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b65ae9-48fb-4d44-bddb-d9342c9b9a35 service swift] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:56.693544 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b65ae9-48fb-4d44-bddb-d9342c9b9a35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:56.706689 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b65ae9-48fb-4d44-bddb-d9342c9b9a35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:56.708929 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b65ae9-48fb-4d44-bddb-d9342c9b9a35 service swift] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:56.756403 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 850/1686] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 12 09:33:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 09:33:58.819174 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5bc2f-800a-466a-b73a-4341297d7bca None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:58.820489 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5bc2f-800a-466a-b73a-4341297d7bca None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:58.820994 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5bc2f-800a-466a-b73a-4341297d7bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:58.892534 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-d6f5bc2f-800a-466a-b73a-4341297d7bca None None] MFA Rules not processed for user `2efdff1c390f4271963e932af8abd473`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:58.897949 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-d6f5bc2f-800a-466a-b73a-4341297d7bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:59.062333 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 837/1687] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:33:59.094329 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b65ae9-48fb-4d44-bddb-d9342c9b9a35 service swift] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:59.096830 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-d9b65ae9-48fb-4d44-bddb-d9342c9b9a35 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:59.343298 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b65ae9-48fb-4d44-bddb-d9342c9b9a35 service swift] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:59.356026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5bc2f-800a-466a-b73a-4341297d7bca None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:33:59.358980 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-d6f5bc2f-800a-466a-b73a-4341297d7bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:59.375642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f45459-5faa-4439-914d-89a5d9ae6d00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:59.376482 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f45459-5faa-4439-914d-89a5d9ae6d00 service nova] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:59.377883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f45459-5faa-4439-914d-89a5d9ae6d00 service nova] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:59.379561 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f45459-5faa-4439-914d-89a5d9ae6d00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:59.404742 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f45459-5faa-4439-914d-89a5d9ae6d00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:59.408883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f45459-5faa-4439-914d-89a5d9ae6d00 service nova] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:59.443297 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 851/1688] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:33:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:33:59.541557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5bc2f-800a-466a-b73a-4341297d7bca None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:33:59.556026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066fe4e-5c6d-40f5-bab2-a786f19a41d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:33:59.557136 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066fe4e-5c6d-40f5-bab2-a786f19a41d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:59.557571 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066fe4e-5c6d-40f5-bab2-a786f19a41d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:59.558067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066fe4e-5c6d-40f5-bab2-a786f19a41d9 admin admin] PATH_INFO: `/v3/projects/fab190a9e4e54d22af5be0d8a8df03dd` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:59.562802 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066fe4e-5c6d-40f5-bab2-a786f19a41d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fab190a9e4e54d22af5be0d8a8df03dd)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:33:59.565290 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066fe4e-5c6d-40f5-bab2-a786f19a41d9 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:33:59.696419 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ab2fd-9e03-453e-9c88-af801f946049 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:59.696702 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ab2fd-9e03-453e-9c88-af801f946049 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:59.696975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ab2fd-9e03-453e-9c88-af801f946049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:59.747815 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e066fe4e-5c6d-40f5-bab2-a786f19a41d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fab190a9e4e54d22af5be0d8a8df03dd', 'request_id': 'req-e066fe4e-5c6d-40f5-bab2-a786f19a41d9'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:33:59.770840 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e066fe4e-5c6d-40f5-bab2-a786f19a41d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fab190a9e4e54d22af5be0d8a8df03dd', 'request_id': 'req-e066fe4e-5c6d-40f5-bab2-a786f19a41d9'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:33:59.789492 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-d98ab2fd-9e03-453e-9c88-af801f946049 None None] MFA Rules not processed for user `0b01be56426e4ff1a09577f30fb79f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:59.790751 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-d98ab2fd-9e03-453e-9c88-af801f946049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:33:59.799065 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e066fe4e-5c6d-40f5-bab2-a786f19a41d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fab190a9e4e54d22af5be0d8a8df03dd', 'request_id': 'req-e066fe4e-5c6d-40f5-bab2-a786f19a41d9'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:33:59.826640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e066fe4e-5c6d-40f5-bab2-a786f19a41d9 admin admin] The token cache is being invalidate because project fab190a9e4e54d22af5be0d8a8df03dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:33:59.831247 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e066fe4e-5c6d-40f5-bab2-a786f19a41d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:33:59.832134 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e066fe4e-5c6d-40f5-bab2-a786f19a41d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:33:59.841007 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 838/1689] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:33:59 2022] DELETE /identity/v3/projects/fab190a9e4e54d22af5be0d8a8df03dd => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:33:59.844240 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf20d81-b13a-4652-9932-9c1b0cccfafa None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:33:59.844715 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf20d81-b13a-4652-9932-9c1b0cccfafa None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:33:59.845166 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf20d81-b13a-4652-9932-9c1b0cccfafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:33:59.904886 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-cbf20d81-b13a-4652-9932-9c1b0cccfafa None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:33:59.906447 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-cbf20d81-b13a-4652-9932-9c1b0cccfafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:00.010105 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 839/1690] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:00.021130 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294f58b-610c-4ccc-be48-e8c5b28769df None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:00.021550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294f58b-610c-4ccc-be48-e8c5b28769df None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:00.021980 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294f58b-610c-4ccc-be48-e8c5b28769df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:00.048608 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 852/1691] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:33:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:34:00.062970 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71420a7-8bc4-4fff-85a7-08b8d7478668 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:00.063359 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71420a7-8bc4-4fff-85a7-08b8d7478668 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:00.063643 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71420a7-8bc4-4fff-85a7-08b8d7478668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:00.068378 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-3294f58b-610c-4ccc-be48-e8c5b28769df None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:00.071628 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-3294f58b-610c-4ccc-be48-e8c5b28769df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:00.109531 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 840/1692] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:34:00.110759 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294f58b-610c-4ccc-be48-e8c5b28769df None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:00.146966 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294f58b-610c-4ccc-be48-e8c5b28769df None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:00.153241 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69913bde-320c-4a7b-b3da-96eecff6c49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:00.154720 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69913bde-320c-4a7b-b3da-96eecff6c49c admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:00.155216 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69913bde-320c-4a7b-b3da-96eecff6c49c admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:00.155695 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69913bde-320c-4a7b-b3da-96eecff6c49c admin admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:00.157545 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69913bde-320c-4a7b-b3da-96eecff6c49c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:34:00.158164 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69913bde-320c-4a7b-b3da-96eecff6c49c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:00.160790 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69913bde-320c-4a7b-b3da-96eecff6c49c admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:00.160900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-a71420a7-8bc4-4fff-85a7-08b8d7478668 None None] MFA Rules not processed for user `0b01be56426e4ff1a09577f30fb79f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:00.165258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-a71420a7-8bc4-4fff-85a7-08b8d7478668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:00.175282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 841/1693] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:34:00.179324 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69913bde-320c-4a7b-b3da-96eecff6c49c admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:00.186647 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 853/1694] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:34:00.192542 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69913bde-320c-4a7b-b3da-96eecff6c49c admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:00.198930 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3cede-615a-4ced-9111-60138e617a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:00.199904 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3cede-615a-4ced-9111-60138e617a2c admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:00.200426 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3cede-615a-4ced-9111-60138e617a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:00.200951 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3cede-615a-4ced-9111-60138e617a2c admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:00.201060 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71420a7-8bc4-4fff-85a7-08b8d7478668 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:00.202155 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3cede-615a-4ced-9111-60138e617a2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:00.204160 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-a71420a7-8bc4-4fff-85a7-08b8d7478668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:00.205154 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3cede-615a-4ced-9111-60138e617a2c admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:00.262095 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 842/1695] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:34:00 2022] POST /identity/v3/projects => generated 405 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:34:00.266695 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3cede-615a-4ced-9111-60138e617a2c admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:00.344166 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71420a7-8bc4-4fff-85a7-08b8d7478668 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:00.366616 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3cede-615a-4ced-9111-60138e617a2c admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:00.373786 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fb485-85da-4c8f-b726-44cf9c3c7ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:00.375003 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fb485-85da-4c8f-b726-44cf9c3c7ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:00.375425 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fb485-85da-4c8f-b726-44cf9c3c7ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:00.375844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fb485-85da-4c8f-b726-44cf9c3c7ab9 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:00.376857 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6fb485-85da-4c8f-b726-44cf9c3c7ab9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:00.379669 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6fb485-85da-4c8f-b726-44cf9c3c7ab9 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:00.407799 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 843/1696] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:34:00 2022] POST /identity/v3/users => generated 303 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:00.411615 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fb485-85da-4c8f-b726-44cf9c3c7ab9 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:00.425996 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fb485-85da-4c8f-b726-44cf9c3c7ab9 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:00.434139 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913090de-3ea1-4c94-9f27-cf7a766c350b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:00.435048 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913090de-3ea1-4c94-9f27-cf7a766c350b admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:00.435468 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913090de-3ea1-4c94-9f27-cf7a766c350b admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:00.435903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913090de-3ea1-4c94-9f27-cf7a766c350b admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:00.436933 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913090de-3ea1-4c94-9f27-cf7a766c350b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:00.439753 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913090de-3ea1-4c94-9f27-cf7a766c350b admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:00.457490 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 844/1697] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:00.462669 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913090de-3ea1-4c94-9f27-cf7a766c350b admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:00.481644 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913090de-3ea1-4c94-9f27-cf7a766c350b admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:00.489834 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43751261-209e-404b-9547-3d6578e7ac79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:00.491279 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43751261-209e-404b-9547-3d6578e7ac79 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:00.492722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43751261-209e-404b-9547-3d6578e7ac79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:00.492722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43751261-209e-404b-9547-3d6578e7ac79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:00.493377 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43751261-209e-404b-9547-3d6578e7ac79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:00.496592 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43751261-209e-404b-9547-3d6578e7ac79 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:00.500878 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c81319-f0b4-404c-9496-527a3488d0ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:00.501807 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c81319-f0b4-404c-9496-527a3488d0ba service nova] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:00.502388 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c81319-f0b4-404c-9496-527a3488d0ba service nova] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:00.502687 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c81319-f0b4-404c-9496-527a3488d0ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:00.511770 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 845/1698] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 09:34:00.516053 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43751261-209e-404b-9547-3d6578e7ac79 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:00.535051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43751261-209e-404b-9547-3d6578e7ac79 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:00.542984 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc94bab-d312-4be1-9aeb-84103c51cc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:00.542984 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc94bab-d312-4be1-9aeb-84103c51cc28 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:00.542984 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc94bab-d312-4be1-9aeb-84103c51cc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:00.542984 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc94bab-d312-4be1-9aeb-84103c51cc28 admin admin] PATH_INFO: `/v3/projects/4f4faf77fa1c4d4abe39ef6577542579/users/c9ca1831b9d64d189dafac0c340cb0b9/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:00.558465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc94bab-d312-4be1-9aeb-84103c51cc28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f4faf77fa1c4d4abe39ef6577542579, user_id=c9ca1831b9d64d189dafac0c340cb0b9, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:00.561126 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc94bab-d312-4be1-9aeb-84103c51cc28 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:00.581388 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 846/1699] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:00 2022] PUT /identity/v3/projects/4f4faf77fa1c4d4abe39ef6577542579/users/c9ca1831b9d64d189dafac0c340cb0b9/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:00.594856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87ea62-9882-4f9f-a110-54e802dd26ba None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:00.595174 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87ea62-9882-4f9f-a110-54e802dd26ba None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:00.595464 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87ea62-9882-4f9f-a110-54e802dd26ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:00.624357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c81319-f0b4-404c-9496-527a3488d0ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:00.629288 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c81319-f0b4-404c-9496-527a3488d0ba service nova] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:00.645486 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-5f87ea62-9882-4f9f-a110-54e802dd26ba None None] MFA Rules not processed for user `c9ca1831b9d64d189dafac0c340cb0b9`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:00.647676 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-5f87ea62-9882-4f9f-a110-54e802dd26ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:00.655853 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 854/1700] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:00.753082 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 847/1701] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:00 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:00.756285 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c81319-f0b4-404c-9496-527a3488d0ba service nova] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:00.798937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c81319-f0b4-404c-9496-527a3488d0ba service nova] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:01.031150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f97b5-e5f1-48d9-8e50-e14e40a3de52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:01.032207 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f97b5-e5f1-48d9-8e50-e14e40a3de52 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:01.032949 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f97b5-e5f1-48d9-8e50-e14e40a3de52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:01.033659 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f97b5-e5f1-48d9-8e50-e14e40a3de52 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:01.034963 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f97b5-e5f1-48d9-8e50-e14e40a3de52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:01.046201 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f97b5-e5f1-48d9-8e50-e14e40a3de52 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:01.161524 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 855/1702] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:34:00 2022] POST /identity/v3/projects => generated 409 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:01.166612 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87ea62-9882-4f9f-a110-54e802dd26ba None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:01.184651 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87ea62-9882-4f9f-a110-54e802dd26ba None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:01.393082 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab64636-db79-40e3-9ba2-31d806bf38cf None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:01.393421 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab64636-db79-40e3-9ba2-31d806bf38cf None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:01.393704 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab64636-db79-40e3-9ba2-31d806bf38cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:01.408163 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc45596-3a93-453c-be76-0249ac2cc1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:01.408881 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc45596-3a93-453c-be76-0249ac2cc1d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:01.409278 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc45596-3a93-453c-be76-0249ac2cc1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:01.409451 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc45596-3a93-453c-be76-0249ac2cc1d0 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:01.414404 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc45596-3a93-453c-be76-0249ac2cc1d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:01.418533 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc45596-3a93-453c-be76-0249ac2cc1d0 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:01.463819 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-eab64636-db79-40e3-9ba2-31d806bf38cf None None] MFA Rules not processed for user `bf7b793f84bd4a72a68d5ab65221e1a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:01.465678 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-eab64636-db79-40e3-9ba2-31d806bf38cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:01.516479 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 848/1703] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:34:01 2022] POST /identity/v3/users => generated 311 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:01.517864 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9743e-b524-43ca-bee6-dee803fb4902 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:01.518186 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9743e-b524-43ca-bee6-dee803fb4902 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:01.518469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9743e-b524-43ca-bee6-dee803fb4902 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:01.531412 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 849/1704] 10.222.0.60 () {54 vars in 912 bytes} [Thu May 12 09:34:01 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:34:01.536207 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9743e-b524-43ca-bee6-dee803fb4902 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:01.566236 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9743e-b524-43ca-bee6-dee803fb4902 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:01.594850 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36f879-ac2b-420d-bbce-76c300b95355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:01.595504 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36f879-ac2b-420d-bbce-76c300b95355 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:01.601115 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36f879-ac2b-420d-bbce-76c300b95355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:01.602038 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36f879-ac2b-420d-bbce-76c300b95355 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:01.602864 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36f879-ac2b-420d-bbce-76c300b95355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:01.607481 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36f879-ac2b-420d-bbce-76c300b95355 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:01.633384 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 856/1705] 10.222.0.65 () {58 vars in 1015 bytes} [Thu May 12 09:34:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:01.635472 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1edaa-75ad-4a43-a9dd-412a53886f49 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:01.635911 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1edaa-75ad-4a43-a9dd-412a53886f49 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:01.636564 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1edaa-75ad-4a43-a9dd-412a53886f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:01.645528 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 850/1706] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:01.653938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36f879-ac2b-420d-bbce-76c300b95355 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:01.671805 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36f879-ac2b-420d-bbce-76c300b95355 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:01.683612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-b8a1edaa-75ad-4a43-a9dd-412a53886f49 None None] MFA Rules not processed for user `bf7b793f84bd4a72a68d5ab65221e1a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:01.685227 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-b8a1edaa-75ad-4a43-a9dd-412a53886f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:01.699113 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b531e33-ca43-4677-bfa6-d8bb2342e95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:01.701074 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 857/1707] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 12 09:34:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:01.704239 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b531e33-ca43-4677-bfa6-d8bb2342e95f admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:01.704535 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b531e33-ca43-4677-bfa6-d8bb2342e95f admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:01.704821 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b531e33-ca43-4677-bfa6-d8bb2342e95f admin admin] PATH_INFO: `/v3/projects/015b0e31e8334216aef96a6cae227a62/users/81f412441fb24d3d904fd86150ac8ddb/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:01.715394 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1edaa-75ad-4a43-a9dd-412a53886f49 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:01.717352 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-b8a1edaa-75ad-4a43-a9dd-412a53886f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:01.735848 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1edaa-75ad-4a43-a9dd-412a53886f49 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:01.762115 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b531e33-ca43-4677-bfa6-d8bb2342e95f admin admin] RBAC: Authorizing `identity:create_grant(project_id=015b0e31e8334216aef96a6cae227a62, user_id=81f412441fb24d3d904fd86150ac8ddb, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:01.767117 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b531e33-ca43-4677-bfa6-d8bb2342e95f admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:01.779530 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a71a5-b0a2-4fa8-aa49-e9cb3098f657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:01.780239 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a71a5-b0a2-4fa8-aa49-e9cb3098f657 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:01.780526 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a71a5-b0a2-4fa8-aa49-e9cb3098f657 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:01.780799 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a71a5-b0a2-4fa8-aa49-e9cb3098f657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:01.821588 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a71a5-b0a2-4fa8-aa49-e9cb3098f657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:01.824278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a71a5-b0a2-4fa8-aa49-e9cb3098f657 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:01.837666 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 851/1708] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:01 2022] PUT /identity/v3/projects/015b0e31e8334216aef96a6cae227a62/users/81f412441fb24d3d904fd86150ac8ddb/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:01.841403 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b531e33-ca43-4677-bfa6-d8bb2342e95f admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:01.845633 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 858/1709] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 09:34:02.056926 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b531e33-ca43-4677-bfa6-d8bb2342e95f admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:02.064004 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b569ef-140d-46fd-851d-b82ee7862b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:02.065081 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b569ef-140d-46fd-851d-b82ee7862b9d admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:02.065607 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b569ef-140d-46fd-851d-b82ee7862b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:02.066129 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b569ef-140d-46fd-851d-b82ee7862b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:02.067371 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b569ef-140d-46fd-851d-b82ee7862b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:02.069373 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b569ef-140d-46fd-851d-b82ee7862b9d admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:02.096505 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 852/1710] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:02.103917 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a71a5-b0a2-4fa8-aa49-e9cb3098f657 service neutron] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:02.137250 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a71a5-b0a2-4fa8-aa49-e9cb3098f657 service neutron] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:02.159005 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd3c67-1b3a-4896-8f17-1e3422b51a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:02.159940 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd3c67-1b3a-4896-8f17-1e3422b51a35 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:02.160204 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd3c67-1b3a-4896-8f17-1e3422b51a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:02.160478 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd3c67-1b3a-4896-8f17-1e3422b51a35 admin admin] PATH_INFO: `/v3/projects/015b0e31e8334216aef96a6cae227a62/users/81f412441fb24d3d904fd86150ac8ddb/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:02.167415 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd3c67-1b3a-4896-8f17-1e3422b51a35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=015b0e31e8334216aef96a6cae227a62, user_id=81f412441fb24d3d904fd86150ac8ddb, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:02.170404 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd3c67-1b3a-4896-8f17-1e3422b51a35 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:02.218301 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 859/1711] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:02 2022] PUT /identity/v3/projects/015b0e31e8334216aef96a6cae227a62/users/81f412441fb24d3d904fd86150ac8ddb/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:02.219985 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fb452-cd5d-4515-9de9-74846761c8e5 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:02.220484 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fb452-cd5d-4515-9de9-74846761c8e5 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:02.220588 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fb452-cd5d-4515-9de9-74846761c8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:02.315204 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-620fb452-cd5d-4515-9de9-74846761c8e5 None None] MFA Rules not processed for user `81f412441fb24d3d904fd86150ac8ddb`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:02.316415 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-620fb452-cd5d-4515-9de9-74846761c8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:02.480959 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 853/1712] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:02 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:02.519231 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd3c67-1b3a-4896-8f17-1e3422b51a35 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:02.521009 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-74cd3c67-1b3a-4896-8f17-1e3422b51a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:02.623554 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da91955-301a-4a7c-8fb4-e5cbf6c57d27 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:02.623894 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da91955-301a-4a7c-8fb4-e5cbf6c57d27 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:02.624183 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da91955-301a-4a7c-8fb4-e5cbf6c57d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:02.663283 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-8da91955-301a-4a7c-8fb4-e5cbf6c57d27 None None] MFA Rules not processed for user `2efdff1c390f4271963e932af8abd473`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:02.665131 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-8da91955-301a-4a7c-8fb4-e5cbf6c57d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:02.722367 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd3c67-1b3a-4896-8f17-1e3422b51a35 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:02.740101 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31d840-4be6-4744-afb9-3d75ba592a1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:02.740776 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31d840-4be6-4744-afb9-3d75ba592a1c service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:02.741060 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31d840-4be6-4744-afb9-3d75ba592a1c service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:02.741388 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 854/1713] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:02.742764 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31d840-4be6-4744-afb9-3d75ba592a1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:02.778537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31d840-4be6-4744-afb9-3d75ba592a1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:02.785077 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31d840-4be6-4744-afb9-3d75ba592a1c service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:02.814934 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 860/1714] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:02 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:03.269475 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da91955-301a-4a7c-8fb4-e5cbf6c57d27 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:03.270748 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-8da91955-301a-4a7c-8fb4-e5cbf6c57d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:03.312920 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31d840-4be6-4744-afb9-3d75ba592a1c service cinder] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:03.322470 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-5c31d840-4be6-4744-afb9-3d75ba592a1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:03.342439 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31d840-4be6-4744-afb9-3d75ba592a1c service cinder] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:03.367075 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59549131-c774-485d-b63c-b114326d2b1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:03.368937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59549131-c774-485d-b63c-b114326d2b1c service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:03.370015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59549131-c774-485d-b63c-b114326d2b1c service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:03.370779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59549131-c774-485d-b63c-b114326d2b1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:03.550536 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59549131-c774-485d-b63c-b114326d2b1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:03.554496 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59549131-c774-485d-b63c-b114326d2b1c service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:03.577608 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 861/1715] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:03 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:03.598380 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da91955-301a-4a7c-8fb4-e5cbf6c57d27 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:03.622196 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc7962-40de-4746-85c3-ad43d58ae747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:03.623387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc7962-40de-4746-85c3-ad43d58ae747 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:03.626038 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc7962-40de-4746-85c3-ad43d58ae747 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:03.626782 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc7962-40de-4746-85c3-ad43d58ae747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:03.661118 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc7962-40de-4746-85c3-ad43d58ae747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:03.669405 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc7962-40de-4746-85c3-ad43d58ae747 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:03.726894 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 855/1716] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:04.046672 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5c10c-0b6f-416e-b913-02b70f6d2358 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:04.047171 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5c10c-0b6f-416e-b913-02b70f6d2358 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:04.047462 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5c10c-0b6f-416e-b913-02b70f6d2358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:04.092700 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-60b5c10c-0b6f-416e-b913-02b70f6d2358 None None] MFA Rules not processed for user `0b01be56426e4ff1a09577f30fb79f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:04.094588 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-60b5c10c-0b6f-416e-b913-02b70f6d2358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:04.238891 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 862/1717] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:04.972176 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedeb916-1a3b-4400-91bf-ae0b5413f2e8 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:04.973234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedeb916-1a3b-4400-91bf-ae0b5413f2e8 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:04.973649 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedeb916-1a3b-4400-91bf-ae0b5413f2e8 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:04.975816 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 856/1718] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 12 09:34:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:34:04.986048 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08475c-4da0-408f-b138-a3c865682cff None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:04.990717 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08475c-4da0-408f-b138-a3c865682cff None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:04.991533 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08475c-4da0-408f-b138-a3c865682cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:05.035661 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-ef08475c-4da0-408f-b138-a3c865682cff None None] MFA Rules not processed for user `2915babd40aa42e8bf7cc85c5a97daa6`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:05.037554 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-ef08475c-4da0-408f-b138-a3c865682cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:05.138061 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 863/1719] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 12 09:34:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:05.179134 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedeb916-1a3b-4400-91bf-ae0b5413f2e8 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:05.198415 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedeb916-1a3b-4400-91bf-ae0b5413f2e8 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:05.204810 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3130a41-dcce-4425-92a3-b2c0360bf6be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:05.205465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3130a41-dcce-4425-92a3-b2c0360bf6be service nova] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:05.205748 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3130a41-dcce-4425-92a3-b2c0360bf6be service nova] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:05.206057 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3130a41-dcce-4425-92a3-b2c0360bf6be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:05.218989 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3130a41-dcce-4425-92a3-b2c0360bf6be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:05.220575 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3130a41-dcce-4425-92a3-b2c0360bf6be service nova] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:05.249046 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 857/1720] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:07.583929 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08475c-4da0-408f-b138-a3c865682cff None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:07.586712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-ef08475c-4da0-408f-b138-a3c865682cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:07.678318 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08475c-4da0-408f-b138-a3c865682cff None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:07.683014 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689dd599-59a9-462a-ac9b-798011ce6e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:07.683888 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dd599-59a9-462a-ac9b-798011ce6e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:07.684166 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dd599-59a9-462a-ac9b-798011ce6e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:07.684436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689dd599-59a9-462a-ac9b-798011ce6e70 admin admin] PATH_INFO: `/v3/users/b5b210bfb3f645348f521d7e2aee6bd1` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:07.685608 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689dd599-59a9-462a-ac9b-798011ce6e70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5b210bfb3f645348f521d7e2aee6bd1)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:07.687593 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689dd599-59a9-462a-ac9b-798011ce6e70 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:07.744069 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-689dd599-59a9-462a-ac9b-798011ce6e70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5b210bfb3f645348f521d7e2aee6bd1'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:07.759526 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-689dd599-59a9-462a-ac9b-798011ce6e70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5b210bfb3f645348f521d7e2aee6bd1'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:07.760288 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-689dd599-59a9-462a-ac9b-798011ce6e70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5b210bfb3f645348f521d7e2aee6bd1'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:07.769211 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-689dd599-59a9-462a-ac9b-798011ce6e70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5b210bfb3f645348f521d7e2aee6bd1'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:07.779652 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-689dd599-59a9-462a-ac9b-798011ce6e70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5b210bfb3f645348f521d7e2aee6bd1'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:07.786975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 864/1721] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:34:07 2022] DELETE /identity/v3/users/b5b210bfb3f645348f521d7e2aee6bd1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:07.792273 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1c95f-45a4-4c97-810c-9bce756caa90 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:07.793566 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1c95f-45a4-4c97-810c-9bce756caa90 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:07.793566 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1c95f-45a4-4c97-810c-9bce756caa90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:07.820557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-5aa1c95f-45a4-4c97-810c-9bce756caa90 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:07.821974 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-5aa1c95f-45a4-4c97-810c-9bce756caa90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:07.899713 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 858/1722] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:34:07.913084 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689dd599-59a9-462a-ac9b-798011ce6e70 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:07.915158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-689dd599-59a9-462a-ac9b-798011ce6e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:08.022067 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689dd599-59a9-462a-ac9b-798011ce6e70 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:08.034010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb737da-f097-477a-a9c0-14e90f47a6ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:08.034774 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb737da-f097-477a-a9c0-14e90f47a6ff service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:08.035061 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb737da-f097-477a-a9c0-14e90f47a6ff service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:08.035413 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb737da-f097-477a-a9c0-14e90f47a6ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:08.054899 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb737da-f097-477a-a9c0-14e90f47a6ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:08.056765 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb737da-f097-477a-a9c0-14e90f47a6ff service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:08.106106 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 865/1723] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:08.522852 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1c95f-45a4-4c97-810c-9bce756caa90 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:08.526967 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-5aa1c95f-45a4-4c97-810c-9bce756caa90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:08.551750 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1c95f-45a4-4c97-810c-9bce756caa90 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:08.561183 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127e99b-6c72-4d7e-8924-9743c8aed223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:08.563370 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127e99b-6c72-4d7e-8924-9743c8aed223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:08.580757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127e99b-6c72-4d7e-8924-9743c8aed223 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:08.582121 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127e99b-6c72-4d7e-8924-9743c8aed223 admin admin] PATH_INFO: `/v3/projects/48c6ab5a0a864171975aad8723b3ede8` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:08.586405 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127e99b-6c72-4d7e-8924-9743c8aed223 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48c6ab5a0a864171975aad8723b3ede8)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:08.591388 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127e99b-6c72-4d7e-8924-9743c8aed223 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:08.704347 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-f127e99b-6c72-4d7e-8924-9743c8aed223 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48c6ab5a0a864171975aad8723b3ede8', 'request_id': 'req-f127e99b-6c72-4d7e-8924-9743c8aed223'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:08.714184 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-f127e99b-6c72-4d7e-8924-9743c8aed223 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48c6ab5a0a864171975aad8723b3ede8', 'request_id': 'req-f127e99b-6c72-4d7e-8924-9743c8aed223'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:08.726572 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-f127e99b-6c72-4d7e-8924-9743c8aed223 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48c6ab5a0a864171975aad8723b3ede8', 'request_id': 'req-f127e99b-6c72-4d7e-8924-9743c8aed223'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:08.745179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-f127e99b-6c72-4d7e-8924-9743c8aed223 admin admin] The token cache is being invalidate because project 48c6ab5a0a864171975aad8723b3ede8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:34:08.745771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-f127e99b-6c72-4d7e-8924-9743c8aed223 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:08.746836 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-f127e99b-6c72-4d7e-8924-9743c8aed223 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:08.749053 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 859/1724] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:34:08 2022] DELETE /identity/v3/projects/48c6ab5a0a864171975aad8723b3ede8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:08.754627 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defd004-a496-4f66-b67c-78d390405e8e None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:08.755302 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defd004-a496-4f66-b67c-78d390405e8e None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:08.755302 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defd004-a496-4f66-b67c-78d390405e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:08.779726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-1defd004-a496-4f66-b67c-78d390405e8e None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:08.782714 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-1defd004-a496-4f66-b67c-78d390405e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:08.891189 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 866/1725] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:08.900841 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cea720-accc-4b98-a27d-af2f254e04b0 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:08.901769 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cea720-accc-4b98-a27d-af2f254e04b0 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:08.902251 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cea720-accc-4b98-a27d-af2f254e04b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:08.951481 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-80cea720-accc-4b98-a27d-af2f254e04b0 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:08.952751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-80cea720-accc-4b98-a27d-af2f254e04b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:08.977833 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1defd004-a496-4f66-b67c-78d390405e8e None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:08.979485 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-1defd004-a496-4f66-b67c-78d390405e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:08.984440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 860/1726] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:08.988333 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cea720-accc-4b98-a27d-af2f254e04b0 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:08.996684 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1defd004-a496-4f66-b67c-78d390405e8e None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:09.011512 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc79edb-0b60-498b-b201-303839b645ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:09.012663 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc79edb-0b60-498b-b201-303839b645ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:09.013090 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc79edb-0b60-498b-b201-303839b645ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:09.013556 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc79edb-0b60-498b-b201-303839b645ca admin admin] PATH_INFO: `/v3/users/5198751821904f849fea5424aa8f16ed` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:09.015259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cea720-accc-4b98-a27d-af2f254e04b0 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:09.015855 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc79edb-0b60-498b-b201-303839b645ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=5198751821904f849fea5424aa8f16ed)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:09.018147 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc79edb-0b60-498b-b201-303839b645ca admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:09.024757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0015f2-ad97-4d93-b077-0bf01e397147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:09.025568 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0015f2-ad97-4d93-b077-0bf01e397147 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:09.026125 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0015f2-ad97-4d93-b077-0bf01e397147 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:09.027444 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0015f2-ad97-4d93-b077-0bf01e397147 admin admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:09.028416 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0015f2-ad97-4d93-b077-0bf01e397147 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:34:09.028954 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0015f2-ad97-4d93-b077-0bf01e397147 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:09.031606 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0015f2-ad97-4d93-b077-0bf01e397147 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:09.073951 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 861/1727] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:34:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:34:09.086109 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0015f2-ad97-4d93-b077-0bf01e397147 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:09.130108 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-cbc79edb-0b60-498b-b201-303839b645ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5198751821904f849fea5424aa8f16ed'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:09.132174 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0015f2-ad97-4d93-b077-0bf01e397147 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:09.148875 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-cbc79edb-0b60-498b-b201-303839b645ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5198751821904f849fea5424aa8f16ed'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:09.149889 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-cbc79edb-0b60-498b-b201-303839b645ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5198751821904f849fea5424aa8f16ed'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:09.156936 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3099719-c778-4bdd-9501-66ffd289eb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:09.157684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3099719-c778-4bdd-9501-66ffd289eb6e admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:09.157963 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3099719-c778-4bdd-9501-66ffd289eb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:09.158428 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3099719-c778-4bdd-9501-66ffd289eb6e admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:09.159859 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3099719-c778-4bdd-9501-66ffd289eb6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:09.160725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-cbc79edb-0b60-498b-b201-303839b645ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5198751821904f849fea5424aa8f16ed'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:09.162937 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3099719-c778-4bdd-9501-66ffd289eb6e admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:09.180020 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-cbc79edb-0b60-498b-b201-303839b645ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5198751821904f849fea5424aa8f16ed'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:09.191131 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 867/1728] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:34:08 2022] DELETE /identity/v3/users/5198751821904f849fea5424aa8f16ed => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:09.196866 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8d6d9-5626-4a7d-adfa-1300fff3e4f3 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:09.196866 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8d6d9-5626-4a7d-adfa-1300fff3e4f3 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:09.196866 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8d6d9-5626-4a7d-adfa-1300fff3e4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:09.224731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 862/1729] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:34:09 2022] POST /identity/v3/projects => generated 365 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:09.225366 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3099719-c778-4bdd-9501-66ffd289eb6e admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:09.231895 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-a3099719-c778-4bdd-9501-66ffd289eb6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:09.233726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-19a8d6d9-5626-4a7d-adfa-1300fff3e4f3 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:09.236603 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-19a8d6d9-5626-4a7d-adfa-1300fff3e4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:09.367640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3099719-c778-4bdd-9501-66ffd289eb6e admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:09.373357 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ab2d7-ef68-415b-97a7-b362d4faf188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:09.374287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ab2d7-ef68-415b-97a7-b362d4faf188 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:09.374708 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ab2d7-ef68-415b-97a7-b362d4faf188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:09.375118 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ab2d7-ef68-415b-97a7-b362d4faf188 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:09.375948 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ab2d7-ef68-415b-97a7-b362d4faf188 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:09.378131 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ab2d7-ef68-415b-97a7-b362d4faf188 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:09.394572 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 868/1730] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:09.406180 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8d6d9-5626-4a7d-adfa-1300fff3e4f3 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:09.411220 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 863/1731] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:34:09 2022] POST /identity/v3/users => generated 283 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:09.414404 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-19a8d6d9-5626-4a7d-adfa-1300fff3e4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:09.418827 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ab2d7-ef68-415b-97a7-b362d4faf188 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:09.430926 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ab2d7-ef68-415b-97a7-b362d4faf188 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:09.436414 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c6570-8e98-4cd8-b0f1-110498118c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:09.437403 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c6570-8e98-4cd8-b0f1-110498118c8f admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:09.437855 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c6570-8e98-4cd8-b0f1-110498118c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:09.438428 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c6570-8e98-4cd8-b0f1-110498118c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:09.439309 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c6570-8e98-4cd8-b0f1-110498118c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:09.441121 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c6570-8e98-4cd8-b0f1-110498118c8f admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:09.454193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 864/1732] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:09.457939 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c6570-8e98-4cd8-b0f1-110498118c8f admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:09.481446 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c6570-8e98-4cd8-b0f1-110498118c8f admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:09.495734 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29748168-a24b-4265-a86c-50eb2950b076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:09.496726 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29748168-a24b-4265-a86c-50eb2950b076 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:09.497175 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29748168-a24b-4265-a86c-50eb2950b076 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:09.497589 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29748168-a24b-4265-a86c-50eb2950b076 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:09.498518 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29748168-a24b-4265-a86c-50eb2950b076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:09.502164 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29748168-a24b-4265-a86c-50eb2950b076 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:09.533725 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 865/1733] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:09.538556 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29748168-a24b-4265-a86c-50eb2950b076 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:09.550458 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8d6d9-5626-4a7d-adfa-1300fff3e4f3 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:09.560842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2212c2-3618-43de-9342-cded6f2dd641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:09.561731 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2212c2-3618-43de-9342-cded6f2dd641 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:09.562203 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2212c2-3618-43de-9342-cded6f2dd641 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:09.562730 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2212c2-3618-43de-9342-cded6f2dd641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:09.591909 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29748168-a24b-4265-a86c-50eb2950b076 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:09.593683 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2212c2-3618-43de-9342-cded6f2dd641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:09.595778 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2212c2-3618-43de-9342-cded6f2dd641 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:09.605535 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd267c-05ff-41a3-aac7-9378a84d4f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:09.606491 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd267c-05ff-41a3-aac7-9378a84d4f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:09.606774 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd267c-05ff-41a3-aac7-9378a84d4f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:09.607049 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd267c-05ff-41a3-aac7-9378a84d4f75 admin admin] PATH_INFO: `/v3/projects/fb5451d0a20e4399a8b2f38a2b6e1104/users/38eab68f0447448699e640e1bbda28b3/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:09.628034 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 869/1734] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:09.657109 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd267c-05ff-41a3-aac7-9378a84d4f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb5451d0a20e4399a8b2f38a2b6e1104, user_id=38eab68f0447448699e640e1bbda28b3, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:09.659823 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd267c-05ff-41a3-aac7-9378a84d4f75 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:09.689875 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 866/1735] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:09 2022] PUT /identity/v3/projects/fb5451d0a20e4399a8b2f38a2b6e1104/users/38eab68f0447448699e640e1bbda28b3/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:09.701142 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80217505-0f10-408b-9400-98dcc20d7203 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:09.701557 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80217505-0f10-408b-9400-98dcc20d7203 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:09.701840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80217505-0f10-408b-9400-98dcc20d7203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:09.769395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-80217505-0f10-408b-9400-98dcc20d7203 None None] MFA Rules not processed for user `38eab68f0447448699e640e1bbda28b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:09.772281 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-80217505-0f10-408b-9400-98dcc20d7203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:09.864838 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd267c-05ff-41a3-aac7-9378a84d4f75 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:09.865271 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 870/1736] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:09 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:09.936305 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd267c-05ff-41a3-aac7-9378a84d4f75 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:09.942459 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d9865-0c6d-4841-bfa2-1f7c1c76b568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:09.943212 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d9865-0c6d-4841-bfa2-1f7c1c76b568 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:09.943913 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d9865-0c6d-4841-bfa2-1f7c1c76b568 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:09.943913 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d9865-0c6d-4841-bfa2-1f7c1c76b568 admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:09.944607 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d9865-0c6d-4841-bfa2-1f7c1c76b568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:09.947510 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d9865-0c6d-4841-bfa2-1f7c1c76b568 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:10.017369 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 867/1737] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:34:09 2022] POST /identity/v3/projects => generated 365 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:34:10.021135 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80217505-0f10-408b-9400-98dcc20d7203 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:10.035830 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80217505-0f10-408b-9400-98dcc20d7203 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:10.198729 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c136a-b1ca-4e9f-bb30-a203e106819b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:10.199494 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c136a-b1ca-4e9f-bb30-a203e106819b admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:10.199787 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c136a-b1ca-4e9f-bb30-a203e106819b admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:10.200062 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c136a-b1ca-4e9f-bb30-a203e106819b admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:10.200922 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c136a-b1ca-4e9f-bb30-a203e106819b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:10.202751 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c136a-b1ca-4e9f-bb30-a203e106819b admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:10.267527 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 871/1738] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:34:10 2022] POST /identity/v3/users => generated 289 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:10.274815 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d9865-0c6d-4841-bfa2-1f7c1c76b568 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:10.277200 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c136a-b1ca-4e9f-bb30-a203e106819b admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:10.282471 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-c51c136a-b1ca-4e9f-bb30-a203e106819b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:10.292864 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d9865-0c6d-4841-bfa2-1f7c1c76b568 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:10.310444 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745158c2-2af7-4e05-b6a7-6b18986c7dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:10.311407 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745158c2-2af7-4e05-b6a7-6b18986c7dba admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:10.311864 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745158c2-2af7-4e05-b6a7-6b18986c7dba admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:10.312281 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745158c2-2af7-4e05-b6a7-6b18986c7dba admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:10.313186 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745158c2-2af7-4e05-b6a7-6b18986c7dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:10.317101 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745158c2-2af7-4e05-b6a7-6b18986c7dba admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:10.323137 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c136a-b1ca-4e9f-bb30-a203e106819b admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:10.333573 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 868/1739] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:10.340366 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745158c2-2af7-4e05-b6a7-6b18986c7dba admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:10.341219 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737c378-79a9-4c32-a9b5-794096e7f5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:10.342455 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737c378-79a9-4c32-a9b5-794096e7f5d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:10.342879 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737c378-79a9-4c32-a9b5-794096e7f5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:10.343290 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737c378-79a9-4c32-a9b5-794096e7f5d9 admin admin] PATH_INFO: `/v3/projects/1c9a6b59c9c04ea9ae9175d560f79471` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:10.345103 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7737c378-79a9-4c32-a9b5-794096e7f5d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c9a6b59c9c04ea9ae9175d560f79471)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:10.349843 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7737c378-79a9-4c32-a9b5-794096e7f5d9 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:10.380025 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745158c2-2af7-4e05-b6a7-6b18986c7dba admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:10.392315 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dda50c-f03f-4132-b260-0fc68a35053b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:10.393225 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dda50c-f03f-4132-b260-0fc68a35053b admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:10.393501 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dda50c-f03f-4132-b260-0fc68a35053b admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:10.393771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dda50c-f03f-4132-b260-0fc68a35053b admin admin] PATH_INFO: `/v3/projects/f8e20bc0e478465cad9203b773ec59d0/users/dd5ed64f111646b0bbf0b4735b6c2b59/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:10.463191 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dda50c-f03f-4132-b260-0fc68a35053b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8e20bc0e478465cad9203b773ec59d0, user_id=dd5ed64f111646b0bbf0b4735b6c2b59, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:10.483415 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dda50c-f03f-4132-b260-0fc68a35053b admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:10.522820 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-7737c378-79a9-4c32-a9b5-794096e7f5d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c9a6b59c9c04ea9ae9175d560f79471', 'request_id': 'req-7737c378-79a9-4c32-a9b5-794096e7f5d9'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:10.537824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 869/1740] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:10 2022] PUT /identity/v3/projects/f8e20bc0e478465cad9203b773ec59d0/users/dd5ed64f111646b0bbf0b4735b6c2b59/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:10.538281 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-7737c378-79a9-4c32-a9b5-794096e7f5d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c9a6b59c9c04ea9ae9175d560f79471', 'request_id': 'req-7737c378-79a9-4c32-a9b5-794096e7f5d9'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:10.538902 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dda50c-f03f-4132-b260-0fc68a35053b admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:10.558454 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-7737c378-79a9-4c32-a9b5-794096e7f5d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c9a6b59c9c04ea9ae9175d560f79471', 'request_id': 'req-7737c378-79a9-4c32-a9b5-794096e7f5d9'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:10.587255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-7737c378-79a9-4c32-a9b5-794096e7f5d9 admin admin] The token cache is being invalidate because project 1c9a6b59c9c04ea9ae9175d560f79471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:34:10.587255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-7737c378-79a9-4c32-a9b5-794096e7f5d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:10.587255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-7737c378-79a9-4c32-a9b5-794096e7f5d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:10.587255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 872/1741] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:34:10 2022] DELETE /identity/v3/projects/1c9a6b59c9c04ea9ae9175d560f79471 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:10.592000 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737c378-79a9-4c32-a9b5-794096e7f5d9 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:10.593444 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-7737c378-79a9-4c32-a9b5-794096e7f5d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:10.688012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dda50c-f03f-4132-b260-0fc68a35053b admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:10.692650 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737c378-79a9-4c32-a9b5-794096e7f5d9 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:10.692938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65fd0a-85e0-4ff5-b275-a26a1c0ddf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:10.693632 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65fd0a-85e0-4ff5-b275-a26a1c0ddf82 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:10.693942 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65fd0a-85e0-4ff5-b275-a26a1c0ddf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:10.694240 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65fd0a-85e0-4ff5-b275-a26a1c0ddf82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:10.694998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65fd0a-85e0-4ff5-b275-a26a1c0ddf82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:10.696622 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65fd0a-85e0-4ff5-b275-a26a1c0ddf82 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:10.698059 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e12a56-5e01-43ed-8ef7-9005d18aa709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:10.699129 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e12a56-5e01-43ed-8ef7-9005d18aa709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:10.699548 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e12a56-5e01-43ed-8ef7-9005d18aa709 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:10.700214 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e12a56-5e01-43ed-8ef7-9005d18aa709 admin admin] PATH_INFO: `/v3/users/25f8dbecb14a4cb68b94043191744430` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:10.701582 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e12a56-5e01-43ed-8ef7-9005d18aa709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25f8dbecb14a4cb68b94043191744430)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:10.703753 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e12a56-5e01-43ed-8ef7-9005d18aa709 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:10.710265 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 870/1742] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:10.711683 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65fd0a-85e0-4ff5-b275-a26a1c0ddf82 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:10.713376 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-7d65fd0a-85e0-4ff5-b275-a26a1c0ddf82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:10.726999 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65fd0a-85e0-4ff5-b275-a26a1c0ddf82 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:10.733255 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cb065-bf1e-4b0a-b9e0-7c48d7a996e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:10.734525 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cb065-bf1e-4b0a-b9e0-7c48d7a996e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:10.734861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cb065-bf1e-4b0a-b9e0-7c48d7a996e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:10.735168 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cb065-bf1e-4b0a-b9e0-7c48d7a996e1 admin admin] PATH_INFO: `/v3/projects/f8e20bc0e478465cad9203b773ec59d0/users/dd5ed64f111646b0bbf0b4735b6c2b59/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:10.737498 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4cb065-bf1e-4b0a-b9e0-7c48d7a996e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8e20bc0e478465cad9203b773ec59d0, user_id=dd5ed64f111646b0bbf0b4735b6c2b59, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:10.741986 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4cb065-bf1e-4b0a-b9e0-7c48d7a996e1 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:10.754178 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 871/1743] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:10 2022] PUT /identity/v3/projects/f8e20bc0e478465cad9203b773ec59d0/users/dd5ed64f111646b0bbf0b4735b6c2b59/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:10.764522 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669110b3-f0d3-4e0e-a96e-2ec6870c4f24 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:10.764830 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669110b3-f0d3-4e0e-a96e-2ec6870c4f24 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:10.765109 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669110b3-f0d3-4e0e-a96e-2ec6870c4f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:10.768295 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e0e12a56-5e01-43ed-8ef7-9005d18aa709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25f8dbecb14a4cb68b94043191744430'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:10.783099 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e0e12a56-5e01-43ed-8ef7-9005d18aa709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25f8dbecb14a4cb68b94043191744430'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:10.785518 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e0e12a56-5e01-43ed-8ef7-9005d18aa709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25f8dbecb14a4cb68b94043191744430'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:10.797444 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e0e12a56-5e01-43ed-8ef7-9005d18aa709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25f8dbecb14a4cb68b94043191744430'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:10.808125 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e0e12a56-5e01-43ed-8ef7-9005d18aa709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25f8dbecb14a4cb68b94043191744430'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:10.821637 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 873/1744] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:34:10 2022] DELETE /identity/v3/users/25f8dbecb14a4cb68b94043191744430 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:10.823104 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-669110b3-f0d3-4e0e-a96e-2ec6870c4f24 None None] MFA Rules not processed for user `dd5ed64f111646b0bbf0b4735b6c2b59`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:10.824595 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-669110b3-f0d3-4e0e-a96e-2ec6870c4f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:10.920896 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 872/1745] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:10 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:34:10.934256 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e12a56-5e01-43ed-8ef7-9005d18aa709 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:10.936033 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-e0e12a56-5e01-43ed-8ef7-9005d18aa709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:11.039729 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e12a56-5e01-43ed-8ef7-9005d18aa709 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:11.045327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17542ccc-3674-4478-8d76-d33633a3428d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:11.046710 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17542ccc-3674-4478-8d76-d33633a3428d service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:11.046993 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17542ccc-3674-4478-8d76-d33633a3428d service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:11.047265 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17542ccc-3674-4478-8d76-d33633a3428d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:11.061015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17542ccc-3674-4478-8d76-d33633a3428d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:11.062555 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17542ccc-3674-4478-8d76-d33633a3428d service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:11.074406 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 874/1746] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:10 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 09:34:11.172741 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669110b3-f0d3-4e0e-a96e-2ec6870c4f24 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:11.174343 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-669110b3-f0d3-4e0e-a96e-2ec6870c4f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:11.275943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669110b3-f0d3-4e0e-a96e-2ec6870c4f24 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:11.280831 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93e92a-73e9-4ded-9f09-9a66d6985707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:11.281704 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93e92a-73e9-4ded-9f09-9a66d6985707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:11.282148 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93e92a-73e9-4ded-9f09-9a66d6985707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:11.282759 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93e92a-73e9-4ded-9f09-9a66d6985707 admin admin] PATH_INFO: `/v3/projects/2aa59333ca2a45128ad19eadf45bdeaf` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:11.285637 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f93e92a-73e9-4ded-9f09-9a66d6985707 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aa59333ca2a45128ad19eadf45bdeaf)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:11.287604 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f93e92a-73e9-4ded-9f09-9a66d6985707 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:11.345472 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-9f93e92a-73e9-4ded-9f09-9a66d6985707 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aa59333ca2a45128ad19eadf45bdeaf', 'request_id': 'req-9f93e92a-73e9-4ded-9f09-9a66d6985707'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:11.351126 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-9f93e92a-73e9-4ded-9f09-9a66d6985707 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aa59333ca2a45128ad19eadf45bdeaf', 'request_id': 'req-9f93e92a-73e9-4ded-9f09-9a66d6985707'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:11.360581 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-9f93e92a-73e9-4ded-9f09-9a66d6985707 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aa59333ca2a45128ad19eadf45bdeaf', 'request_id': 'req-9f93e92a-73e9-4ded-9f09-9a66d6985707'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:11.373038 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-9f93e92a-73e9-4ded-9f09-9a66d6985707 admin admin] The token cache is being invalidate because project 2aa59333ca2a45128ad19eadf45bdeaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:34:11.373323 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-9f93e92a-73e9-4ded-9f09-9a66d6985707 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:11.374011 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-9f93e92a-73e9-4ded-9f09-9a66d6985707 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:11.375550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 873/1747] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:34:11 2022] DELETE /identity/v3/projects/2aa59333ca2a45128ad19eadf45bdeaf => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:11.380792 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831e659-f13c-420d-be7a-175d47af00bf None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:11.381163 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831e659-f13c-420d-be7a-175d47af00bf None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:11.381444 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831e659-f13c-420d-be7a-175d47af00bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:11.400235 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-9831e659-f13c-420d-be7a-175d47af00bf None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:11.402363 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-9831e659-f13c-420d-be7a-175d47af00bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:11.474447 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 875/1748] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:11.487260 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72eea9-0bc7-446f-89f6-7799b4f98012 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:11.487260 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72eea9-0bc7-446f-89f6-7799b4f98012 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:11.487260 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72eea9-0bc7-446f-89f6-7799b4f98012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:11.506412 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-cd72eea9-0bc7-446f-89f6-7799b4f98012 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:11.508428 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-cd72eea9-0bc7-446f-89f6-7799b4f98012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:11.525701 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 874/1749] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:34:11.530054 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831e659-f13c-420d-be7a-175d47af00bf None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:11.543507 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831e659-f13c-420d-be7a-175d47af00bf None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:11.548932 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f199a-cd89-4cd6-9552-583bca5a4409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:11.549931 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f199a-cd89-4cd6-9552-583bca5a4409 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:11.550095 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f199a-cd89-4cd6-9552-583bca5a4409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:11.550462 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f199a-cd89-4cd6-9552-583bca5a4409 admin admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:11.551225 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f199a-cd89-4cd6-9552-583bca5a4409 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:34:11.551604 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f199a-cd89-4cd6-9552-583bca5a4409 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:11.553315 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f199a-cd89-4cd6-9552-583bca5a4409 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:11.567692 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 876/1750] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:34:11.573828 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72eea9-0bc7-446f-89f6-7799b4f98012 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:11.579004 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f199a-cd89-4cd6-9552-583bca5a4409 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:11.580855 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-ac5f199a-cd89-4cd6-9552-583bca5a4409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:11.583297 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72eea9-0bc7-446f-89f6-7799b4f98012 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:11.588712 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9bae82-be70-4680-a130-5df0da7e6bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:11.589538 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bae82-be70-4680-a130-5df0da7e6bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:11.589949 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bae82-be70-4680-a130-5df0da7e6bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:11.590327 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bae82-be70-4680-a130-5df0da7e6bb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:11.591260 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9bae82-be70-4680-a130-5df0da7e6bb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:11.593265 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9bae82-be70-4680-a130-5df0da7e6bb3 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:11.601954 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f199a-cd89-4cd6-9552-583bca5a4409 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:11.617453 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2abbde0-4980-4d41-af84-95c0c82a94b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:11.618510 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abbde0-4980-4d41-af84-95c0c82a94b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:11.618825 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abbde0-4980-4d41-af84-95c0c82a94b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:11.619131 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abbde0-4980-4d41-af84-95c0c82a94b7 admin admin] PATH_INFO: `/v3/users/38eab68f0447448699e640e1bbda28b3` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:11.620363 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2abbde0-4980-4d41-af84-95c0c82a94b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38eab68f0447448699e640e1bbda28b3)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:11.622488 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2abbde0-4980-4d41-af84-95c0c82a94b7 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:11.631525 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 875/1751] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:34:11 2022] POST /identity/v3/projects => generated 355 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:34:11.632660 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9bae82-be70-4680-a130-5df0da7e6bb3 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:11.676733 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d2abbde0-4980-4d41-af84-95c0c82a94b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38eab68f0447448699e640e1bbda28b3'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:11.690865 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d2abbde0-4980-4d41-af84-95c0c82a94b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38eab68f0447448699e640e1bbda28b3'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:11.691779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d2abbde0-4980-4d41-af84-95c0c82a94b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38eab68f0447448699e640e1bbda28b3'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:11.699235 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9bae82-be70-4680-a130-5df0da7e6bb3 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:11.699926 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d2abbde0-4980-4d41-af84-95c0c82a94b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38eab68f0447448699e640e1bbda28b3'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:11.703991 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b373e5-7cd3-4c7a-912a-46551a2ff29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:11.704659 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b373e5-7cd3-4c7a-912a-46551a2ff29d admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:11.704937 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b373e5-7cd3-4c7a-912a-46551a2ff29d admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:11.705207 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b373e5-7cd3-4c7a-912a-46551a2ff29d admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:11.705888 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b373e5-7cd3-4c7a-912a-46551a2ff29d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:11.707470 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d2abbde0-4980-4d41-af84-95c0c82a94b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38eab68f0447448699e640e1bbda28b3'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:11.707975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b373e5-7cd3-4c7a-912a-46551a2ff29d admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:11.714226 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 877/1752] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:34:11 2022] DELETE /identity/v3/users/38eab68f0447448699e640e1bbda28b3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:11.718840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a53b47-5558-413f-8b6c-7075105efbbb None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:11.719144 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a53b47-5558-413f-8b6c-7075105efbbb None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:11.719425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a53b47-5558-413f-8b6c-7075105efbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:11.731882 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 876/1753] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:34:11 2022] POST /identity/v3/users => generated 278 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:34:11.735985 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b373e5-7cd3-4c7a-912a-46551a2ff29d admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:11.736979 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-f2a53b47-5558-413f-8b6c-7075105efbbb None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:11.737605 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-81b373e5-7cd3-4c7a-912a-46551a2ff29d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:11.738176 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-f2a53b47-5558-413f-8b6c-7075105efbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:11.749810 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b373e5-7cd3-4c7a-912a-46551a2ff29d admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:11.794896 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 878/1754] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:34:11.807898 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56c01b-fadc-4bce-9d00-93eee3be21ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:11.808739 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56c01b-fadc-4bce-9d00-93eee3be21ff admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:11.809030 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56c01b-fadc-4bce-9d00-93eee3be21ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:11.809310 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56c01b-fadc-4bce-9d00-93eee3be21ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:11.810074 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c56c01b-fadc-4bce-9d00-93eee3be21ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:11.811820 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c56c01b-fadc-4bce-9d00-93eee3be21ff admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:11.814229 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a53b47-5558-413f-8b6c-7075105efbbb None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:11.815991 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-f2a53b47-5558-413f-8b6c-7075105efbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:11.823181 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 877/1755] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 09:34:11.832025 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56c01b-fadc-4bce-9d00-93eee3be21ff admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:11.846366 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56c01b-fadc-4bce-9d00-93eee3be21ff admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:11.854438 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469b3d0-8159-4e1c-957f-3390bc6a9a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:11.855531 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469b3d0-8159-4e1c-957f-3390bc6a9a6d admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:11.856108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469b3d0-8159-4e1c-957f-3390bc6a9a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:11.856391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469b3d0-8159-4e1c-957f-3390bc6a9a6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:11.857194 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469b3d0-8159-4e1c-957f-3390bc6a9a6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:11.859599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469b3d0-8159-4e1c-957f-3390bc6a9a6d admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:11.870640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 878/1756] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:11.874596 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469b3d0-8159-4e1c-957f-3390bc6a9a6d admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:11.890113 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469b3d0-8159-4e1c-957f-3390bc6a9a6d admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:11.891114 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a53b47-5558-413f-8b6c-7075105efbbb None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:11.896512 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5fea8-67de-41ca-aa5e-e9a2ec54b361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:11.896850 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b77cf-1f2d-46d4-8e16-a13602997549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:11.897486 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5fea8-67de-41ca-aa5e-e9a2ec54b361 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:11.898034 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5fea8-67de-41ca-aa5e-e9a2ec54b361 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:11.898318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b77cf-1f2d-46d4-8e16-a13602997549 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:11.898480 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5fea8-67de-41ca-aa5e-e9a2ec54b361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:11.898880 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b77cf-1f2d-46d4-8e16-a13602997549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:11.899942 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b77cf-1f2d-46d4-8e16-a13602997549 admin admin] PATH_INFO: `/v3/projects/896b421dbd0e4ac4b576926da45b2053/users/422a67aaa9b34c29bd287df35e363529/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:11.912612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5fea8-67de-41ca-aa5e-e9a2ec54b361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:11.915048 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5fea8-67de-41ca-aa5e-e9a2ec54b361 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:11.922959 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b77cf-1f2d-46d4-8e16-a13602997549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=896b421dbd0e4ac4b576926da45b2053, user_id=422a67aaa9b34c29bd287df35e363529, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:11.927791 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b77cf-1f2d-46d4-8e16-a13602997549 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:11.930303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 879/1757] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 09:34:11.942344 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 879/1758] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:11 2022] PUT /identity/v3/projects/896b421dbd0e4ac4b576926da45b2053/users/422a67aaa9b34c29bd287df35e363529/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:34:11.953312 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45786572-12f7-48b2-aba4-3de8744ade85 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:11.953679 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45786572-12f7-48b2-aba4-3de8744ade85 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:11.954125 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45786572-12f7-48b2-aba4-3de8744ade85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:11.984188 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-45786572-12f7-48b2-aba4-3de8744ade85 None None] MFA Rules not processed for user `422a67aaa9b34c29bd287df35e363529`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:11.985526 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-45786572-12f7-48b2-aba4-3de8744ade85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:12.061611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 880/1759] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:11 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:12.063296 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b77cf-1f2d-46d4-8e16-a13602997549 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:12.142192 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b77cf-1f2d-46d4-8e16-a13602997549 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:12.146932 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8172c-370b-4abb-8822-ef078f168d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:12.147589 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8172c-370b-4abb-8822-ef078f168d79 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:12.147933 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8172c-370b-4abb-8822-ef078f168d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:12.148213 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8172c-370b-4abb-8822-ef078f168d79 admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:12.148948 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8172c-370b-4abb-8822-ef078f168d79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:12.150866 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8172c-370b-4abb-8822-ef078f168d79 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:12.180744 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 880/1760] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:34:12 2022] POST /identity/v3/projects => generated 357 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:12.185380 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45786572-12f7-48b2-aba4-3de8744ade85 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:12.210585 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45786572-12f7-48b2-aba4-3de8744ade85 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:12.243355 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8172c-370b-4abb-8822-ef078f168d79 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:12.245064 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-e1a8172c-370b-4abb-8822-ef078f168d79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:12.335816 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f7035-5848-4e01-a7bb-0a979f5b9667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:12.336962 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f7035-5848-4e01-a7bb-0a979f5b9667 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:12.337607 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f7035-5848-4e01-a7bb-0a979f5b9667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:12.338144 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f7035-5848-4e01-a7bb-0a979f5b9667 admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:12.339061 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f7035-5848-4e01-a7bb-0a979f5b9667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:12.341319 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f7035-5848-4e01-a7bb-0a979f5b9667 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:12.365534 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8172c-370b-4abb-8822-ef078f168d79 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:12.371481 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011900c7-ad9a-4fde-804e-9149214d5935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:12.372465 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 881/1761] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:34:12 2022] POST /identity/v3/users => generated 285 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:12.372583 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011900c7-ad9a-4fde-804e-9149214d5935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:12.373002 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011900c7-ad9a-4fde-804e-9149214d5935 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:12.373425 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011900c7-ad9a-4fde-804e-9149214d5935 admin admin] PATH_INFO: `/v3/projects/fb5451d0a20e4399a8b2f38a2b6e1104` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:12.374988 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011900c7-ad9a-4fde-804e-9149214d5935 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb5451d0a20e4399a8b2f38a2b6e1104)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:12.376158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f7035-5848-4e01-a7bb-0a979f5b9667 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:12.377118 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011900c7-ad9a-4fde-804e-9149214d5935 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:12.394019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f7035-5848-4e01-a7bb-0a979f5b9667 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:12.399960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867673b-b348-4b2a-9259-54040189da8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:12.402045 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867673b-b348-4b2a-9259-54040189da8d admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:12.402375 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867673b-b348-4b2a-9259-54040189da8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:12.403151 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867673b-b348-4b2a-9259-54040189da8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:12.403940 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867673b-b348-4b2a-9259-54040189da8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:12.410016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867673b-b348-4b2a-9259-54040189da8d admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:12.433002 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 882/1762] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 09:34:12.437569 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867673b-b348-4b2a-9259-54040189da8d admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:12.450086 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867673b-b348-4b2a-9259-54040189da8d admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:12.453488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-011900c7-ad9a-4fde-804e-9149214d5935 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb5451d0a20e4399a8b2f38a2b6e1104', 'request_id': 'req-011900c7-ad9a-4fde-804e-9149214d5935'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:12.459607 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-011900c7-ad9a-4fde-804e-9149214d5935 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb5451d0a20e4399a8b2f38a2b6e1104', 'request_id': 'req-011900c7-ad9a-4fde-804e-9149214d5935'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:12.469241 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-011900c7-ad9a-4fde-804e-9149214d5935 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb5451d0a20e4399a8b2f38a2b6e1104', 'request_id': 'req-011900c7-ad9a-4fde-804e-9149214d5935'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:12.483278 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-011900c7-ad9a-4fde-804e-9149214d5935 admin admin] The token cache is being invalidate because project fb5451d0a20e4399a8b2f38a2b6e1104 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:34:12.483978 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-011900c7-ad9a-4fde-804e-9149214d5935 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:12.484426 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-011900c7-ad9a-4fde-804e-9149214d5935 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:12.486216 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 881/1763] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:34:12 2022] DELETE /identity/v3/projects/fb5451d0a20e4399a8b2f38a2b6e1104 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:12.490568 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011900c7-ad9a-4fde-804e-9149214d5935 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:12.492564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-011900c7-ad9a-4fde-804e-9149214d5935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:12.541537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303700d-482b-44f8-9980-83b5d2b495a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:12.542943 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303700d-482b-44f8-9980-83b5d2b495a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:12.543337 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303700d-482b-44f8-9980-83b5d2b495a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:12.543715 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303700d-482b-44f8-9980-83b5d2b495a7 admin admin] PATH_INFO: `/v3/projects/5f1b1495c43645a49fa3b5c3c187d657/users/415ec208ee844bedb449c3358766b7de/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:12.562087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303700d-482b-44f8-9980-83b5d2b495a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f1b1495c43645a49fa3b5c3c187d657, user_id=415ec208ee844bedb449c3358766b7de, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:12.564662 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303700d-482b-44f8-9980-83b5d2b495a7 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:12.576010 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011900c7-ad9a-4fde-804e-9149214d5935 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:12.579213 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 883/1764] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:12 2022] PUT /identity/v3/projects/5f1b1495c43645a49fa3b5c3c187d657/users/415ec208ee844bedb449c3358766b7de/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:34:12.582970 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303700d-482b-44f8-9980-83b5d2b495a7 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:12.584757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-d303700d-482b-44f8-9980-83b5d2b495a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:12.650148 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112d7be-d315-497b-8fc3-bd192f666139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:12.654864 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112d7be-d315-497b-8fc3-bd192f666139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:12.655341 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112d7be-d315-497b-8fc3-bd192f666139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:12.655786 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112d7be-d315-497b-8fc3-bd192f666139 admin admin] PATH_INFO: `/v3/users/dd5ed64f111646b0bbf0b4735b6c2b59` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:12.657161 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112d7be-d315-497b-8fc3-bd192f666139 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd5ed64f111646b0bbf0b4735b6c2b59)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:12.659167 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112d7be-d315-497b-8fc3-bd192f666139 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:12.707712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303700d-482b-44f8-9980-83b5d2b495a7 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:12.723454 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f80e38-b18c-4df0-b9df-e06a32b7b76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:12.724673 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f80e38-b18c-4df0-b9df-e06a32b7b76c admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:12.726659 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f80e38-b18c-4df0-b9df-e06a32b7b76c admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:12.727941 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f80e38-b18c-4df0-b9df-e06a32b7b76c admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:12.732785 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f80e38-b18c-4df0-b9df-e06a32b7b76c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:12.735938 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f80e38-b18c-4df0-b9df-e06a32b7b76c admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:12.786119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 884/1765] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 09:34:12.790864 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f80e38-b18c-4df0-b9df-e06a32b7b76c admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:12.816441 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f80e38-b18c-4df0-b9df-e06a32b7b76c admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:12.827516 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98662f1a-1f8b-4f32-8493-7d0a61dcc7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:12.837570 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98662f1a-1f8b-4f32-8493-7d0a61dcc7a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:12.837888 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98662f1a-1f8b-4f32-8493-7d0a61dcc7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:12.838196 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98662f1a-1f8b-4f32-8493-7d0a61dcc7a4 admin admin] PATH_INFO: `/v3/projects/5f1b1495c43645a49fa3b5c3c187d657/users/415ec208ee844bedb449c3358766b7de/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:12.840881 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98662f1a-1f8b-4f32-8493-7d0a61dcc7a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f1b1495c43645a49fa3b5c3c187d657, user_id=415ec208ee844bedb449c3358766b7de, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:12.844238 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98662f1a-1f8b-4f32-8493-7d0a61dcc7a4 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:12.854827 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-f112d7be-d315-497b-8fc3-bd192f666139 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd5ed64f111646b0bbf0b4735b6c2b59'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:12.866530 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 885/1766] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:12 2022] PUT /identity/v3/projects/5f1b1495c43645a49fa3b5c3c187d657/users/415ec208ee844bedb449c3358766b7de/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:12.869796 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-f112d7be-d315-497b-8fc3-bd192f666139 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd5ed64f111646b0bbf0b4735b6c2b59'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:12.870618 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-f112d7be-d315-497b-8fc3-bd192f666139 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd5ed64f111646b0bbf0b4735b6c2b59'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:12.881121 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154aae65-9183-463c-bcae-ab944e684b44 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:12.881776 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-f112d7be-d315-497b-8fc3-bd192f666139 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd5ed64f111646b0bbf0b4735b6c2b59'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:12.883120 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154aae65-9183-463c-bcae-ab944e684b44 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:12.883409 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154aae65-9183-463c-bcae-ab944e684b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:12.899473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-f112d7be-d315-497b-8fc3-bd192f666139 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd5ed64f111646b0bbf0b4735b6c2b59'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:12.915092 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 882/1767] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:34:12 2022] DELETE /identity/v3/users/dd5ed64f111646b0bbf0b4735b6c2b59 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:34:12.933716 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-154aae65-9183-463c-bcae-ab944e684b44 None None] MFA Rules not processed for user `415ec208ee844bedb449c3358766b7de`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:12.935023 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-154aae65-9183-463c-bcae-ab944e684b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:13.016997 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 886/1768] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:12 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:34:13.029250 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112d7be-d315-497b-8fc3-bd192f666139 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:13.031246 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-f112d7be-d315-497b-8fc3-bd192f666139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:13.091261 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112d7be-d315-497b-8fc3-bd192f666139 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:13.098654 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940787c-6e69-40c8-aedd-e9e3ee99c097 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:13.099565 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940787c-6e69-40c8-aedd-e9e3ee99c097 service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:13.099854 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940787c-6e69-40c8-aedd-e9e3ee99c097 service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:13.100133 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940787c-6e69-40c8-aedd-e9e3ee99c097 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:13.110814 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e940787c-6e69-40c8-aedd-e9e3ee99c097 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:13.112263 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e940787c-6e69-40c8-aedd-e9e3ee99c097 service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:13.122325 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 883/1769] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:13 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:13.208049 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154aae65-9183-463c-bcae-ab944e684b44 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:13.220050 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154aae65-9183-463c-bcae-ab944e684b44 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:13.223816 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fc3b3-c3ea-4c87-86c4-b2029379be80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:13.224535 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fc3b3-c3ea-4c87-86c4-b2029379be80 service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:13.224803 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fc3b3-c3ea-4c87-86c4-b2029379be80 service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:13.225152 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fc3b3-c3ea-4c87-86c4-b2029379be80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:13.227640 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-328fc3b3-c3ea-4c87-86c4-b2029379be80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:13.247404 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940787c-6e69-40c8-aedd-e9e3ee99c097 service cinder] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:13.248820 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-e940787c-6e69-40c8-aedd-e9e3ee99c097 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:13.307412 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fc3b3-c3ea-4c87-86c4-b2029379be80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:13.308597 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fc3b3-c3ea-4c87-86c4-b2029379be80 service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:13.316303 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940787c-6e69-40c8-aedd-e9e3ee99c097 service cinder] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:13.318588 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 887/1770] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:13 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:13.321143 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ad57c-21c0-4e76-9cca-a2074aed24ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:13.322051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ad57c-21c0-4e76-9cca-a2074aed24ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:13.322346 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ad57c-21c0-4e76-9cca-a2074aed24ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:13.322616 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ad57c-21c0-4e76-9cca-a2074aed24ab admin admin] PATH_INFO: `/v3/projects/f8e20bc0e478465cad9203b773ec59d0` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:13.323828 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ad57c-21c0-4e76-9cca-a2074aed24ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8e20bc0e478465cad9203b773ec59d0)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:13.325710 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ad57c-21c0-4e76-9cca-a2074aed24ab admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:13.380852 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-a04ad57c-21c0-4e76-9cca-a2074aed24ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8e20bc0e478465cad9203b773ec59d0', 'request_id': 'req-a04ad57c-21c0-4e76-9cca-a2074aed24ab'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:13.387316 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-a04ad57c-21c0-4e76-9cca-a2074aed24ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8e20bc0e478465cad9203b773ec59d0', 'request_id': 'req-a04ad57c-21c0-4e76-9cca-a2074aed24ab'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:13.395652 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-a04ad57c-21c0-4e76-9cca-a2074aed24ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8e20bc0e478465cad9203b773ec59d0', 'request_id': 'req-a04ad57c-21c0-4e76-9cca-a2074aed24ab'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:13.408160 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-a04ad57c-21c0-4e76-9cca-a2074aed24ab admin admin] The token cache is being invalidate because project f8e20bc0e478465cad9203b773ec59d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:34:13.408446 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-a04ad57c-21c0-4e76-9cca-a2074aed24ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:13.409113 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-a04ad57c-21c0-4e76-9cca-a2074aed24ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:13.416393 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 884/1771] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:34:13 2022] DELETE /identity/v3/projects/f8e20bc0e478465cad9203b773ec59d0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:13.418087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9f5bb-1076-4c42-9df9-5eed8c4da93a None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:13.418392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9f5bb-1076-4c42-9df9-5eed8c4da93a None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:13.418665 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9f5bb-1076-4c42-9df9-5eed8c4da93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:13.445289 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-81f9f5bb-1076-4c42-9df9-5eed8c4da93a None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:13.447368 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-81f9f5bb-1076-4c42-9df9-5eed8c4da93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:13.526612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 888/1772] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:34:13.535637 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91472771-b9f9-49e9-9253-aa754cf45351 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:13.535929 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91472771-b9f9-49e9-9253-aa754cf45351 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:13.536207 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91472771-b9f9-49e9-9253-aa754cf45351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:13.559723 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-91472771-b9f9-49e9-9253-aa754cf45351 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:13.561802 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-91472771-b9f9-49e9-9253-aa754cf45351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:13.575243 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 885/1773] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:13.577069 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9f5bb-1076-4c42-9df9-5eed8c4da93a None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:13.588006 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9f5bb-1076-4c42-9df9-5eed8c4da93a None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:13.592953 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9611975-6e4c-4b80-a10b-386fb40385c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:13.593696 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9611975-6e4c-4b80-a10b-386fb40385c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:13.594085 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9611975-6e4c-4b80-a10b-386fb40385c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:13.594436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9611975-6e4c-4b80-a10b-386fb40385c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:13.595242 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9611975-6e4c-4b80-a10b-386fb40385c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:34:13.595620 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9611975-6e4c-4b80-a10b-386fb40385c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:13.597331 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9611975-6e4c-4b80-a10b-386fb40385c8 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:13.615719 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 889/1774] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:34:13.616942 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91472771-b9f9-49e9-9253-aa754cf45351 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:13.626898 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91472771-b9f9-49e9-9253-aa754cf45351 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:13.631669 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ef63b-b8a7-46c4-b6f2-b4fdc749c805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:13.632454 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ef63b-b8a7-46c4-b6f2-b4fdc749c805 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:13.632804 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ef63b-b8a7-46c4-b6f2-b4fdc749c805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:13.633269 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ef63b-b8a7-46c4-b6f2-b4fdc749c805 admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:13.634354 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ef63b-b8a7-46c4-b6f2-b4fdc749c805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:13.636340 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ef63b-b8a7-46c4-b6f2-b4fdc749c805 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:13.669944 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 886/1775] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:34:13 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:13.674097 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9611975-6e4c-4b80-a10b-386fb40385c8 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:13.685206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9611975-6e4c-4b80-a10b-386fb40385c8 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:13.773442 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd04a0-5922-4fba-9850-0b753bb168cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:13.774154 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd04a0-5922-4fba-9850-0b753bb168cb admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:13.774438 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd04a0-5922-4fba-9850-0b753bb168cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:13.774712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd04a0-5922-4fba-9850-0b753bb168cb admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:13.775406 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd04a0-5922-4fba-9850-0b753bb168cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:13.777473 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd04a0-5922-4fba-9850-0b753bb168cb admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:13.802992 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 890/1776] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:34:13 2022] POST /identity/v3/users => generated 294 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:13.807112 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ef63b-b8a7-46c4-b6f2-b4fdc749c805 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:13.817311 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ef63b-b8a7-46c4-b6f2-b4fdc749c805 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:13.822269 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eee2da-2d14-4d31-9ba6-abf094d83e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:13.822937 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eee2da-2d14-4d31-9ba6-abf094d83e20 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:13.823243 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eee2da-2d14-4d31-9ba6-abf094d83e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:13.823514 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eee2da-2d14-4d31-9ba6-abf094d83e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:13.824241 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eee2da-2d14-4d31-9ba6-abf094d83e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:13.825912 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eee2da-2d14-4d31-9ba6-abf094d83e20 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:13.836712 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 887/1777] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:13.840758 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd04a0-5922-4fba-9850-0b753bb168cb admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:13.850510 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd04a0-5922-4fba-9850-0b753bb168cb admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:13.855618 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952d09e-5eec-4c54-bc1e-b93378992c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:13.856264 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952d09e-5eec-4c54-bc1e-b93378992c34 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:13.856546 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952d09e-5eec-4c54-bc1e-b93378992c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:13.856818 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952d09e-5eec-4c54-bc1e-b93378992c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:13.857535 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952d09e-5eec-4c54-bc1e-b93378992c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:13.859175 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952d09e-5eec-4c54-bc1e-b93378992c34 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:13.868971 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 891/1778] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:13.873064 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eee2da-2d14-4d31-9ba6-abf094d83e20 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:13.882878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eee2da-2d14-4d31-9ba6-abf094d83e20 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:13.887868 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f0a59-960d-4741-a931-9ee839e71eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:13.888819 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f0a59-960d-4741-a931-9ee839e71eb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:13.889173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f0a59-960d-4741-a931-9ee839e71eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:13.889616 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f0a59-960d-4741-a931-9ee839e71eb3 admin admin] PATH_INFO: `/v3/projects/5ef95f15e62945aeb7fbcbc2a3944e58/users/b18aecfa13f6483daf67fdd6cb37fecb/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:13.909813 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f0a59-960d-4741-a931-9ee839e71eb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ef95f15e62945aeb7fbcbc2a3944e58, user_id=b18aecfa13f6483daf67fdd6cb37fecb, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:13.912660 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f0a59-960d-4741-a931-9ee839e71eb3 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:13.929785 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 888/1779] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:13 2022] PUT /identity/v3/projects/5ef95f15e62945aeb7fbcbc2a3944e58/users/b18aecfa13f6483daf67fdd6cb37fecb/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:13.940530 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724a3f4-300b-402f-8df0-14c68c510a9b None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:13.941024 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724a3f4-300b-402f-8df0-14c68c510a9b None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:13.941422 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724a3f4-300b-402f-8df0-14c68c510a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:13.993150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-a724a3f4-300b-402f-8df0-14c68c510a9b None None] MFA Rules not processed for user `b18aecfa13f6483daf67fdd6cb37fecb`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:13.994468 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-a724a3f4-300b-402f-8df0-14c68c510a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:14.082138 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 892/1780] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:14.086860 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f0a59-960d-4741-a931-9ee839e71eb3 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:14.151757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f0a59-960d-4741-a931-9ee839e71eb3 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:14.156379 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6b11a-1400-4ac8-b5d6-637a95317760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:14.157049 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6b11a-1400-4ac8-b5d6-637a95317760 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:14.157332 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6b11a-1400-4ac8-b5d6-637a95317760 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:14.157608 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6b11a-1400-4ac8-b5d6-637a95317760 admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:14.158350 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6b11a-1400-4ac8-b5d6-637a95317760 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:14.160282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6b11a-1400-4ac8-b5d6-637a95317760 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:14.190530 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 889/1781] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:34:14 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:14.191749 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724a3f4-300b-402f-8df0-14c68c510a9b None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:14.202428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724a3f4-300b-402f-8df0-14c68c510a9b None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:14.266148 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bea292-811d-4139-8d32-07801642b364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:14.266824 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bea292-811d-4139-8d32-07801642b364 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:14.267103 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bea292-811d-4139-8d32-07801642b364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:14.267375 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bea292-811d-4139-8d32-07801642b364 admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:14.268120 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bea292-811d-4139-8d32-07801642b364 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:14.270061 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bea292-811d-4139-8d32-07801642b364 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:14.295849 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 893/1782] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:34:14 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:14.297029 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6b11a-1400-4ac8-b5d6-637a95317760 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:14.307849 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6b11a-1400-4ac8-b5d6-637a95317760 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:14.312914 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42464b-b7eb-4230-b1e9-97f04cf82c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:14.313641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42464b-b7eb-4230-b1e9-97f04cf82c33 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:14.313864 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42464b-b7eb-4230-b1e9-97f04cf82c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:14.314125 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42464b-b7eb-4230-b1e9-97f04cf82c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:14.314855 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e42464b-b7eb-4230-b1e9-97f04cf82c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:14.316655 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e42464b-b7eb-4230-b1e9-97f04cf82c33 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:14.327395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 890/1783] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 09:34:14.331744 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bea292-811d-4139-8d32-07801642b364 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:14.342929 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bea292-811d-4139-8d32-07801642b364 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:14.354564 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6819a-39b8-4031-90fd-f870bffd598f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:14.355408 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6819a-39b8-4031-90fd-f870bffd598f admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:14.355690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6819a-39b8-4031-90fd-f870bffd598f admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:14.355964 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6819a-39b8-4031-90fd-f870bffd598f admin admin] PATH_INFO: `/v3/projects/c96835b185b6456098d435a4452853d7/users/0fa72d0c930245938e51f2c3d78fb49d/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:14.379283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6819a-39b8-4031-90fd-f870bffd598f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96835b185b6456098d435a4452853d7, user_id=0fa72d0c930245938e51f2c3d78fb49d, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:14.382180 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6819a-39b8-4031-90fd-f870bffd598f admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:14.397339 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 894/1784] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:14 2022] PUT /identity/v3/projects/c96835b185b6456098d435a4452853d7/users/0fa72d0c930245938e51f2c3d78fb49d/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:14.401892 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42464b-b7eb-4230-b1e9-97f04cf82c33 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:14.412226 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42464b-b7eb-4230-b1e9-97f04cf82c33 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:14.467395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee7e8b-8f8f-46f8-b9e9-c974bd839852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:14.468098 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee7e8b-8f8f-46f8-b9e9-c974bd839852 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:14.468383 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee7e8b-8f8f-46f8-b9e9-c974bd839852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:14.468655 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee7e8b-8f8f-46f8-b9e9-c974bd839852 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:14.469373 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee7e8b-8f8f-46f8-b9e9-c974bd839852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:14.470986 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee7e8b-8f8f-46f8-b9e9-c974bd839852 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:14.485928 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 891/1785] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:14.487897 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6819a-39b8-4031-90fd-f870bffd598f admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:14.498897 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6819a-39b8-4031-90fd-f870bffd598f admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:14.503723 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f879e-7cf1-45df-bab2-d138a3409590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:14.504609 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f879e-7cf1-45df-bab2-d138a3409590 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:14.504908 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f879e-7cf1-45df-bab2-d138a3409590 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:14.505159 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f879e-7cf1-45df-bab2-d138a3409590 admin admin] PATH_INFO: `/v3/projects/c96835b185b6456098d435a4452853d7/users/0fa72d0c930245938e51f2c3d78fb49d/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:14.507132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f879e-7cf1-45df-bab2-d138a3409590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96835b185b6456098d435a4452853d7, user_id=0fa72d0c930245938e51f2c3d78fb49d, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:14.510425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f879e-7cf1-45df-bab2-d138a3409590 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:14.520694 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 895/1786] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:14 2022] PUT /identity/v3/projects/c96835b185b6456098d435a4452853d7/users/0fa72d0c930245938e51f2c3d78fb49d/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:14.532341 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f366eb9-7031-44df-a899-166c244c7f3c None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:14.532637 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f366eb9-7031-44df-a899-166c244c7f3c None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:14.532906 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f366eb9-7031-44df-a899-166c244c7f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:14.558849 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-9f366eb9-7031-44df-a899-166c244c7f3c None None] MFA Rules not processed for user `0fa72d0c930245938e51f2c3d78fb49d`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:14.560194 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-9f366eb9-7031-44df-a899-166c244c7f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:14.623985 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 892/1787] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:14.635178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f879e-7cf1-45df-bab2-d138a3409590 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:14.636957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-b19f879e-7cf1-45df-bab2-d138a3409590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:14.692489 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f879e-7cf1-45df-bab2-d138a3409590 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:14.696595 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab2239-fc93-43f3-8e8c-288ef83a4454 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:14.697257 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab2239-fc93-43f3-8e8c-288ef83a4454 service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:14.697533 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab2239-fc93-43f3-8e8c-288ef83a4454 service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:14.697804 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab2239-fc93-43f3-8e8c-288ef83a4454 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:14.706444 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab2239-fc93-43f3-8e8c-288ef83a4454 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:14.707859 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab2239-fc93-43f3-8e8c-288ef83a4454 service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:14.717543 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 896/1788] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:14.790123 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f366eb9-7031-44df-a899-166c244c7f3c None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:14.853070 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f366eb9-7031-44df-a899-166c244c7f3c None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:14.860468 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d76ce2-b835-4f72-829f-fe9e580e857f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:14.861424 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d76ce2-b835-4f72-829f-fe9e580e857f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:14.861782 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d76ce2-b835-4f72-829f-fe9e580e857f admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:14.862118 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d76ce2-b835-4f72-829f-fe9e580e857f admin admin] PATH_INFO: `/v3/users/b18aecfa13f6483daf67fdd6cb37fecb` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:14.863380 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d76ce2-b835-4f72-829f-fe9e580e857f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b18aecfa13f6483daf67fdd6cb37fecb)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:14.865397 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d76ce2-b835-4f72-829f-fe9e580e857f admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:14.910132 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-86d76ce2-b835-4f72-829f-fe9e580e857f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b18aecfa13f6483daf67fdd6cb37fecb'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:14.921496 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-86d76ce2-b835-4f72-829f-fe9e580e857f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b18aecfa13f6483daf67fdd6cb37fecb'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:14.922189 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-86d76ce2-b835-4f72-829f-fe9e580e857f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b18aecfa13f6483daf67fdd6cb37fecb'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:14.929661 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-86d76ce2-b835-4f72-829f-fe9e580e857f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b18aecfa13f6483daf67fdd6cb37fecb'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:14.936283 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-86d76ce2-b835-4f72-829f-fe9e580e857f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b18aecfa13f6483daf67fdd6cb37fecb'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:14.942015 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 893/1789] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:34:14 2022] DELETE /identity/v3/users/b18aecfa13f6483daf67fdd6cb37fecb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:14.947185 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b20e87-c750-4c5c-a72b-e5bfe63bffc1 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:14.947658 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b20e87-c750-4c5c-a72b-e5bfe63bffc1 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:14.947857 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b20e87-c750-4c5c-a72b-e5bfe63bffc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:14.966054 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-65b20e87-c750-4c5c-a72b-e5bfe63bffc1 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:14.967229 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-65b20e87-c750-4c5c-a72b-e5bfe63bffc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:15.042612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 897/1790] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:15.049185 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d76ce2-b835-4f72-829f-fe9e580e857f admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:15.050897 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-86d76ce2-b835-4f72-829f-fe9e580e857f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:15.108391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d76ce2-b835-4f72-829f-fe9e580e857f admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:15.112063 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384a24f-2bec-4875-963b-3e272c2837e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:15.112721 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384a24f-2bec-4875-963b-3e272c2837e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:15.113003 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384a24f-2bec-4875-963b-3e272c2837e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:15.113278 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384a24f-2bec-4875-963b-3e272c2837e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:15.123797 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384a24f-2bec-4875-963b-3e272c2837e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:15.125327 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384a24f-2bec-4875-963b-3e272c2837e9 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:15.135901 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 894/1791] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:15.484437 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b20e87-c750-4c5c-a72b-e5bfe63bffc1 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:15.486108 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-65b20e87-c750-4c5c-a72b-e5bfe63bffc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:15.499425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b20e87-c750-4c5c-a72b-e5bfe63bffc1 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:15.504639 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4463682-bcd6-4155-9a11-41404469ae21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:15.505542 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4463682-bcd6-4155-9a11-41404469ae21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:15.505823 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4463682-bcd6-4155-9a11-41404469ae21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:15.506131 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4463682-bcd6-4155-9a11-41404469ae21 admin admin] PATH_INFO: `/v3/projects/5ef95f15e62945aeb7fbcbc2a3944e58` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:15.507352 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4463682-bcd6-4155-9a11-41404469ae21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ef95f15e62945aeb7fbcbc2a3944e58)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:15.509550 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4463682-bcd6-4155-9a11-41404469ae21 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:15.561405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-b4463682-bcd6-4155-9a11-41404469ae21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ef95f15e62945aeb7fbcbc2a3944e58', 'request_id': 'req-b4463682-bcd6-4155-9a11-41404469ae21'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:15.567103 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-b4463682-bcd6-4155-9a11-41404469ae21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ef95f15e62945aeb7fbcbc2a3944e58', 'request_id': 'req-b4463682-bcd6-4155-9a11-41404469ae21'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:15.575131 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-b4463682-bcd6-4155-9a11-41404469ae21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ef95f15e62945aeb7fbcbc2a3944e58', 'request_id': 'req-b4463682-bcd6-4155-9a11-41404469ae21'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:15.588962 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-b4463682-bcd6-4155-9a11-41404469ae21 admin admin] The token cache is being invalidate because project 5ef95f15e62945aeb7fbcbc2a3944e58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:34:15.589406 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-b4463682-bcd6-4155-9a11-41404469ae21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:15.590264 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-b4463682-bcd6-4155-9a11-41404469ae21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:15.592243 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 898/1792] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:34:15 2022] DELETE /identity/v3/projects/5ef95f15e62945aeb7fbcbc2a3944e58 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:15.596360 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384a24f-2bec-4875-963b-3e272c2837e9 service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:15.608151 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384a24f-2bec-4875-963b-3e272c2837e9 service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:15.677699 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d04f3-d0c4-4931-a625-adc07bcafc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:15.679207 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d04f3-d0c4-4931-a625-adc07bcafc5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:15.680172 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d04f3-d0c4-4931-a625-adc07bcafc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:15.680323 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d04f3-d0c4-4931-a625-adc07bcafc5b admin admin] PATH_INFO: `/v3/users/0fa72d0c930245938e51f2c3d78fb49d` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:15.681786 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d04f3-d0c4-4931-a625-adc07bcafc5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fa72d0c930245938e51f2c3d78fb49d)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:15.684641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d04f3-d0c4-4931-a625-adc07bcafc5b admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:15.732034 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-f70d04f3-d0c4-4931-a625-adc07bcafc5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fa72d0c930245938e51f2c3d78fb49d'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:15.743962 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-f70d04f3-d0c4-4931-a625-adc07bcafc5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fa72d0c930245938e51f2c3d78fb49d'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:15.744704 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-f70d04f3-d0c4-4931-a625-adc07bcafc5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fa72d0c930245938e51f2c3d78fb49d'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:15.751759 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-f70d04f3-d0c4-4931-a625-adc07bcafc5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fa72d0c930245938e51f2c3d78fb49d'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:15.758283 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-f70d04f3-d0c4-4931-a625-adc07bcafc5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fa72d0c930245938e51f2c3d78fb49d'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:15.765311 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 895/1793] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:34:15 2022] DELETE /identity/v3/users/0fa72d0c930245938e51f2c3d78fb49d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:16.098979 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4463682-bcd6-4155-9a11-41404469ae21 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:16.103001 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-b4463682-bcd6-4155-9a11-41404469ae21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:16.140513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4463682-bcd6-4155-9a11-41404469ae21 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:16.272262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec841a64-a665-4f09-b3c8-c16da3d61808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:16.273927 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec841a64-a665-4f09-b3c8-c16da3d61808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:16.274283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec841a64-a665-4f09-b3c8-c16da3d61808 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:16.274665 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec841a64-a665-4f09-b3c8-c16da3d61808 admin admin] PATH_INFO: `/v3/projects/c96835b185b6456098d435a4452853d7` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:16.276101 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec841a64-a665-4f09-b3c8-c16da3d61808 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c96835b185b6456098d435a4452853d7)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:16.278429 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec841a64-a665-4f09-b3c8-c16da3d61808 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:16.346490 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-ec841a64-a665-4f09-b3c8-c16da3d61808 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c96835b185b6456098d435a4452853d7', 'request_id': 'req-ec841a64-a665-4f09-b3c8-c16da3d61808'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:16.353141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-ec841a64-a665-4f09-b3c8-c16da3d61808 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c96835b185b6456098d435a4452853d7', 'request_id': 'req-ec841a64-a665-4f09-b3c8-c16da3d61808'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:16.361756 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-ec841a64-a665-4f09-b3c8-c16da3d61808 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c96835b185b6456098d435a4452853d7', 'request_id': 'req-ec841a64-a665-4f09-b3c8-c16da3d61808'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:16.374121 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-ec841a64-a665-4f09-b3c8-c16da3d61808 admin admin] The token cache is being invalidate because project c96835b185b6456098d435a4452853d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:34:16.374405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-ec841a64-a665-4f09-b3c8-c16da3d61808 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:16.375068 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-ec841a64-a665-4f09-b3c8-c16da3d61808 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:16.376631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 899/1794] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:34:16 2022] DELETE /identity/v3/projects/c96835b185b6456098d435a4452853d7 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:16.381504 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d236b-2079-4af9-b2bf-c73091884c2d None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:16.381813 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d236b-2079-4af9-b2bf-c73091884c2d None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:16.382625 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d236b-2079-4af9-b2bf-c73091884c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:16.437481 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-543d236b-2079-4af9-b2bf-c73091884c2d None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:16.439292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-543d236b-2079-4af9-b2bf-c73091884c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:16.578654 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 896/1795] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:16.588413 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0a652-dbab-4a14-888e-b23ee4989e38 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:16.588852 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0a652-dbab-4a14-888e-b23ee4989e38 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:16.589220 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0a652-dbab-4a14-888e-b23ee4989e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:16.619792 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-c0f0a652-dbab-4a14-888e-b23ee4989e38 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:16.621480 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-c0f0a652-dbab-4a14-888e-b23ee4989e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:16.635688 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 900/1796] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:16.640652 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d236b-2079-4af9-b2bf-c73091884c2d None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:16.652342 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d236b-2079-4af9-b2bf-c73091884c2d None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:16.658074 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8076e3c-58a3-4c0d-99db-28bdde646d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:16.659112 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8076e3c-58a3-4c0d-99db-28bdde646d4d admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:16.659539 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8076e3c-58a3-4c0d-99db-28bdde646d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:16.660057 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8076e3c-58a3-4c0d-99db-28bdde646d4d admin admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:16.661065 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8076e3c-58a3-4c0d-99db-28bdde646d4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:34:16.661475 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8076e3c-58a3-4c0d-99db-28bdde646d4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:16.663734 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8076e3c-58a3-4c0d-99db-28bdde646d4d admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:16.678039 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 897/1797] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:34:16.683632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0a652-dbab-4a14-888e-b23ee4989e38 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:16.698840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0a652-dbab-4a14-888e-b23ee4989e38 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:16.704358 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212f3c5-efe9-4b67-8c1c-74f010e03cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:16.705110 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212f3c5-efe9-4b67-8c1c-74f010e03cfb admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:16.705478 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212f3c5-efe9-4b67-8c1c-74f010e03cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:16.706011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212f3c5-efe9-4b67-8c1c-74f010e03cfb admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:16.706840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212f3c5-efe9-4b67-8c1c-74f010e03cfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:16.708968 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212f3c5-efe9-4b67-8c1c-74f010e03cfb admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:16.747809 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 901/1798] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:34:16 2022] POST /identity/v3/projects => generated 381 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:34:16.751649 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8076e3c-58a3-4c0d-99db-28bdde646d4d admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:16.771986 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8076e3c-58a3-4c0d-99db-28bdde646d4d admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:16.894803 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355ad3f-c268-4071-a6c5-4d62fb8e2806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:16.895814 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355ad3f-c268-4071-a6c5-4d62fb8e2806 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:16.896334 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355ad3f-c268-4071-a6c5-4d62fb8e2806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:16.897486 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355ad3f-c268-4071-a6c5-4d62fb8e2806 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:16.898443 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355ad3f-c268-4071-a6c5-4d62fb8e2806 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:16.905343 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355ad3f-c268-4071-a6c5-4d62fb8e2806 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:16.943988 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 898/1799] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:34:16 2022] POST /identity/v3/users => generated 291 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:16.948104 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212f3c5-efe9-4b67-8c1c-74f010e03cfb admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:16.958969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212f3c5-efe9-4b67-8c1c-74f010e03cfb admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:16.964909 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba9873-fe2d-4e59-b80d-1170ab8c4a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:16.966131 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba9873-fe2d-4e59-b80d-1170ab8c4a4a admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:16.966725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba9873-fe2d-4e59-b80d-1170ab8c4a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:16.967137 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba9873-fe2d-4e59-b80d-1170ab8c4a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:16.968005 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba9873-fe2d-4e59-b80d-1170ab8c4a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:16.970491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba9873-fe2d-4e59-b80d-1170ab8c4a4a admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:16.984715 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 902/1800] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:16.988843 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355ad3f-c268-4071-a6c5-4d62fb8e2806 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:17.000122 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355ad3f-c268-4071-a6c5-4d62fb8e2806 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:17.004648 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860290bc-314b-4f1a-87d9-a5a3b76ad581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:17.005324 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860290bc-314b-4f1a-87d9-a5a3b76ad581 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:17.005596 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860290bc-314b-4f1a-87d9-a5a3b76ad581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:17.005874 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860290bc-314b-4f1a-87d9-a5a3b76ad581 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:17.006838 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860290bc-314b-4f1a-87d9-a5a3b76ad581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:17.008579 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860290bc-314b-4f1a-87d9-a5a3b76ad581 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:17.019804 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 899/1801] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:17.024520 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba9873-fe2d-4e59-b80d-1170ab8c4a4a admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:17.037278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba9873-fe2d-4e59-b80d-1170ab8c4a4a admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:17.049199 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32f737-ee43-4006-896b-b7c324df2578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:17.050223 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32f737-ee43-4006-896b-b7c324df2578 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:17.052083 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32f737-ee43-4006-896b-b7c324df2578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:17.053860 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32f737-ee43-4006-896b-b7c324df2578 admin admin] PATH_INFO: `/v3/projects/4eac8344a35a43a5bb6d755006c4476a/users/5075cabc854f49a889816c5f03aed393/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:17.089303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32f737-ee43-4006-896b-b7c324df2578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eac8344a35a43a5bb6d755006c4476a, user_id=5075cabc854f49a889816c5f03aed393, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:17.105772 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32f737-ee43-4006-896b-b7c324df2578 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:17.131191 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 903/1802] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:17 2022] PUT /identity/v3/projects/4eac8344a35a43a5bb6d755006c4476a/users/5075cabc854f49a889816c5f03aed393/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:17.142803 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da273046-7e07-4d61-b440-405bef3983ac None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:17.143866 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da273046-7e07-4d61-b440-405bef3983ac None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:17.143866 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da273046-7e07-4d61-b440-405bef3983ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:17.196762 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-da273046-7e07-4d61-b440-405bef3983ac None None] MFA Rules not processed for user `5075cabc854f49a889816c5f03aed393`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:17.198991 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-da273046-7e07-4d61-b440-405bef3983ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:17.304001 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 900/1803] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:17.309080 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32f737-ee43-4006-896b-b7c324df2578 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:17.454256 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32f737-ee43-4006-896b-b7c324df2578 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:17.471976 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee680a8-1a3d-46fb-85a9-9d503cbed42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:17.471976 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee680a8-1a3d-46fb-85a9-9d503cbed42b admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:17.471976 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee680a8-1a3d-46fb-85a9-9d503cbed42b admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:17.471976 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee680a8-1a3d-46fb-85a9-9d503cbed42b admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:17.472601 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee680a8-1a3d-46fb-85a9-9d503cbed42b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:17.472601 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee680a8-1a3d-46fb-85a9-9d503cbed42b admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:17.499199 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 904/1804] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:34:17 2022] POST /identity/v3/projects => generated 383 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:34:17.500310 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da273046-7e07-4d61-b440-405bef3983ac None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:17.511212 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da273046-7e07-4d61-b440-405bef3983ac None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:17.572126 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4edb64-40f4-4ed2-aa04-8a3e93824e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:17.572861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4edb64-40f4-4ed2-aa04-8a3e93824e02 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:17.573161 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4edb64-40f4-4ed2-aa04-8a3e93824e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:17.573522 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4edb64-40f4-4ed2-aa04-8a3e93824e02 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:17.574266 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4edb64-40f4-4ed2-aa04-8a3e93824e02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:17.576954 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4edb64-40f4-4ed2-aa04-8a3e93824e02 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:17.598495 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 901/1805] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:34:17 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:34:17.602815 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee680a8-1a3d-46fb-85a9-9d503cbed42b admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:17.613063 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee680a8-1a3d-46fb-85a9-9d503cbed42b admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:17.622719 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c42d8-07f9-4a99-91c3-d69277315449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:17.623718 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c42d8-07f9-4a99-91c3-d69277315449 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:17.624139 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c42d8-07f9-4a99-91c3-d69277315449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:17.624551 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c42d8-07f9-4a99-91c3-d69277315449 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:17.629113 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c42d8-07f9-4a99-91c3-d69277315449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:17.631632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c42d8-07f9-4a99-91c3-d69277315449 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:17.645607 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 905/1806] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:17.650215 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4edb64-40f4-4ed2-aa04-8a3e93824e02 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:17.661504 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4edb64-40f4-4ed2-aa04-8a3e93824e02 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:17.667408 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a3b8e-c265-4de3-9762-b96405bf45b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:17.668646 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a3b8e-c265-4de3-9762-b96405bf45b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:17.669148 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a3b8e-c265-4de3-9762-b96405bf45b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:17.669621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a3b8e-c265-4de3-9762-b96405bf45b3 admin admin] PATH_INFO: `/v3/projects/8f20977da96e479596e8b6a838866fc7/users/d852ffddfc03467f896bdc441606b46e/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:17.687954 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a3b8e-c265-4de3-9762-b96405bf45b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f20977da96e479596e8b6a838866fc7, user_id=d852ffddfc03467f896bdc441606b46e, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:17.691852 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a3b8e-c265-4de3-9762-b96405bf45b3 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:17.714325 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 902/1807] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:17 2022] PUT /identity/v3/projects/8f20977da96e479596e8b6a838866fc7/users/d852ffddfc03467f896bdc441606b46e/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:17.718244 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c42d8-07f9-4a99-91c3-d69277315449 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:17.729408 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c42d8-07f9-4a99-91c3-d69277315449 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:17.790868 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec76e3-0393-4378-8fa5-c8eea49238c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:17.791626 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec76e3-0393-4378-8fa5-c8eea49238c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:17.792938 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec76e3-0393-4378-8fa5-c8eea49238c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:17.794041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec76e3-0393-4378-8fa5-c8eea49238c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:17.794409 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec76e3-0393-4378-8fa5-c8eea49238c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:17.797735 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec76e3-0393-4378-8fa5-c8eea49238c8 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:17.814153 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 906/1808] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:17.815632 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a3b8e-c265-4de3-9762-b96405bf45b3 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:17.841970 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a3b8e-c265-4de3-9762-b96405bf45b3 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:17.848215 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced398d9-b1e6-485e-9349-bf26346b3d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:17.849360 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced398d9-b1e6-485e-9349-bf26346b3d2f admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:17.849769 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced398d9-b1e6-485e-9349-bf26346b3d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:17.850163 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced398d9-b1e6-485e-9349-bf26346b3d2f admin admin] PATH_INFO: `/v3/projects/8f20977da96e479596e8b6a838866fc7/users/d852ffddfc03467f896bdc441606b46e/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:17.853328 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced398d9-b1e6-485e-9349-bf26346b3d2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f20977da96e479596e8b6a838866fc7, user_id=d852ffddfc03467f896bdc441606b46e, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:17.857240 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced398d9-b1e6-485e-9349-bf26346b3d2f admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:17.887473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 903/1809] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:17 2022] PUT /identity/v3/projects/8f20977da96e479596e8b6a838866fc7/users/d852ffddfc03467f896bdc441606b46e/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:17.900355 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631f148-3182-4b1c-b274-3e626bbdf387 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:17.900861 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631f148-3182-4b1c-b274-3e626bbdf387 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:17.901312 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631f148-3182-4b1c-b274-3e626bbdf387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:17.952886 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-e631f148-3182-4b1c-b274-3e626bbdf387 None None] MFA Rules not processed for user `d852ffddfc03467f896bdc441606b46e`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:17.955231 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-e631f148-3182-4b1c-b274-3e626bbdf387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:18.120282 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 907/1810] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:18.203441 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced398d9-b1e6-485e-9349-bf26346b3d2f admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:18.205562 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-ced398d9-b1e6-485e-9349-bf26346b3d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:18.279587 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631f148-3182-4b1c-b274-3e626bbdf387 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:18.281824 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-e631f148-3182-4b1c-b274-3e626bbdf387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:18.298164 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced398d9-b1e6-485e-9349-bf26346b3d2f admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:18.307186 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa7a3a-d147-48ca-92e9-d62d7943cdde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:18.308318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa7a3a-d147-48ca-92e9-d62d7943cdde service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:18.308724 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa7a3a-d147-48ca-92e9-d62d7943cdde service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:18.309101 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa7a3a-d147-48ca-92e9-d62d7943cdde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:18.324492 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa7a3a-d147-48ca-92e9-d62d7943cdde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:18.326580 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa7a3a-d147-48ca-92e9-d62d7943cdde service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:18.358119 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 904/1811] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:18.397972 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631f148-3182-4b1c-b274-3e626bbdf387 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:18.404088 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993736de-5a8b-4d63-9926-5b67d7c2c817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:18.405584 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993736de-5a8b-4d63-9926-5b67d7c2c817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:18.406140 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993736de-5a8b-4d63-9926-5b67d7c2c817 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:18.407963 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993736de-5a8b-4d63-9926-5b67d7c2c817 admin admin] PATH_INFO: `/v3/users/4d61640a3fc84c7aa0d5c70556c6112d` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:18.409846 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993736de-5a8b-4d63-9926-5b67d7c2c817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d61640a3fc84c7aa0d5c70556c6112d)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:18.416363 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993736de-5a8b-4d63-9926-5b67d7c2c817 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:18.481823 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa7a3a-d147-48ca-92e9-d62d7943cdde service cinder] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:18.498448 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa7a3a-d147-48ca-92e9-d62d7943cdde service cinder] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:18.508386 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97d24b-768f-4740-a309-d8770fedd49c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:18.509820 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97d24b-768f-4740-a309-d8770fedd49c service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:18.510555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97d24b-768f-4740-a309-d8770fedd49c service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:18.512516 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97d24b-768f-4740-a309-d8770fedd49c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:18.513217 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-993736de-5a8b-4d63-9926-5b67d7c2c817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d61640a3fc84c7aa0d5c70556c6112d'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:18.556071 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-993736de-5a8b-4d63-9926-5b67d7c2c817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d61640a3fc84c7aa0d5c70556c6112d'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:18.558010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-993736de-5a8b-4d63-9926-5b67d7c2c817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d61640a3fc84c7aa0d5c70556c6112d'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:18.578198 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-993736de-5a8b-4d63-9926-5b67d7c2c817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d61640a3fc84c7aa0d5c70556c6112d'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:18.581892 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-993736de-5a8b-4d63-9926-5b67d7c2c817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d61640a3fc84c7aa0d5c70556c6112d'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:18.629359 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97d24b-768f-4740-a309-d8770fedd49c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:18.632738 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97d24b-768f-4740-a309-d8770fedd49c service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:18.634554 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 908/1812] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:34:18 2022] DELETE /identity/v3/users/4d61640a3fc84c7aa0d5c70556c6112d => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:34:18.639369 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a28bbf-db88-42c3-96a8-d0a7c5d2578b None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:18.639728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a28bbf-db88-42c3-96a8-d0a7c5d2578b None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:18.640077 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a28bbf-db88-42c3-96a8-d0a7c5d2578b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:18.656608 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 905/1813] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 09:34:18.670696 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-c2a28bbf-db88-42c3-96a8-d0a7c5d2578b None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:18.672062 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-c2a28bbf-db88-42c3-96a8-d0a7c5d2578b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:18.766943 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 909/1814] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:18.793393 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97d24b-768f-4740-a309-d8770fedd49c service cinder] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:18.795244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-cb97d24b-768f-4740-a309-d8770fedd49c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:18.912191 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97d24b-768f-4740-a309-d8770fedd49c service cinder] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:18.986639 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209dcade-7f23-4d5a-86c0-dbf597e4876d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:18.987434 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dcade-7f23-4d5a-86c0-dbf597e4876d service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:18.987844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dcade-7f23-4d5a-86c0-dbf597e4876d service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:18.988570 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dcade-7f23-4d5a-86c0-dbf597e4876d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:19.003166 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209dcade-7f23-4d5a-86c0-dbf597e4876d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:19.004880 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209dcade-7f23-4d5a-86c0-dbf597e4876d service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:19.018949 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 906/1815] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:19.089960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a28bbf-db88-42c3-96a8-d0a7c5d2578b None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:19.091875 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-c2a28bbf-db88-42c3-96a8-d0a7c5d2578b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:19.112606 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a28bbf-db88-42c3-96a8-d0a7c5d2578b None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:19.130180 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde88945-479b-4ce5-8f39-30a805d078c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:19.131049 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde88945-479b-4ce5-8f39-30a805d078c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:19.131906 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde88945-479b-4ce5-8f39-30a805d078c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:19.132767 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde88945-479b-4ce5-8f39-30a805d078c8 admin admin] PATH_INFO: `/v3/users/5075cabc854f49a889816c5f03aed393` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:19.134838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde88945-479b-4ce5-8f39-30a805d078c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5075cabc854f49a889816c5f03aed393)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:19.136785 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde88945-479b-4ce5-8f39-30a805d078c8 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:19.213486 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-cde88945-479b-4ce5-8f39-30a805d078c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5075cabc854f49a889816c5f03aed393'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:19.238779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-cde88945-479b-4ce5-8f39-30a805d078c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5075cabc854f49a889816c5f03aed393'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:19.240293 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-cde88945-479b-4ce5-8f39-30a805d078c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5075cabc854f49a889816c5f03aed393'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:19.258409 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-cde88945-479b-4ce5-8f39-30a805d078c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5075cabc854f49a889816c5f03aed393'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:19.275833 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-cde88945-479b-4ce5-8f39-30a805d078c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5075cabc854f49a889816c5f03aed393'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:19.291029 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 910/1816] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:34:19 2022] DELETE /identity/v3/users/5075cabc854f49a889816c5f03aed393 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:19.295733 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c56571-f60f-41d4-a3c4-25a787af3a36 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:19.296219 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c56571-f60f-41d4-a3c4-25a787af3a36 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:19.296502 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c56571-f60f-41d4-a3c4-25a787af3a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:19.326720 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-87c56571-f60f-41d4-a3c4-25a787af3a36 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:19.327951 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-87c56571-f60f-41d4-a3c4-25a787af3a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:19.477549 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 907/1817] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:19.516765 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde88945-479b-4ce5-8f39-30a805d078c8 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:19.518476 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-cde88945-479b-4ce5-8f39-30a805d078c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:19.548019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde88945-479b-4ce5-8f39-30a805d078c8 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:19.565333 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c56571-f60f-41d4-a3c4-25a787af3a36 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:19.577836 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630c30f-f9d5-4ceb-bed9-34cbe2da7506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:19.580877 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630c30f-f9d5-4ceb-bed9-34cbe2da7506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:19.580877 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630c30f-f9d5-4ceb-bed9-34cbe2da7506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:19.581111 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630c30f-f9d5-4ceb-bed9-34cbe2da7506 admin admin] PATH_INFO: `/v3/users/c9ca1831b9d64d189dafac0c340cb0b9` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:19.581186 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-87c56571-f60f-41d4-a3c4-25a787af3a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:19.582983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630c30f-f9d5-4ceb-bed9-34cbe2da7506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ca1831b9d64d189dafac0c340cb0b9)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:19.598461 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630c30f-f9d5-4ceb-bed9-34cbe2da7506 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:19.684800 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c56571-f60f-41d4-a3c4-25a787af3a36 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:19.689273 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e0b80-3b92-4aca-8979-6dead7adbea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:19.690558 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e0b80-3b92-4aca-8979-6dead7adbea2 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:19.691210 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e0b80-3b92-4aca-8979-6dead7adbea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:19.691678 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e0b80-3b92-4aca-8979-6dead7adbea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:19.703977 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e0b80-3b92-4aca-8979-6dead7adbea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:19.705819 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e0b80-3b92-4aca-8979-6dead7adbea2 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:19.722030 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 908/1818] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:19.734299 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e630c30f-f9d5-4ceb-bed9-34cbe2da7506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ca1831b9d64d189dafac0c340cb0b9'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:19.757313 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e630c30f-f9d5-4ceb-bed9-34cbe2da7506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ca1831b9d64d189dafac0c340cb0b9'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:19.758162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e630c30f-f9d5-4ceb-bed9-34cbe2da7506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ca1831b9d64d189dafac0c340cb0b9'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:19.769643 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e630c30f-f9d5-4ceb-bed9-34cbe2da7506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ca1831b9d64d189dafac0c340cb0b9'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:19.787423 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e630c30f-f9d5-4ceb-bed9-34cbe2da7506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ca1831b9d64d189dafac0c340cb0b9'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:19.797957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 911/1819] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:34:19 2022] DELETE /identity/v3/users/c9ca1831b9d64d189dafac0c340cb0b9 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:19.801097 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fa76e-cd4c-47db-a3ee-0c68beb43a94 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:19.801342 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fa76e-cd4c-47db-a3ee-0c68beb43a94 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:19.803568 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fa76e-cd4c-47db-a3ee-0c68beb43a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:19.829475 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-256fa76e-cd4c-47db-a3ee-0c68beb43a94 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:19.830886 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-256fa76e-cd4c-47db-a3ee-0c68beb43a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:19.920558 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 909/1820] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:34:19.949513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630c30f-f9d5-4ceb-bed9-34cbe2da7506 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:19.951531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-e630c30f-f9d5-4ceb-bed9-34cbe2da7506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:20.073387 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630c30f-f9d5-4ceb-bed9-34cbe2da7506 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:20.081640 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b07746-0b2f-42fb-9e82-ec9ecd4c732f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:20.082936 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b07746-0b2f-42fb-9e82-ec9ecd4c732f service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:20.083451 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b07746-0b2f-42fb-9e82-ec9ecd4c732f service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:20.084277 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b07746-0b2f-42fb-9e82-ec9ecd4c732f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:20.096768 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b07746-0b2f-42fb-9e82-ec9ecd4c732f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:20.098799 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b07746-0b2f-42fb-9e82-ec9ecd4c732f service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:20.118532 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 912/1821] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:20.313780 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fa76e-cd4c-47db-a3ee-0c68beb43a94 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:20.315267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-256fa76e-cd4c-47db-a3ee-0c68beb43a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:20.335968 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fa76e-cd4c-47db-a3ee-0c68beb43a94 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:20.340836 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760b4ad-2424-413a-8fb5-0fe7f85371ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:20.341734 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760b4ad-2424-413a-8fb5-0fe7f85371ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:20.342052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760b4ad-2424-413a-8fb5-0fe7f85371ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:20.342530 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760b4ad-2424-413a-8fb5-0fe7f85371ef admin admin] PATH_INFO: `/v3/projects/9df3a5df9f9045bc94bdc3ce3e833c43` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:20.343886 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760b4ad-2424-413a-8fb5-0fe7f85371ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=9df3a5df9f9045bc94bdc3ce3e833c43)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:20.346259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760b4ad-2424-413a-8fb5-0fe7f85371ef admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:20.409642 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e760b4ad-2424-413a-8fb5-0fe7f85371ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9df3a5df9f9045bc94bdc3ce3e833c43', 'request_id': 'req-e760b4ad-2424-413a-8fb5-0fe7f85371ef'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:20.416436 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e760b4ad-2424-413a-8fb5-0fe7f85371ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9df3a5df9f9045bc94bdc3ce3e833c43', 'request_id': 'req-e760b4ad-2424-413a-8fb5-0fe7f85371ef'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:20.423912 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e760b4ad-2424-413a-8fb5-0fe7f85371ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9df3a5df9f9045bc94bdc3ce3e833c43', 'request_id': 'req-e760b4ad-2424-413a-8fb5-0fe7f85371ef'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:20.437588 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b07746-0b2f-42fb-9e82-ec9ecd4c732f service neutron] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:20.439131 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-84b07746-0b2f-42fb-9e82-ec9ecd4c732f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:20.439488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e760b4ad-2424-413a-8fb5-0fe7f85371ef admin admin] The token cache is being invalidate because project 9df3a5df9f9045bc94bdc3ce3e833c43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:34:20.439789 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e760b4ad-2424-413a-8fb5-0fe7f85371ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:20.442493 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e760b4ad-2424-413a-8fb5-0fe7f85371ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:20.448047 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 910/1822] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:34:20 2022] DELETE /identity/v3/projects/9df3a5df9f9045bc94bdc3ce3e833c43 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:20.450698 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760b4ad-2424-413a-8fb5-0fe7f85371ef admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:20.453713 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-e760b4ad-2424-413a-8fb5-0fe7f85371ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:20.459550 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b07746-0b2f-42fb-9e82-ec9ecd4c732f service neutron] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:20.527426 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d88c0-b830-4c89-bc26-d4131eee06dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:20.528352 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d88c0-b830-4c89-bc26-d4131eee06dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:20.528631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d88c0-b830-4c89-bc26-d4131eee06dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:20.528931 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d88c0-b830-4c89-bc26-d4131eee06dc admin admin] PATH_INFO: `/v3/projects/4eac8344a35a43a5bb6d755006c4476a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:20.530615 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d88c0-b830-4c89-bc26-d4131eee06dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eac8344a35a43a5bb6d755006c4476a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:20.532134 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d88c0-b830-4c89-bc26-d4131eee06dc admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:20.545046 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760b4ad-2424-413a-8fb5-0fe7f85371ef admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:20.551165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f9d02-a249-45e0-b4c2-de50a8934c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:20.552349 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f9d02-a249-45e0-b4c2-de50a8934c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:20.552935 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f9d02-a249-45e0-b4c2-de50a8934c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:20.553213 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f9d02-a249-45e0-b4c2-de50a8934c07 admin admin] PATH_INFO: `/v3/users/1ed8d19376544b228804a24be0a2bdcc` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:20.555052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f9d02-a249-45e0-b4c2-de50a8934c07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ed8d19376544b228804a24be0a2bdcc)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:20.556979 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f9d02-a249-45e0-b4c2-de50a8934c07 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:20.636288 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f50d88c0-b830-4c89-bc26-d4131eee06dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eac8344a35a43a5bb6d755006c4476a', 'request_id': 'req-f50d88c0-b830-4c89-bc26-d4131eee06dc'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:20.641437 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-943f9d02-a249-45e0-b4c2-de50a8934c07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ed8d19376544b228804a24be0a2bdcc'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:20.647048 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f50d88c0-b830-4c89-bc26-d4131eee06dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eac8344a35a43a5bb6d755006c4476a', 'request_id': 'req-f50d88c0-b830-4c89-bc26-d4131eee06dc'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:20.654884 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-943f9d02-a249-45e0-b4c2-de50a8934c07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ed8d19376544b228804a24be0a2bdcc'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:20.655713 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-943f9d02-a249-45e0-b4c2-de50a8934c07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ed8d19376544b228804a24be0a2bdcc'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:20.660694 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f50d88c0-b830-4c89-bc26-d4131eee06dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eac8344a35a43a5bb6d755006c4476a', 'request_id': 'req-f50d88c0-b830-4c89-bc26-d4131eee06dc'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:20.667930 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-943f9d02-a249-45e0-b4c2-de50a8934c07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ed8d19376544b228804a24be0a2bdcc'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:20.678367 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-943f9d02-a249-45e0-b4c2-de50a8934c07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ed8d19376544b228804a24be0a2bdcc'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:20.679120 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f50d88c0-b830-4c89-bc26-d4131eee06dc admin admin] The token cache is being invalidate because project 4eac8344a35a43a5bb6d755006c4476a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:34:20.679489 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f50d88c0-b830-4c89-bc26-d4131eee06dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:20.680213 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f50d88c0-b830-4c89-bc26-d4131eee06dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:20.685096 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 913/1823] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:34:20 2022] DELETE /identity/v3/projects/4eac8344a35a43a5bb6d755006c4476a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:20.686379 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 911/1824] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:34:20 2022] DELETE /identity/v3/users/1ed8d19376544b228804a24be0a2bdcc => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:20.686863 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f9d02-a249-45e0-b4c2-de50a8934c07 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:20.689423 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d88c0-b830-4c89-bc26-d4131eee06dc admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:20.690871 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-943f9d02-a249-45e0-b4c2-de50a8934c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:20.691964 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-f50d88c0-b830-4c89-bc26-d4131eee06dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:20.786667 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d88c0-b830-4c89-bc26-d4131eee06dc admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:20.788949 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f9d02-a249-45e0-b4c2-de50a8934c07 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:20.791739 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487c864-68fd-4a70-b317-5e9d16b0d6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:20.792700 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487c864-68fd-4a70-b317-5e9d16b0d6b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:20.793111 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487c864-68fd-4a70-b317-5e9d16b0d6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:20.793454 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487c864-68fd-4a70-b317-5e9d16b0d6b2 admin admin] PATH_INFO: `/v3/projects/4f4faf77fa1c4d4abe39ef6577542579` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:20.798399 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487c864-68fd-4a70-b317-5e9d16b0d6b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f4faf77fa1c4d4abe39ef6577542579)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:20.800307 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42878ac-a6e2-46c5-ab73-e97e325d8cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:20.800547 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487c864-68fd-4a70-b317-5e9d16b0d6b2 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:20.801592 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42878ac-a6e2-46c5-ab73-e97e325d8cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:20.802064 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42878ac-a6e2-46c5-ab73-e97e325d8cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:20.802698 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42878ac-a6e2-46c5-ab73-e97e325d8cf0 admin admin] PATH_INFO: `/v3/users/d852ffddfc03467f896bdc441606b46e` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:20.804634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42878ac-a6e2-46c5-ab73-e97e325d8cf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d852ffddfc03467f896bdc441606b46e)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:20.807318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42878ac-a6e2-46c5-ab73-e97e325d8cf0 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:20.884559 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-6487c864-68fd-4a70-b317-5e9d16b0d6b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f4faf77fa1c4d4abe39ef6577542579', 'request_id': 'req-6487c864-68fd-4a70-b317-5e9d16b0d6b2'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:20.895530 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-d42878ac-a6e2-46c5-ab73-e97e325d8cf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd852ffddfc03467f896bdc441606b46e'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:20.896011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-6487c864-68fd-4a70-b317-5e9d16b0d6b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f4faf77fa1c4d4abe39ef6577542579', 'request_id': 'req-6487c864-68fd-4a70-b317-5e9d16b0d6b2'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:20.910607 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-6487c864-68fd-4a70-b317-5e9d16b0d6b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f4faf77fa1c4d4abe39ef6577542579', 'request_id': 'req-6487c864-68fd-4a70-b317-5e9d16b0d6b2'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:20.913171 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-d42878ac-a6e2-46c5-ab73-e97e325d8cf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd852ffddfc03467f896bdc441606b46e'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:20.914075 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-d42878ac-a6e2-46c5-ab73-e97e325d8cf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd852ffddfc03467f896bdc441606b46e'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:20.925534 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-d42878ac-a6e2-46c5-ab73-e97e325d8cf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd852ffddfc03467f896bdc441606b46e'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:20.930844 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-6487c864-68fd-4a70-b317-5e9d16b0d6b2 admin admin] The token cache is being invalidate because project 4f4faf77fa1c4d4abe39ef6577542579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:34:20.931596 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-6487c864-68fd-4a70-b317-5e9d16b0d6b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:20.932502 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-6487c864-68fd-4a70-b317-5e9d16b0d6b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:20.934796 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 914/1825] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:34:20 2022] DELETE /identity/v3/projects/4f4faf77fa1c4d4abe39ef6577542579 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:20.939102 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-d42878ac-a6e2-46c5-ab73-e97e325d8cf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd852ffddfc03467f896bdc441606b46e'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:20.941711 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487c864-68fd-4a70-b317-5e9d16b0d6b2 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:20.946602 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-6487c864-68fd-4a70-b317-5e9d16b0d6b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:20.954228 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 912/1826] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:34:20 2022] DELETE /identity/v3/users/d852ffddfc03467f896bdc441606b46e => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:21.075191 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487c864-68fd-4a70-b317-5e9d16b0d6b2 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:21.229623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42878ac-a6e2-46c5-ab73-e97e325d8cf0 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:21.231244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-d42878ac-a6e2-46c5-ab73-e97e325d8cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:21.370840 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42878ac-a6e2-46c5-ab73-e97e325d8cf0 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:21.376595 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c5e51-cbf3-49c0-b10f-b59b213784ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:21.378025 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c5e51-cbf3-49c0-b10f-b59b213784ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:21.378316 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c5e51-cbf3-49c0-b10f-b59b213784ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:21.378593 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c5e51-cbf3-49c0-b10f-b59b213784ff admin admin] PATH_INFO: `/v3/projects/f0b6c24c864646dd9f1ab0ebdb4b885d` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:21.386077 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c5e51-cbf3-49c0-b10f-b59b213784ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0b6c24c864646dd9f1ab0ebdb4b885d)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:21.388161 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c5e51-cbf3-49c0-b10f-b59b213784ff admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:21.401384 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498e4f5-1d71-4a52-9483-4eb4fdf18884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:21.403223 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498e4f5-1d71-4a52-9483-4eb4fdf18884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:21.403573 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498e4f5-1d71-4a52-9483-4eb4fdf18884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:21.403916 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498e4f5-1d71-4a52-9483-4eb4fdf18884 admin admin] PATH_INFO: `/v3/users/81f412441fb24d3d904fd86150ac8ddb` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:21.405225 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498e4f5-1d71-4a52-9483-4eb4fdf18884 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81f412441fb24d3d904fd86150ac8ddb)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:21.407577 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498e4f5-1d71-4a52-9483-4eb4fdf18884 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:21.451309 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-7f2c5e51-cbf3-49c0-b10f-b59b213784ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0b6c24c864646dd9f1ab0ebdb4b885d', 'request_id': 'req-7f2c5e51-cbf3-49c0-b10f-b59b213784ff'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:21.458292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-7f2c5e51-cbf3-49c0-b10f-b59b213784ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0b6c24c864646dd9f1ab0ebdb4b885d', 'request_id': 'req-7f2c5e51-cbf3-49c0-b10f-b59b213784ff'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:21.469400 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-7f2c5e51-cbf3-49c0-b10f-b59b213784ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0b6c24c864646dd9f1ab0ebdb4b885d', 'request_id': 'req-7f2c5e51-cbf3-49c0-b10f-b59b213784ff'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:21.471177 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d498e4f5-1d71-4a52-9483-4eb4fdf18884 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81f412441fb24d3d904fd86150ac8ddb'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:21.482538 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-7f2c5e51-cbf3-49c0-b10f-b59b213784ff admin admin] The token cache is being invalidate because project f0b6c24c864646dd9f1ab0ebdb4b885d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:34:21.482907 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-7f2c5e51-cbf3-49c0-b10f-b59b213784ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:21.483692 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-7f2c5e51-cbf3-49c0-b10f-b59b213784ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:21.485982 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 913/1827] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:34:21 2022] DELETE /identity/v3/projects/f0b6c24c864646dd9f1ab0ebdb4b885d => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:21.490497 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d5422-33e1-4653-8aa3-806b483a0742 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:21.490862 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d5422-33e1-4653-8aa3-806b483a0742 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:21.491055 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d5422-33e1-4653-8aa3-806b483a0742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:21.492496 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d498e4f5-1d71-4a52-9483-4eb4fdf18884 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81f412441fb24d3d904fd86150ac8ddb'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:21.493476 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d498e4f5-1d71-4a52-9483-4eb4fdf18884 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81f412441fb24d3d904fd86150ac8ddb'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:21.502526 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d498e4f5-1d71-4a52-9483-4eb4fdf18884 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81f412441fb24d3d904fd86150ac8ddb'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:21.512074 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-385d5422-33e1-4653-8aa3-806b483a0742 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:21.513368 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-385d5422-33e1-4653-8aa3-806b483a0742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:21.514526 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d498e4f5-1d71-4a52-9483-4eb4fdf18884 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81f412441fb24d3d904fd86150ac8ddb'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:21.521459 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 915/1828] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:34:20 2022] DELETE /identity/v3/users/81f412441fb24d3d904fd86150ac8ddb => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:34:21.522379 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498e4f5-1d71-4a52-9483-4eb4fdf18884 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:21.524830 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-d498e4f5-1d71-4a52-9483-4eb4fdf18884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:21.583368 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 914/1829] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:34:21.593008 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24511d-d7e2-483c-84c3-eaf17db2467b None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:21.593560 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24511d-d7e2-483c-84c3-eaf17db2467b None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:21.593718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24511d-d7e2-483c-84c3-eaf17db2467b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:21.612685 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-6e24511d-d7e2-483c-84c3-eaf17db2467b None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:21.613928 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-6e24511d-d7e2-483c-84c3-eaf17db2467b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:21.614216 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498e4f5-1d71-4a52-9483-4eb4fdf18884 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:21.619095 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f768fe-82a6-46b8-b13e-20509fae8996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:21.620036 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f768fe-82a6-46b8-b13e-20509fae8996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:21.620378 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f768fe-82a6-46b8-b13e-20509fae8996 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:21.620711 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f768fe-82a6-46b8-b13e-20509fae8996 admin admin] PATH_INFO: `/v3/projects/8f20977da96e479596e8b6a838866fc7` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:21.622143 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f768fe-82a6-46b8-b13e-20509fae8996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f20977da96e479596e8b6a838866fc7)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:21.624237 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f768fe-82a6-46b8-b13e-20509fae8996 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:21.626312 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 915/1830] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:21.627342 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24511d-d7e2-483c-84c3-eaf17db2467b None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:21.637265 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24511d-d7e2-483c-84c3-eaf17db2467b None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:21.642151 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c86e7-fda2-4dba-b8c0-2522f8125e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:21.642822 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c86e7-fda2-4dba-b8c0-2522f8125e71 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:21.643086 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c86e7-fda2-4dba-b8c0-2522f8125e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:21.643458 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c86e7-fda2-4dba-b8c0-2522f8125e71 admin admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:21.644351 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c86e7-fda2-4dba-b8c0-2522f8125e71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:34:21.644660 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c86e7-fda2-4dba-b8c0-2522f8125e71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:21.646276 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c86e7-fda2-4dba-b8c0-2522f8125e71 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:21.659009 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 916/1831] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:34:21.663172 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c86e7-fda2-4dba-b8c0-2522f8125e71 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:21.673016 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c86e7-fda2-4dba-b8c0-2522f8125e71 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:21.685232 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-06f768fe-82a6-46b8-b13e-20509fae8996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f20977da96e479596e8b6a838866fc7', 'request_id': 'req-06f768fe-82a6-46b8-b13e-20509fae8996'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:21.693461 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-06f768fe-82a6-46b8-b13e-20509fae8996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f20977da96e479596e8b6a838866fc7', 'request_id': 'req-06f768fe-82a6-46b8-b13e-20509fae8996'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:21.704293 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-06f768fe-82a6-46b8-b13e-20509fae8996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f20977da96e479596e8b6a838866fc7', 'request_id': 'req-06f768fe-82a6-46b8-b13e-20509fae8996'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:21.718871 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-06f768fe-82a6-46b8-b13e-20509fae8996 admin admin] The token cache is being invalidate because project 8f20977da96e479596e8b6a838866fc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:34:21.719153 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-06f768fe-82a6-46b8-b13e-20509fae8996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:21.720221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-06f768fe-82a6-46b8-b13e-20509fae8996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:21.721469 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 916/1832] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:34:21 2022] DELETE /identity/v3/projects/8f20977da96e479596e8b6a838866fc7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:21.726184 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e519db-1132-4e20-b0b2-04cd01e61a78 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:21.726539 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e519db-1132-4e20-b0b2-04cd01e61a78 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:21.727008 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e519db-1132-4e20-b0b2-04cd01e61a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:21.741260 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e74c41-e6ea-44a6-b9b9-535b66a7e9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:21.742063 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e74c41-e6ea-44a6-b9b9-535b66a7e9d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:21.742346 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e74c41-e6ea-44a6-b9b9-535b66a7e9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:21.742615 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e74c41-e6ea-44a6-b9b9-535b66a7e9d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:21.743569 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e74c41-e6ea-44a6-b9b9-535b66a7e9d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:21.745243 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-b0e519db-1132-4e20-b0b2-04cd01e61a78 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:21.745931 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e74c41-e6ea-44a6-b9b9-535b66a7e9d6 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:21.746570 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-b0e519db-1132-4e20-b0b2-04cd01e61a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:21.761469 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 917/1833] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:21.762978 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85e82f-8dc5-4ac6-aaf1-58895ce18a75 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:21.763258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85e82f-8dc5-4ac6-aaf1-58895ce18a75 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:21.763561 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85e82f-8dc5-4ac6-aaf1-58895ce18a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:21.779261 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 917/1834] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:34:21 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:34:21.782226 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e74c41-e6ea-44a6-b9b9-535b66a7e9d6 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:21.783685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-6b85e82f-8dc5-4ac6-aaf1-58895ce18a75 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:21.784868 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-6b85e82f-8dc5-4ac6-aaf1-58895ce18a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:21.786776 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-94e74c41-e6ea-44a6-b9b9-535b66a7e9d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:21.854273 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e74c41-e6ea-44a6-b9b9-535b66a7e9d6 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:21.859950 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060961c-8e17-4228-82db-de5c979d7a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:21.860860 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060961c-8e17-4228-82db-de5c979d7a80 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:21.861337 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060961c-8e17-4228-82db-de5c979d7a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:21.861749 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060961c-8e17-4228-82db-de5c979d7a80 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:21.862678 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060961c-8e17-4228-82db-de5c979d7a80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:21.865337 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060961c-8e17-4228-82db-de5c979d7a80 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:21.908328 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 918/1835] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:21.914376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85e82f-8dc5-4ac6-aaf1-58895ce18a75 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:21.916761 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 918/1836] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:34:21 2022] POST /identity/v3/users => generated 294 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:21.920816 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060961c-8e17-4228-82db-de5c979d7a80 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:21.933102 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060961c-8e17-4228-82db-de5c979d7a80 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:21.940188 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc64006-4fc4-42c3-ae6f-f71e195b1f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:21.941499 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85e82f-8dc5-4ac6-aaf1-58895ce18a75 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:21.942326 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc64006-4fc4-42c3-ae6f-f71e195b1f70 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:21.942604 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc64006-4fc4-42c3-ae6f-f71e195b1f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:21.942870 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc64006-4fc4-42c3-ae6f-f71e195b1f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:21.944346 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc64006-4fc4-42c3-ae6f-f71e195b1f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:21.947054 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc64006-4fc4-42c3-ae6f-f71e195b1f70 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:21.958497 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010efeb9-ad6d-4bdf-aca3-71a1223d1dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:21.959637 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010efeb9-ad6d-4bdf-aca3-71a1223d1dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:21.960220 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010efeb9-ad6d-4bdf-aca3-71a1223d1dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:21.960625 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010efeb9-ad6d-4bdf-aca3-71a1223d1dd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:21.961505 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010efeb9-ad6d-4bdf-aca3-71a1223d1dd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:34:21.961808 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010efeb9-ad6d-4bdf-aca3-71a1223d1dd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:21.966564 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010efeb9-ad6d-4bdf-aca3-71a1223d1dd9 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:21.970600 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 919/1837] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:21.971474 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc64006-4fc4-42c3-ae6f-f71e195b1f70 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:21.979494 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-9cc64006-4fc4-42c3-ae6f-f71e195b1f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:21.996513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 919/1838] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:34:21.997465 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010efeb9-ad6d-4bdf-aca3-71a1223d1dd9 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:22.010003 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc64006-4fc4-42c3-ae6f-f71e195b1f70 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:22.019549 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010efeb9-ad6d-4bdf-aca3-71a1223d1dd9 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:22.025737 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f915e07-1ccd-4d7b-858f-2edf8661933e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:22.026390 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f915e07-1ccd-4d7b-858f-2edf8661933e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:22.026672 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f915e07-1ccd-4d7b-858f-2edf8661933e admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:22.026944 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f915e07-1ccd-4d7b-858f-2edf8661933e admin admin] PATH_INFO: `/v3/projects/015b0e31e8334216aef96a6cae227a62` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:22.029340 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f915e07-1ccd-4d7b-858f-2edf8661933e admin admin] RBAC: Authorizing `identity:delete_project(project_id=015b0e31e8334216aef96a6cae227a62)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:22.031593 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f915e07-1ccd-4d7b-858f-2edf8661933e admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:22.034599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d418177-b0c6-4e4f-8fa5-2e175b5a8c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:22.035272 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d418177-b0c6-4e4f-8fa5-2e175b5a8c5c admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:22.035552 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d418177-b0c6-4e4f-8fa5-2e175b5a8c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:22.035824 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d418177-b0c6-4e4f-8fa5-2e175b5a8c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:22.036555 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d418177-b0c6-4e4f-8fa5-2e175b5a8c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:22.040048 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d418177-b0c6-4e4f-8fa5-2e175b5a8c5c admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:22.066079 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 920/1839] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:22.066960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d418177-b0c6-4e4f-8fa5-2e175b5a8c5c admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:22.090981 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d418177-b0c6-4e4f-8fa5-2e175b5a8c5c admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:22.097462 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c7fb7-23f8-47c2-958f-f31813150625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:22.098790 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c7fb7-23f8-47c2-958f-f31813150625 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:22.099088 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c7fb7-23f8-47c2-958f-f31813150625 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:22.099360 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c7fb7-23f8-47c2-958f-f31813150625 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:22.100071 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c7fb7-23f8-47c2-958f-f31813150625 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:22.102445 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c7fb7-23f8-47c2-958f-f31813150625 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:22.138978 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-9f915e07-1ccd-4d7b-858f-2edf8661933e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '015b0e31e8334216aef96a6cae227a62', 'request_id': 'req-9f915e07-1ccd-4d7b-858f-2edf8661933e'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:22.148298 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-9f915e07-1ccd-4d7b-858f-2edf8661933e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '015b0e31e8334216aef96a6cae227a62', 'request_id': 'req-9f915e07-1ccd-4d7b-858f-2edf8661933e'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:22.154727 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 921/1840] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:34:22 2022] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:22.155600 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c7fb7-23f8-47c2-958f-f31813150625 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:22.159429 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-9f915e07-1ccd-4d7b-858f-2edf8661933e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '015b0e31e8334216aef96a6cae227a62', 'request_id': 'req-9f915e07-1ccd-4d7b-858f-2edf8661933e'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:22.187789 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-9f915e07-1ccd-4d7b-858f-2edf8661933e admin admin] The token cache is being invalidate because project 015b0e31e8334216aef96a6cae227a62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:34:22.188205 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-9f915e07-1ccd-4d7b-858f-2edf8661933e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:22.188941 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-9f915e07-1ccd-4d7b-858f-2edf8661933e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:22.191908 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 920/1841] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:34:21 2022] DELETE /identity/v3/projects/015b0e31e8334216aef96a6cae227a62 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:22.192387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f915e07-1ccd-4d7b-858f-2edf8661933e admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:22.197840 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-9f915e07-1ccd-4d7b-858f-2edf8661933e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:22.284552 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c7fb7-23f8-47c2-958f-f31813150625 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:22.299980 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1e5cb-878a-4ab6-bbf3-7a76ee860f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:22.300194 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1e5cb-878a-4ab6-bbf3-7a76ee860f14 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:22.300447 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1e5cb-878a-4ab6-bbf3-7a76ee860f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:22.301035 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1e5cb-878a-4ab6-bbf3-7a76ee860f14 admin admin] PATH_INFO: `/v3/projects/f01ce275bfeb443da44fb59d360b60df/users/7370cfdfaa86471fa55426ed35550279/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:22.326170 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1e5cb-878a-4ab6-bbf3-7a76ee860f14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f01ce275bfeb443da44fb59d360b60df, user_id=7370cfdfaa86471fa55426ed35550279, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:22.328832 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1e5cb-878a-4ab6-bbf3-7a76ee860f14 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:22.330635 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f915e07-1ccd-4d7b-858f-2edf8661933e admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:22.344245 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa38f15-ee32-425d-8cb5-e74667f57119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:22.345432 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa38f15-ee32-425d-8cb5-e74667f57119 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:22.346064 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa38f15-ee32-425d-8cb5-e74667f57119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:22.346915 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa38f15-ee32-425d-8cb5-e74667f57119 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:22.348024 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa38f15-ee32-425d-8cb5-e74667f57119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:22.351474 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa38f15-ee32-425d-8cb5-e74667f57119 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:22.354490 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 922/1842] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:22 2022] PUT /identity/v3/projects/f01ce275bfeb443da44fb59d360b60df/users/7370cfdfaa86471fa55426ed35550279/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:22.355781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7da51-8a45-4c54-a8ec-b9d486d42bfd None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:22.356062 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7da51-8a45-4c54-a8ec-b9d486d42bfd None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:22.356335 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7da51-8a45-4c54-a8ec-b9d486d42bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:22.392568 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-8fc7da51-8a45-4c54-a8ec-b9d486d42bfd None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:22.395567 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 921/1843] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:34:22 2022] POST /identity/v3/users => generated 287 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:22.397013 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8c27c-32d5-496c-a152-3df8823048fe None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:22.397350 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8c27c-32d5-496c-a152-3df8823048fe None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:22.397667 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8c27c-32d5-496c-a152-3df8823048fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:22.402655 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-8fc7da51-8a45-4c54-a8ec-b9d486d42bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:22.474875 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-dbf8c27c-32d5-496c-a152-3df8823048fe None None] MFA Rules not processed for user `7370cfdfaa86471fa55426ed35550279`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:22.482630 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-dbf8c27c-32d5-496c-a152-3df8823048fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:22.550069 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 923/1844] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:22.557681 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7da51-8a45-4c54-a8ec-b9d486d42bfd None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:22.579720 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7da51-8a45-4c54-a8ec-b9d486d42bfd None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:22.596814 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63175ea-9ec8-4aac-b536-565f95e7a20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:22.600484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63175ea-9ec8-4aac-b536-565f95e7a20d admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:22.601522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63175ea-9ec8-4aac-b536-565f95e7a20d admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:22.601812 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63175ea-9ec8-4aac-b536-565f95e7a20d admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:22.606757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63175ea-9ec8-4aac-b536-565f95e7a20d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:22.611143 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63175ea-9ec8-4aac-b536-565f95e7a20d admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:22.614945 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 922/1845] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:22.616609 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4fa27-0991-43fc-a0c8-3740bea04f18 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:22.617103 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4fa27-0991-43fc-a0c8-3740bea04f18 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:22.617579 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4fa27-0991-43fc-a0c8-3740bea04f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:22.646619 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-c8e4fa27-0991-43fc-a0c8-3740bea04f18 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:22.648481 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-c8e4fa27-0991-43fc-a0c8-3740bea04f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:22.655595 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 924/1846] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:22.658078 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63175ea-9ec8-4aac-b536-565f95e7a20d admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:22.663940 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 923/1847] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:22.665213 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4fa27-0991-43fc-a0c8-3740bea04f18 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:22.665539 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-c63175ea-9ec8-4aac-b536-565f95e7a20d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:22.676359 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4fa27-0991-43fc-a0c8-3740bea04f18 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:22.685421 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985a1c0-8aab-4cb0-b9cf-904373709174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:22.686305 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985a1c0-8aab-4cb0-b9cf-904373709174 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:22.686931 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985a1c0-8aab-4cb0-b9cf-904373709174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:22.687681 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985a1c0-8aab-4cb0-b9cf-904373709174 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:22.688137 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985a1c0-8aab-4cb0-b9cf-904373709174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:22.689880 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985a1c0-8aab-4cb0-b9cf-904373709174 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:22.694760 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63175ea-9ec8-4aac-b536-565f95e7a20d admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:22.701794 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf14a2-8cbb-4336-8d55-8c42f00cf8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:22.702505 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf14a2-8cbb-4336-8d55-8c42f00cf8d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:22.702858 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf14a2-8cbb-4336-8d55-8c42f00cf8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:22.703150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf14a2-8cbb-4336-8d55-8c42f00cf8d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:22.703854 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf14a2-8cbb-4336-8d55-8c42f00cf8d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:22.706153 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf14a2-8cbb-4336-8d55-8c42f00cf8d2 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:22.712800 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 924/1848] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:22.714584 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985a1c0-8aab-4cb0-b9cf-904373709174 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:22.728468 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985a1c0-8aab-4cb0-b9cf-904373709174 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:22.738330 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867c058-3d04-4ecd-906d-64d9cb18ed5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:22.739566 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867c058-3d04-4ecd-906d-64d9cb18ed5c admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:22.740082 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867c058-3d04-4ecd-906d-64d9cb18ed5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:22.740555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867c058-3d04-4ecd-906d-64d9cb18ed5c admin admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:22.741702 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867c058-3d04-4ecd-906d-64d9cb18ed5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:34:22.742703 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867c058-3d04-4ecd-906d-64d9cb18ed5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:22.745300 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5867c058-3d04-4ecd-906d-64d9cb18ed5c admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:22.758895 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 925/1849] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:34:22 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:22.760067 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf14a2-8cbb-4336-8d55-8c42f00cf8d2 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:22.769280 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 925/1850] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:34:22.771182 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867c058-3d04-4ecd-906d-64d9cb18ed5c admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:22.783402 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867c058-3d04-4ecd-906d-64d9cb18ed5c admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:22.852218 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf14a2-8cbb-4336-8d55-8c42f00cf8d2 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:22.859040 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832b4be-b949-438e-a327-87804bf66546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:22.860012 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832b4be-b949-438e-a327-87804bf66546 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:22.860292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8ef91-0429-4a56-89cd-693c53fcb41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:22.860414 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832b4be-b949-438e-a327-87804bf66546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:22.860632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832b4be-b949-438e-a327-87804bf66546 admin admin] PATH_INFO: `/v3/projects/bfbda12e4b664723a04097b2ca1e8698/users/577753fb8fd84511b4f30a8179430aa5/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:22.861749 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8ef91-0429-4a56-89cd-693c53fcb41d admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:22.862467 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8ef91-0429-4a56-89cd-693c53fcb41d admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:22.863120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8ef91-0429-4a56-89cd-693c53fcb41d admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:22.864120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da8ef91-0429-4a56-89cd-693c53fcb41d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:22.866941 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da8ef91-0429-4a56-89cd-693c53fcb41d admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:22.885220 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832b4be-b949-438e-a327-87804bf66546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfbda12e4b664723a04097b2ca1e8698, user_id=577753fb8fd84511b4f30a8179430aa5, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:22.888954 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832b4be-b949-438e-a327-87804bf66546 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:22.896532 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 926/1851] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:34:22 2022] POST /identity/v3/users => generated 300 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:22.898029 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8ef91-0429-4a56-89cd-693c53fcb41d admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:22.912172 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8ef91-0429-4a56-89cd-693c53fcb41d admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:22.918559 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 926/1852] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:22 2022] PUT /identity/v3/projects/bfbda12e4b664723a04097b2ca1e8698/users/577753fb8fd84511b4f30a8179430aa5/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:22.928105 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832b4be-b949-438e-a327-87804bf66546 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:23.033996 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713deb85-9096-4895-ad05-5ef20b1c9b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:23.035355 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713deb85-9096-4895-ad05-5ef20b1c9b6a admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:23.035637 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713deb85-9096-4895-ad05-5ef20b1c9b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:23.035917 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713deb85-9096-4895-ad05-5ef20b1c9b6a admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:23.036630 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713deb85-9096-4895-ad05-5ef20b1c9b6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:23.049468 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713deb85-9096-4895-ad05-5ef20b1c9b6a admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:23.089338 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832b4be-b949-438e-a327-87804bf66546 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:23.110514 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884857d2-62a3-4437-a7f7-414a28aca933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:23.114600 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884857d2-62a3-4437-a7f7-414a28aca933 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:23.114897 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884857d2-62a3-4437-a7f7-414a28aca933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:23.115181 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884857d2-62a3-4437-a7f7-414a28aca933 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:23.117029 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884857d2-62a3-4437-a7f7-414a28aca933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:23.122039 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884857d2-62a3-4437-a7f7-414a28aca933 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:23.125381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 927/1853] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:34:22 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:23.131413 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace71c2-2f50-46c2-8ef2-c4062ebaa490 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:23.131413 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace71c2-2f50-46c2-8ef2-c4062ebaa490 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:23.131413 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace71c2-2f50-46c2-8ef2-c4062ebaa490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:23.157822 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 927/1854] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:23.174249 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884857d2-62a3-4437-a7f7-414a28aca933 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:23.197793 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884857d2-62a3-4437-a7f7-414a28aca933 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:23.245024 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-2ace71c2-2f50-46c2-8ef2-c4062ebaa490 None None] MFA Rules not processed for user `577753fb8fd84511b4f30a8179430aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:23.259911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-2ace71c2-2f50-46c2-8ef2-c4062ebaa490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:23.350244 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59265f93-98a9-4237-9376-ae35ba271827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:23.351006 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59265f93-98a9-4237-9376-ae35ba271827 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:23.351290 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59265f93-98a9-4237-9376-ae35ba271827 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:23.352298 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59265f93-98a9-4237-9376-ae35ba271827 admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:23.353092 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59265f93-98a9-4237-9376-ae35ba271827 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:23.360366 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59265f93-98a9-4237-9376-ae35ba271827 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:23.418673 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 928/1855] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:23.419603 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace71c2-2f50-46c2-8ef2-c4062ebaa490 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:23.424576 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 928/1856] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:34:23 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:23.425481 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59265f93-98a9-4237-9376-ae35ba271827 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:23.441403 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59265f93-98a9-4237-9376-ae35ba271827 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:23.453257 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace71c2-2f50-46c2-8ef2-c4062ebaa490 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:23.461923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a83d7-e25d-4bb5-9db2-3cbf3b51d507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:23.462443 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a83d7-e25d-4bb5-9db2-3cbf3b51d507 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:23.462685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a83d7-e25d-4bb5-9db2-3cbf3b51d507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:23.462958 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a83d7-e25d-4bb5-9db2-3cbf3b51d507 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:23.464257 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a83d7-e25d-4bb5-9db2-3cbf3b51d507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:23.467652 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a83d7-e25d-4bb5-9db2-3cbf3b51d507 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:23.470288 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2adc52-bfbd-422f-aa0e-c83421e5da40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:23.471752 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2adc52-bfbd-422f-aa0e-c83421e5da40 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:23.472097 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2adc52-bfbd-422f-aa0e-c83421e5da40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:23.472804 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2adc52-bfbd-422f-aa0e-c83421e5da40 admin admin] PATH_INFO: `/v3/projects/67fa67430dbd439898a7d11cb6924039/users/dfb718a7926142de8d89dfce747ec357/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:23.495891 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2adc52-bfbd-422f-aa0e-c83421e5da40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67fa67430dbd439898a7d11cb6924039, user_id=dfb718a7926142de8d89dfce747ec357, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:23.499773 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2adc52-bfbd-422f-aa0e-c83421e5da40 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:23.505155 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 929/1857] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:34:23 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:23.505155 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a83d7-e25d-4bb5-9db2-3cbf3b51d507 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:23.530538 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 929/1858] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:23 2022] PUT /identity/v3/projects/67fa67430dbd439898a7d11cb6924039/users/dfb718a7926142de8d89dfce747ec357/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:23.532397 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2adc52-bfbd-422f-aa0e-c83421e5da40 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:23.610693 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a83d7-e25d-4bb5-9db2-3cbf3b51d507 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:23.659592 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2adc52-bfbd-422f-aa0e-c83421e5da40 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:23.681982 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db0b6b-7236-4dbc-918a-7a3f0f474db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:23.684068 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db0b6b-7236-4dbc-918a-7a3f0f474db0 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:23.684356 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db0b6b-7236-4dbc-918a-7a3f0f474db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:23.684636 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db0b6b-7236-4dbc-918a-7a3f0f474db0 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:23.685344 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db0b6b-7236-4dbc-918a-7a3f0f474db0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:23.693738 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db0b6b-7236-4dbc-918a-7a3f0f474db0 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:23.715603 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6825f-f48b-4a95-8eb5-4a7237908f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:23.721601 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6825f-f48b-4a95-8eb5-4a7237908f93 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:23.722024 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6825f-f48b-4a95-8eb5-4a7237908f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:23.722520 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6825f-f48b-4a95-8eb5-4a7237908f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:23.723371 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6825f-f48b-4a95-8eb5-4a7237908f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:23.729343 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6825f-f48b-4a95-8eb5-4a7237908f93 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:23.746847 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 930/1859] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:34:23 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:23.748611 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db0b6b-7236-4dbc-918a-7a3f0f474db0 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:23.755619 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 930/1860] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:23.756576 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6825f-f48b-4a95-8eb5-4a7237908f93 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:23.775826 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db0b6b-7236-4dbc-918a-7a3f0f474db0 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:23.782002 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6825f-f48b-4a95-8eb5-4a7237908f93 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:23.790931 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659dab7b-b064-43d4-9f90-405c3d918cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:23.791634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659dab7b-b064-43d4-9f90-405c3d918cec admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:23.792945 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659dab7b-b064-43d4-9f90-405c3d918cec admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:23.793243 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659dab7b-b064-43d4-9f90-405c3d918cec admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:23.794059 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659dab7b-b064-43d4-9f90-405c3d918cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:23.795694 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659dab7b-b064-43d4-9f90-405c3d918cec admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:23.799196 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bd2ca-d15f-4ce9-80d7-a9325b3d6596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:23.799904 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bd2ca-d15f-4ce9-80d7-a9325b3d6596 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:23.805877 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bd2ca-d15f-4ce9-80d7-a9325b3d6596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:23.806313 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bd2ca-d15f-4ce9-80d7-a9325b3d6596 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:23.807085 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8bd2ca-d15f-4ce9-80d7-a9325b3d6596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:23.810718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 931/1861] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:23.812060 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659dab7b-b064-43d4-9f90-405c3d918cec admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:23.813002 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8bd2ca-d15f-4ce9-80d7-a9325b3d6596 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:23.823778 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659dab7b-b064-43d4-9f90-405c3d918cec admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:23.829121 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730f3a3-a19e-4ae9-9b1c-9da3e8dd6786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:23.829817 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730f3a3-a19e-4ae9-9b1c-9da3e8dd6786 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:23.830156 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730f3a3-a19e-4ae9-9b1c-9da3e8dd6786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:23.830438 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730f3a3-a19e-4ae9-9b1c-9da3e8dd6786 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:23.831173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730f3a3-a19e-4ae9-9b1c-9da3e8dd6786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:23.833231 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730f3a3-a19e-4ae9-9b1c-9da3e8dd6786 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:23.841117 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 931/1862] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:23.841530 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bd2ca-d15f-4ce9-80d7-a9325b3d6596 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:23.848414 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 932/1863] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:23.849313 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730f3a3-a19e-4ae9-9b1c-9da3e8dd6786 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:23.858897 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bd2ca-d15f-4ce9-80d7-a9325b3d6596 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:23.861559 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730f3a3-a19e-4ae9-9b1c-9da3e8dd6786 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:23.870089 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2274fe4-0bae-4ba4-a6ac-73c8053eb3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:23.872708 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2274fe4-0bae-4ba4-a6ac-73c8053eb3d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:23.873552 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da360083-d401-44e7-ad87-3af4b0a525cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:23.874048 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2274fe4-0bae-4ba4-a6ac-73c8053eb3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:23.875094 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da360083-d401-44e7-ad87-3af4b0a525cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:23.875878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2274fe4-0bae-4ba4-a6ac-73c8053eb3d4 admin admin] PATH_INFO: `/v3/projects/ee38dd0269464eba8d383fbe8731346e/users/12bc70de878349adb976d5933820e02a/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:23.877242 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da360083-d401-44e7-ad87-3af4b0a525cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:23.878065 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da360083-d401-44e7-ad87-3af4b0a525cd admin admin] PATH_INFO: `/v3/projects/67fa67430dbd439898a7d11cb6924039/users/dfb718a7926142de8d89dfce747ec357/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:23.886695 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da360083-d401-44e7-ad87-3af4b0a525cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=67fa67430dbd439898a7d11cb6924039, user_id=dfb718a7926142de8d89dfce747ec357, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:23.889759 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da360083-d401-44e7-ad87-3af4b0a525cd admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:23.911557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2274fe4-0bae-4ba4-a6ac-73c8053eb3d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee38dd0269464eba8d383fbe8731346e, user_id=12bc70de878349adb976d5933820e02a, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:23.920817 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 932/1864] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:23 2022] PUT /identity/v3/projects/67fa67430dbd439898a7d11cb6924039/users/dfb718a7926142de8d89dfce747ec357/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:23.926270 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2274fe4-0bae-4ba4-a6ac-73c8053eb3d4 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:23.935229 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da360083-d401-44e7-ad87-3af4b0a525cd admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:23.967354 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 933/1865] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:23 2022] PUT /identity/v3/projects/ee38dd0269464eba8d383fbe8731346e/users/12bc70de878349adb976d5933820e02a/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:23.968682 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98150b-644e-4868-a4ee-31ff8831430f None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:23.968970 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98150b-644e-4868-a4ee-31ff8831430f None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:23.969242 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98150b-644e-4868-a4ee-31ff8831430f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:24.030052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-7d98150b-644e-4868-a4ee-31ff8831430f None None] MFA Rules not processed for user `dfb718a7926142de8d89dfce747ec357`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:24.031924 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-7d98150b-644e-4868-a4ee-31ff8831430f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:24.074919 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da360083-d401-44e7-ad87-3af4b0a525cd admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:24.173147 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 934/1866] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:24.174737 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98150b-644e-4868-a4ee-31ff8831430f None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:24.196782 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669a787-2d45-4d57-b5de-63b47ea37e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:24.197738 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669a787-2d45-4d57-b5de-63b47ea37e47 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:24.198047 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669a787-2d45-4d57-b5de-63b47ea37e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:24.198325 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669a787-2d45-4d57-b5de-63b47ea37e47 admin admin] PATH_INFO: `/v3/projects/83c0bb756998486880519e3e3234921a/users/5b023a9f681340acb99a6367843a095f/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:24.229162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f669a787-2d45-4d57-b5de-63b47ea37e47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83c0bb756998486880519e3e3234921a, user_id=5b023a9f681340acb99a6367843a095f, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:24.232374 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f669a787-2d45-4d57-b5de-63b47ea37e47 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:24.265860 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 933/1867] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:23 2022] PUT /identity/v3/projects/83c0bb756998486880519e3e3234921a/users/5b023a9f681340acb99a6367843a095f/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:24.266883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669a787-2d45-4d57-b5de-63b47ea37e47 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:24.277521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-f669a787-2d45-4d57-b5de-63b47ea37e47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:24.306622 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98150b-644e-4868-a4ee-31ff8831430f None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:24.407199 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669a787-2d45-4d57-b5de-63b47ea37e47 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:24.418685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95847e3-5898-4c38-80b6-94f0e808b767 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:24.419356 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95847e3-5898-4c38-80b6-94f0e808b767 service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:24.419641 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95847e3-5898-4c38-80b6-94f0e808b767 service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:24.419915 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95847e3-5898-4c38-80b6-94f0e808b767 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:24.436286 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd58a4d-7c41-4024-bb5e-572819a7f133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:24.437141 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd58a4d-7c41-4024-bb5e-572819a7f133 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:24.437491 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd58a4d-7c41-4024-bb5e-572819a7f133 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:24.437871 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd58a4d-7c41-4024-bb5e-572819a7f133 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:24.438702 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd58a4d-7c41-4024-bb5e-572819a7f133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:24.440372 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd58a4d-7c41-4024-bb5e-572819a7f133 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:24.472157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 935/1868] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:24.474105 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb143b5f-4de1-48b5-9e3e-a4b6d18bb1a6 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:24.479325 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb143b5f-4de1-48b5-9e3e-a4b6d18bb1a6 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:24.479722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb143b5f-4de1-48b5-9e3e-a4b6d18bb1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:24.541725 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-bb143b5f-4de1-48b5-9e3e-a4b6d18bb1a6 None None] MFA Rules not processed for user `5b023a9f681340acb99a6367843a095f`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:24.545261 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-bb143b5f-4de1-48b5-9e3e-a4b6d18bb1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:24.603083 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95847e3-5898-4c38-80b6-94f0e808b767 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:24.603083 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95847e3-5898-4c38-80b6-94f0e808b767 service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:24.642018 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 934/1869] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:24.643881 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95847e3-5898-4c38-80b6-94f0e808b767 service cinder] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:24.684583 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95847e3-5898-4c38-80b6-94f0e808b767 service cinder] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:24.691686 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934b723-4c83-42e5-ad10-3e4f696326fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:24.692997 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934b723-4c83-42e5-ad10-3e4f696326fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:24.693283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934b723-4c83-42e5-ad10-3e4f696326fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:24.693647 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934b723-4c83-42e5-ad10-3e4f696326fe admin admin] PATH_INFO: `/v3/projects/ee38dd0269464eba8d383fbe8731346e/users/12bc70de878349adb976d5933820e02a/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:24.696472 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934b723-4c83-42e5-ad10-3e4f696326fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee38dd0269464eba8d383fbe8731346e, user_id=12bc70de878349adb976d5933820e02a, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:24.700657 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934b723-4c83-42e5-ad10-3e4f696326fe admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:24.715935 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 935/1870] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:24 2022] PUT /identity/v3/projects/ee38dd0269464eba8d383fbe8731346e/users/12bc70de878349adb976d5933820e02a/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:24.717998 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34becc18-67ad-4c1b-9052-e0c5c0b8c0ba None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:24.718286 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34becc18-67ad-4c1b-9052-e0c5c0b8c0ba None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:24.718564 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34becc18-67ad-4c1b-9052-e0c5c0b8c0ba None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:24.719874 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 936/1871] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 12 09:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:34:24.720595 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34becc18-67ad-4c1b-9052-e0c5c0b8c0ba None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:24.751523 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 936/1872] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:24.753087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e891feb-08db-4c3e-a7a8-9256d5c7dd0b None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:24.753383 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e891feb-08db-4c3e-a7a8-9256d5c7dd0b None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:24.754360 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e891feb-08db-4c3e-a7a8-9256d5c7dd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:24.814278 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-4e891feb-08db-4c3e-a7a8-9256d5c7dd0b None None] MFA Rules not processed for user `12bc70de878349adb976d5933820e02a`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:24.816528 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-4e891feb-08db-4c3e-a7a8-9256d5c7dd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:24.877046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34becc18-67ad-4c1b-9052-e0c5c0b8c0ba None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:24.885489 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e02d0-c897-4af7-aae6-60e896939385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:24.886422 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e02d0-c897-4af7-aae6-60e896939385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:24.886706 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e02d0-c897-4af7-aae6-60e896939385 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:24.886981 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e02d0-c897-4af7-aae6-60e896939385 admin admin] PATH_INFO: `/v3/users/7370cfdfaa86471fa55426ed35550279` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:24.888239 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e02d0-c897-4af7-aae6-60e896939385 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7370cfdfaa86471fa55426ed35550279)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:24.890446 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e02d0-c897-4af7-aae6-60e896939385 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:24.923641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 937/1873] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:24 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:24.925001 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e891feb-08db-4c3e-a7a8-9256d5c7dd0b None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:24.969600 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-6b4e02d0-c897-4af7-aae6-60e896939385 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7370cfdfaa86471fa55426ed35550279'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:24.997320 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-6b4e02d0-c897-4af7-aae6-60e896939385 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7370cfdfaa86471fa55426ed35550279'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:25.000789 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-6b4e02d0-c897-4af7-aae6-60e896939385 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7370cfdfaa86471fa55426ed35550279'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:25.013823 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e891feb-08db-4c3e-a7a8-9256d5c7dd0b None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:25.019663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c92021-0ce7-4799-8ecf-7d5381340d41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:25.019848 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-6b4e02d0-c897-4af7-aae6-60e896939385 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7370cfdfaa86471fa55426ed35550279'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:25.020792 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c92021-0ce7-4799-8ecf-7d5381340d41 service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:25.021454 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c92021-0ce7-4799-8ecf-7d5381340d41 service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:25.022354 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c92021-0ce7-4799-8ecf-7d5381340d41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:25.033473 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-6b4e02d0-c897-4af7-aae6-60e896939385 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7370cfdfaa86471fa55426ed35550279'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:25.059731 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 937/1874] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:34:24 2022] DELETE /identity/v3/users/7370cfdfaa86471fa55426ed35550279 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:25.060865 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc762c4f-5b3e-4746-9f77-1bcdaa30455d None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:25.061204 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc762c4f-5b3e-4746-9f77-1bcdaa30455d None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:25.061419 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc762c4f-5b3e-4746-9f77-1bcdaa30455d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:25.098130 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-cc762c4f-5b3e-4746-9f77-1bcdaa30455d None None] MFA Rules not processed for user `2915babd40aa42e8bf7cc85c5a97daa6`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:25.100155 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-cc762c4f-5b3e-4746-9f77-1bcdaa30455d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:25.145843 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c92021-0ce7-4799-8ecf-7d5381340d41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:25.147301 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c92021-0ce7-4799-8ecf-7d5381340d41 service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:25.161826 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 938/1875] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:25.162697 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c92021-0ce7-4799-8ecf-7d5381340d41 service cinder] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:25.164643 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-26c92021-0ce7-4799-8ecf-7d5381340d41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:25.176438 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c92021-0ce7-4799-8ecf-7d5381340d41 service cinder] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:25.217625 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 938/1876] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 12 09:34:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:25.219626 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf0b64-173b-47f6-b8a0-e2a7ff9f8a7d None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:25.220098 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf0b64-173b-47f6-b8a0-e2a7ff9f8a7d None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:25.220383 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf0b64-173b-47f6-b8a0-e2a7ff9f8a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:25.251594 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8417cc-3b61-48ca-af00-e8c7cffbfdcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:25.252287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8417cc-3b61-48ca-af00-e8c7cffbfdcc service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:25.252839 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8417cc-3b61-48ca-af00-e8c7cffbfdcc service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:25.253246 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8417cc-3b61-48ca-af00-e8c7cffbfdcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:25.255279 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-9b8417cc-3b61-48ca-af00-e8c7cffbfdcc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:25.260782 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-30bf0b64-173b-47f6-b8a0-e2a7ff9f8a7d None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:25.262044 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-30bf0b64-173b-47f6-b8a0-e2a7ff9f8a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:25.365521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 939/1877] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:25.367223 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf0b64-173b-47f6-b8a0-e2a7ff9f8a7d None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:25.367363 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8417cc-3b61-48ca-af00-e8c7cffbfdcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:25.369100 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-30bf0b64-173b-47f6-b8a0-e2a7ff9f8a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:25.369648 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8417cc-3b61-48ca-af00-e8c7cffbfdcc service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:25.384812 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf0b64-173b-47f6-b8a0-e2a7ff9f8a7d None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:25.391588 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c44959-8bd5-4e51-a92d-4e26c35aa4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:25.392822 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c44959-8bd5-4e51-a92d-4e26c35aa4ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:25.393316 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c44959-8bd5-4e51-a92d-4e26c35aa4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:25.393775 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c44959-8bd5-4e51-a92d-4e26c35aa4ed admin admin] PATH_INFO: `/v3/users/5b023a9f681340acb99a6367843a095f` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:25.394652 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 939/1878] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:25.395753 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c44959-8bd5-4e51-a92d-4e26c35aa4ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b023a9f681340acb99a6367843a095f)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:25.398298 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c44959-8bd5-4e51-a92d-4e26c35aa4ed admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:25.407981 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8417cc-3b61-48ca-af00-e8c7cffbfdcc service cinder] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:25.417768 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-9b8417cc-3b61-48ca-af00-e8c7cffbfdcc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:25.476329 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8417cc-3b61-48ca-af00-e8c7cffbfdcc service cinder] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:25.489875 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-69c44959-8bd5-4e51-a92d-4e26c35aa4ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b023a9f681340acb99a6367843a095f'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:25.495908 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079b475-ecc2-4b5d-ad0c-2592a6f811dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:25.496593 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079b475-ecc2-4b5d-ad0c-2592a6f811dd service nova] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:25.496876 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079b475-ecc2-4b5d-ad0c-2592a6f811dd service nova] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:25.497155 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079b475-ecc2-4b5d-ad0c-2592a6f811dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:25.514559 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079b475-ecc2-4b5d-ad0c-2592a6f811dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:25.516505 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079b475-ecc2-4b5d-ad0c-2592a6f811dd service nova] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:25.525716 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-69c44959-8bd5-4e51-a92d-4e26c35aa4ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b023a9f681340acb99a6367843a095f'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:25.526666 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-69c44959-8bd5-4e51-a92d-4e26c35aa4ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b023a9f681340acb99a6367843a095f'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:25.552702 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-69c44959-8bd5-4e51-a92d-4e26c35aa4ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b023a9f681340acb99a6367843a095f'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:25.563109 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-69c44959-8bd5-4e51-a92d-4e26c35aa4ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b023a9f681340acb99a6367843a095f'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:25.566225 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 940/1879] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:25.571393 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079b475-ecc2-4b5d-ad0c-2592a6f811dd service nova] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:25.573321 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 940/1880] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:34:25 2022] DELETE /identity/v3/users/5b023a9f681340acb99a6367843a095f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:25.574311 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-b079b475-ecc2-4b5d-ad0c-2592a6f811dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:25.574609 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ef45f-6d87-4603-b7e8-284a0abe9fe6 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:25.574909 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ef45f-6d87-4603-b7e8-284a0abe9fe6 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:25.575190 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ef45f-6d87-4603-b7e8-284a0abe9fe6 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:25.577245 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 941/1881] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 12 09:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:34:25.578644 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef07d5-ab90-4bc5-8bb7-32d8d9b3a230 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:25.578889 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef07d5-ab90-4bc5-8bb7-32d8d9b3a230 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:25.579136 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef07d5-ab90-4bc5-8bb7-32d8d9b3a230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:25.599607 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-59ef07d5-ab90-4bc5-8bb7-32d8d9b3a230 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:25.601573 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-59ef07d5-ab90-4bc5-8bb7-32d8d9b3a230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:25.677192 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 942/1882] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:25.677192 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba46053-67bf-4e5f-b0b2-c8e2dd2b58ee None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:25.677192 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba46053-67bf-4e5f-b0b2-c8e2dd2b58ee None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:25.677192 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba46053-67bf-4e5f-b0b2-c8e2dd2b58ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:25.718185 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079b475-ecc2-4b5d-ad0c-2592a6f811dd service nova] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:25.729371 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-fba46053-67bf-4e5f-b0b2-c8e2dd2b58ee None None] MFA Rules not processed for user `2915babd40aa42e8bf7cc85c5a97daa6`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:25.732556 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-fba46053-67bf-4e5f-b0b2-c8e2dd2b58ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:25.825085 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf3262-2206-4bc0-aca5-fecfd4f5a1f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:25.826407 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf3262-2206-4bc0-aca5-fecfd4f5a1f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:25.826740 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf3262-2206-4bc0-aca5-fecfd4f5a1f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:25.827348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf3262-2206-4bc0-aca5-fecfd4f5a1f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:25.830340 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-44cf3262-2206-4bc0-aca5-fecfd4f5a1f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:25.836746 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 943/1883] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 12 09:34:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:25.837787 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba46053-67bf-4e5f-b0b2-c8e2dd2b58ee None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:25.846510 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf3262-2206-4bc0-aca5-fecfd4f5a1f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:25.848381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf3262-2206-4bc0-aca5-fecfd4f5a1f4 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:25.857943 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-fba46053-67bf-4e5f-b0b2-c8e2dd2b58ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:25.864213 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 941/1884] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:25.865623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf3262-2206-4bc0-aca5-fecfd4f5a1f4 service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:25.867879 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-44cf3262-2206-4bc0-aca5-fecfd4f5a1f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:25.882374 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba46053-67bf-4e5f-b0b2-c8e2dd2b58ee None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:25.891476 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a42a6-1821-4aef-82ea-c8566ba3c33a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:25.894658 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a42a6-1821-4aef-82ea-c8566ba3c33a service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:25.895032 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a42a6-1821-4aef-82ea-c8566ba3c33a service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:25.895368 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a42a6-1821-4aef-82ea-c8566ba3c33a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:25.912406 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a42a6-1821-4aef-82ea-c8566ba3c33a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:25.914760 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a42a6-1821-4aef-82ea-c8566ba3c33a service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:25.920154 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf3262-2206-4bc0-aca5-fecfd4f5a1f4 service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:25.927994 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a28bec-0a15-4565-9f47-d853dd8b4110 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:25.928886 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a28bec-0a15-4565-9f47-d853dd8b4110 service nova] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:25.929277 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a28bec-0a15-4565-9f47-d853dd8b4110 service nova] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:25.930074 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a28bec-0a15-4565-9f47-d853dd8b4110 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:25.941940 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a28bec-0a15-4565-9f47-d853dd8b4110 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:25.943812 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a28bec-0a15-4565-9f47-d853dd8b4110 service nova] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:25.962838 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 942/1885] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:25.979037 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 944/1886] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:26.705934 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a28bec-0a15-4565-9f47-d853dd8b4110 service nova] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:26.707368 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-37a28bec-0a15-4565-9f47-d853dd8b4110 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:26.722832 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a28bec-0a15-4565-9f47-d853dd8b4110 service nova] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:26.730927 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d04c6e-2251-456c-b38a-ec263a279c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:26.732450 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d04c6e-2251-456c-b38a-ec263a279c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:26.747576 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d04c6e-2251-456c-b38a-ec263a279c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:26.749376 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d04c6e-2251-456c-b38a-ec263a279c3b admin admin] PATH_INFO: `/v3/projects/f01ce275bfeb443da44fb59d360b60df` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:26.751876 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d04c6e-2251-456c-b38a-ec263a279c3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f01ce275bfeb443da44fb59d360b60df)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:26.755464 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d04c6e-2251-456c-b38a-ec263a279c3b admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:26.806186 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-88d04c6e-2251-456c-b38a-ec263a279c3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f01ce275bfeb443da44fb59d360b60df', 'request_id': 'req-88d04c6e-2251-456c-b38a-ec263a279c3b'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:26.818760 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-88d04c6e-2251-456c-b38a-ec263a279c3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f01ce275bfeb443da44fb59d360b60df', 'request_id': 'req-88d04c6e-2251-456c-b38a-ec263a279c3b'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:26.826379 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-88d04c6e-2251-456c-b38a-ec263a279c3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f01ce275bfeb443da44fb59d360b60df', 'request_id': 'req-88d04c6e-2251-456c-b38a-ec263a279c3b'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:26.836110 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a42a6-1821-4aef-82ea-c8566ba3c33a service neutron] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:26.837925 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-852a42a6-1821-4aef-82ea-c8566ba3c33a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:26.840899 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-88d04c6e-2251-456c-b38a-ec263a279c3b admin admin] The token cache is being invalidate because project f01ce275bfeb443da44fb59d360b60df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:34:26.841956 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-88d04c6e-2251-456c-b38a-ec263a279c3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:26.843031 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-88d04c6e-2251-456c-b38a-ec263a279c3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:26.845966 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 943/1887] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:34:26 2022] DELETE /identity/v3/projects/f01ce275bfeb443da44fb59d360b60df => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:26.848646 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d04c6e-2251-456c-b38a-ec263a279c3b admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:26.850185 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-88d04c6e-2251-456c-b38a-ec263a279c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:26.852059 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a42a6-1821-4aef-82ea-c8566ba3c33a service neutron] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:26.908528 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255da4d-7ab2-47a3-ac26-b273d3b9559c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:26.909417 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255da4d-7ab2-47a3-ac26-b273d3b9559c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:26.909687 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255da4d-7ab2-47a3-ac26-b273d3b9559c admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:26.909990 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255da4d-7ab2-47a3-ac26-b273d3b9559c admin admin] PATH_INFO: `/v3/projects/83c0bb756998486880519e3e3234921a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:26.911200 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255da4d-7ab2-47a3-ac26-b273d3b9559c admin admin] RBAC: Authorizing `identity:delete_project(project_id=83c0bb756998486880519e3e3234921a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:26.913671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255da4d-7ab2-47a3-ac26-b273d3b9559c admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:26.918179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d04c6e-2251-456c-b38a-ec263a279c3b admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:26.922895 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50284b-b26b-48ed-9354-50f8557371b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:26.923776 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50284b-b26b-48ed-9354-50f8557371b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:26.924179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50284b-b26b-48ed-9354-50f8557371b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:26.924465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50284b-b26b-48ed-9354-50f8557371b6 admin admin] PATH_INFO: `/v3/users/dfb718a7926142de8d89dfce747ec357` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:26.925671 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50284b-b26b-48ed-9354-50f8557371b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfb718a7926142de8d89dfce747ec357)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:26.927617 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50284b-b26b-48ed-9354-50f8557371b6 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:26.963530 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-9255da4d-7ab2-47a3-ac26-b273d3b9559c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83c0bb756998486880519e3e3234921a', 'request_id': 'req-9255da4d-7ab2-47a3-ac26-b273d3b9559c'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:26.968646 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-9255da4d-7ab2-47a3-ac26-b273d3b9559c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83c0bb756998486880519e3e3234921a', 'request_id': 'req-9255da4d-7ab2-47a3-ac26-b273d3b9559c'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:26.973327 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-8d50284b-b26b-48ed-9354-50f8557371b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfb718a7926142de8d89dfce747ec357'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:26.976481 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-9255da4d-7ab2-47a3-ac26-b273d3b9559c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83c0bb756998486880519e3e3234921a', 'request_id': 'req-9255da4d-7ab2-47a3-ac26-b273d3b9559c'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:26.985892 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-8d50284b-b26b-48ed-9354-50f8557371b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfb718a7926142de8d89dfce747ec357'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:26.986589 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-8d50284b-b26b-48ed-9354-50f8557371b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfb718a7926142de8d89dfce747ec357'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:26.987404 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-9255da4d-7ab2-47a3-ac26-b273d3b9559c admin admin] The token cache is being invalidate because project 83c0bb756998486880519e3e3234921a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:34:26.987689 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-9255da4d-7ab2-47a3-ac26-b273d3b9559c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:26.988392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-9255da4d-7ab2-47a3-ac26-b273d3b9559c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:26.990025 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 945/1888] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:34:26 2022] DELETE /identity/v3/projects/83c0bb756998486880519e3e3234921a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:26.994587 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-8d50284b-b26b-48ed-9354-50f8557371b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfb718a7926142de8d89dfce747ec357'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:26.996962 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928d11b-bf4f-422b-8a78-3a00170dbee7 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:26.997247 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928d11b-bf4f-422b-8a78-3a00170dbee7 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:26.997522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928d11b-bf4f-422b-8a78-3a00170dbee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:27.002114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-8d50284b-b26b-48ed-9354-50f8557371b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfb718a7926142de8d89dfce747ec357'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:27.008356 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 944/1889] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:34:26 2022] DELETE /identity/v3/users/dfb718a7926142de8d89dfce747ec357 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:34:27.016835 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-9928d11b-bf4f-422b-8a78-3a00170dbee7 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:27.018079 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-9928d11b-bf4f-422b-8a78-3a00170dbee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:27.089975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf5a1f-219f-4137-bb69-9f17fa1d3607 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:27.090275 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf5a1f-219f-4137-bb69-9f17fa1d3607 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:27.090555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf5a1f-219f-4137-bb69-9f17fa1d3607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:27.091519 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 946/1890] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:34:27.112177 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-30bf5a1f-219f-4137-bb69-9f17fa1d3607 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:27.113443 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-30bf5a1f-219f-4137-bb69-9f17fa1d3607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:27.123229 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 945/1891] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:34:27.127493 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928d11b-bf4f-422b-8a78-3a00170dbee7 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:27.141092 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928d11b-bf4f-422b-8a78-3a00170dbee7 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:27.147319 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ac8d4-647f-45d0-b65b-a1ba232f9f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:27.148790 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ac8d4-647f-45d0-b65b-a1ba232f9f0c admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:27.149257 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ac8d4-647f-45d0-b65b-a1ba232f9f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:27.149712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ac8d4-647f-45d0-b65b-a1ba232f9f0c admin admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:27.150691 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ac8d4-647f-45d0-b65b-a1ba232f9f0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:34:27.151182 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ac8d4-647f-45d0-b65b-a1ba232f9f0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:27.153632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ac8d4-647f-45d0-b65b-a1ba232f9f0c admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:27.171802 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 947/1892] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:34:27.178241 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf5a1f-219f-4137-bb69-9f17fa1d3607 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:27.187860 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf5a1f-219f-4137-bb69-9f17fa1d3607 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:27.193060 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bef45-b91c-45a5-8637-654edebec01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:27.193724 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bef45-b91c-45a5-8637-654edebec01c admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:27.194053 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bef45-b91c-45a5-8637-654edebec01c admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:27.194388 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bef45-b91c-45a5-8637-654edebec01c admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:27.196191 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28bef45-b91c-45a5-8637-654edebec01c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:27.197050 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28bef45-b91c-45a5-8637-654edebec01c admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:27.232335 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 946/1893] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:34:27 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:34:27.233336 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ac8d4-647f-45d0-b65b-a1ba232f9f0c admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:27.246144 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ac8d4-647f-45d0-b65b-a1ba232f9f0c admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:27.310984 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bef45-b91c-45a5-8637-654edebec01c admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:27.311341 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0268f-eeee-40e2-8159-47fc81eb0b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:27.312027 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0268f-eeee-40e2-8159-47fc81eb0b28 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:27.312307 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0268f-eeee-40e2-8159-47fc81eb0b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:27.312583 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0268f-eeee-40e2-8159-47fc81eb0b28 admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:27.313401 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0268f-eeee-40e2-8159-47fc81eb0b28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:27.315393 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0268f-eeee-40e2-8159-47fc81eb0b28 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:27.317522 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-c28bef45-b91c-45a5-8637-654edebec01c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:27.341766 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 948/1894] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:34:27 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:27.344259 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0268f-eeee-40e2-8159-47fc81eb0b28 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:27.347300 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bef45-b91c-45a5-8637-654edebec01c admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:27.353248 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6261458-7784-4d39-b6e6-dd4ceeafb039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:27.354157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6261458-7784-4d39-b6e6-dd4ceeafb039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:27.354328 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0268f-eeee-40e2-8159-47fc81eb0b28 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:27.354434 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6261458-7784-4d39-b6e6-dd4ceeafb039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:27.354750 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6261458-7784-4d39-b6e6-dd4ceeafb039 admin admin] PATH_INFO: `/v3/projects/67fa67430dbd439898a7d11cb6924039` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:27.355999 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6261458-7784-4d39-b6e6-dd4ceeafb039 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67fa67430dbd439898a7d11cb6924039)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:27.358285 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6261458-7784-4d39-b6e6-dd4ceeafb039 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:27.359659 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9385f3a-ba58-4343-96fa-feec3a7b573c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:27.360441 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9385f3a-ba58-4343-96fa-feec3a7b573c admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:27.360749 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9385f3a-ba58-4343-96fa-feec3a7b573c admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:27.362370 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9385f3a-ba58-4343-96fa-feec3a7b573c admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:27.363346 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9385f3a-ba58-4343-96fa-feec3a7b573c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:27.365186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9385f3a-ba58-4343-96fa-feec3a7b573c admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:27.380292 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 949/1895] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:27.381188 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9385f3a-ba58-4343-96fa-feec3a7b573c admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:27.392561 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9385f3a-ba58-4343-96fa-feec3a7b573c admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:27.402046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ae7fe-ae20-414c-b30d-6055cd9ac707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:27.402727 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ae7fe-ae20-414c-b30d-6055cd9ac707 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:27.403043 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ae7fe-ae20-414c-b30d-6055cd9ac707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:27.403322 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ae7fe-ae20-414c-b30d-6055cd9ac707 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:27.404087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ae7fe-ae20-414c-b30d-6055cd9ac707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:27.405659 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ae7fe-ae20-414c-b30d-6055cd9ac707 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:27.418758 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e6261458-7784-4d39-b6e6-dd4ceeafb039 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67fa67430dbd439898a7d11cb6924039', 'request_id': 'req-e6261458-7784-4d39-b6e6-dd4ceeafb039'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:27.421182 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 950/1896] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:27.422116 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ae7fe-ae20-414c-b30d-6055cd9ac707 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:27.427711 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e6261458-7784-4d39-b6e6-dd4ceeafb039 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67fa67430dbd439898a7d11cb6924039', 'request_id': 'req-e6261458-7784-4d39-b6e6-dd4ceeafb039'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:27.439401 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e6261458-7784-4d39-b6e6-dd4ceeafb039 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67fa67430dbd439898a7d11cb6924039', 'request_id': 'req-e6261458-7784-4d39-b6e6-dd4ceeafb039'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:27.443034 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ae7fe-ae20-414c-b30d-6055cd9ac707 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:27.454297 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e6261458-7784-4d39-b6e6-dd4ceeafb039 admin admin] The token cache is being invalidate because project 67fa67430dbd439898a7d11cb6924039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:34:27.454589 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e6261458-7784-4d39-b6e6-dd4ceeafb039 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:27.455679 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e6261458-7784-4d39-b6e6-dd4ceeafb039 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:27.458565 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 947/1897] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:34:27 2022] DELETE /identity/v3/projects/67fa67430dbd439898a7d11cb6924039 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:27.463617 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf56df-cc22-4928-b8d6-60efa4a44c8d None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:27.463874 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf56df-cc22-4928-b8d6-60efa4a44c8d None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:27.464288 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf56df-cc22-4928-b8d6-60efa4a44c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:27.486709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-c8cf56df-cc22-4928-b8d6-60efa4a44c8d None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:27.488983 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-c8cf56df-cc22-4928-b8d6-60efa4a44c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:27.556599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fecca-abad-4a16-946d-eeb764c3874b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:27.557503 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fecca-abad-4a16-946d-eeb764c3874b admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:27.557787 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fecca-abad-4a16-946d-eeb764c3874b admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:27.558111 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fecca-abad-4a16-946d-eeb764c3874b admin admin] PATH_INFO: `/v3/projects/59546c2ca0074bb5b77b7c5e64d9c068/users/7dd6d3e1b6ea49d4a75e5f7e105ea0f0/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:27.567806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 948/1898] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:27.575660 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39fecca-abad-4a16-946d-eeb764c3874b admin admin] RBAC: Authorizing `identity:create_grant(project_id=59546c2ca0074bb5b77b7c5e64d9c068, user_id=7dd6d3e1b6ea49d4a75e5f7e105ea0f0, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:27.575833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a005e-e635-407c-b856-e0ede143c01f None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:27.576133 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a005e-e635-407c-b856-e0ede143c01f None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:27.576539 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a005e-e635-407c-b856-e0ede143c01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:27.578678 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39fecca-abad-4a16-946d-eeb764c3874b admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:27.592554 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 951/1899] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:27 2022] PUT /identity/v3/projects/59546c2ca0074bb5b77b7c5e64d9c068/users/7dd6d3e1b6ea49d4a75e5f7e105ea0f0/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:27.597640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-ba5a005e-e635-407c-b856-e0ede143c01f None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:27.598476 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf48230-e969-473b-bf4d-b72832b84ffe None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:27.598990 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf48230-e969-473b-bf4d-b72832b84ffe None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:27.599106 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-ba5a005e-e635-407c-b856-e0ede143c01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:27.599537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf48230-e969-473b-bf4d-b72832b84ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:27.622647 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-ebf48230-e969-473b-bf4d-b72832b84ffe None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:27.624483 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-ebf48230-e969-473b-bf4d-b72832b84ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:27.674290 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 949/1900] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:34:27.677558 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a005e-e635-407c-b856-e0ede143c01f None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:27.689222 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a005e-e635-407c-b856-e0ede143c01f None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:27.697538 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec74b67-a9f6-4ff6-ba39-04b06ad5d90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:27.698585 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec74b67-a9f6-4ff6-ba39-04b06ad5d90b admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:27.699118 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec74b67-a9f6-4ff6-ba39-04b06ad5d90b admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:27.699565 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec74b67-a9f6-4ff6-ba39-04b06ad5d90b admin admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:27.700410 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec74b67-a9f6-4ff6-ba39-04b06ad5d90b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:34:27.700678 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec74b67-a9f6-4ff6-ba39-04b06ad5d90b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:27.702353 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec74b67-a9f6-4ff6-ba39-04b06ad5d90b admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:27.709835 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 952/1901] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:27.719632 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 950/1902] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:34:27.720854 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf48230-e969-473b-bf4d-b72832b84ffe None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:27.723943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec74b67-a9f6-4ff6-ba39-04b06ad5d90b admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:27.727105 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-ebf48230-e969-473b-bf4d-b72832b84ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:27.741254 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec74b67-a9f6-4ff6-ba39-04b06ad5d90b admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:27.747894 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa44356-2a04-4d2d-9fc7-14b3bf4b80f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:27.749168 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa44356-2a04-4d2d-9fc7-14b3bf4b80f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:27.750032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa44356-2a04-4d2d-9fc7-14b3bf4b80f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:27.752377 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa44356-2a04-4d2d-9fc7-14b3bf4b80f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:27.753102 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa44356-2a04-4d2d-9fc7-14b3bf4b80f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:27.755370 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa44356-2a04-4d2d-9fc7-14b3bf4b80f0 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:27.784382 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 951/1903] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:34:27 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:27.789030 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa44356-2a04-4d2d-9fc7-14b3bf4b80f0 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:27.789601 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf48230-e969-473b-bf4d-b72832b84ffe None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:27.847416 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b630e92-8f2f-4aee-8501-f4db4b0ba4db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:27.849105 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b630e92-8f2f-4aee-8501-f4db4b0ba4db service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:27.849390 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b630e92-8f2f-4aee-8501-f4db4b0ba4db service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:27.849673 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b630e92-8f2f-4aee-8501-f4db4b0ba4db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:27.860244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa44356-2a04-4d2d-9fc7-14b3bf4b80f0 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:27.860788 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b630e92-8f2f-4aee-8501-f4db4b0ba4db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:27.862159 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b630e92-8f2f-4aee-8501-f4db4b0ba4db service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:27.865580 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a0455-6429-4004-8629-034485672bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:27.866960 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a0455-6429-4004-8629-034485672bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:27.867431 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a0455-6429-4004-8629-034485672bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:27.867708 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a0455-6429-4004-8629-034485672bc8 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:27.868559 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a0455-6429-4004-8629-034485672bc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:27.870990 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a0455-6429-4004-8629-034485672bc8 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:27.879148 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 953/1904] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:27.898355 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 952/1905] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:34:27 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:27.898938 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b630e92-8f2f-4aee-8501-f4db4b0ba4db service neutron] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:27.910022 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b630e92-8f2f-4aee-8501-f4db4b0ba4db service neutron] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:27.915589 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead686fb-ba9a-4e63-8a28-401388990280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:27.916331 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead686fb-ba9a-4e63-8a28-401388990280 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:27.916684 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead686fb-ba9a-4e63-8a28-401388990280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:27.917030 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead686fb-ba9a-4e63-8a28-401388990280 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:27.917831 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead686fb-ba9a-4e63-8a28-401388990280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:27.919669 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead686fb-ba9a-4e63-8a28-401388990280 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:27.930624 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 954/1906] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 09:34:27.934523 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a0455-6429-4004-8629-034485672bc8 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:27.945219 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a0455-6429-4004-8629-034485672bc8 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:27.950557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea2370-3f97-4bc9-a64c-9bfe7c2de034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:27.951245 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea2370-3f97-4bc9-a64c-9bfe7c2de034 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:27.951544 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea2370-3f97-4bc9-a64c-9bfe7c2de034 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:27.951810 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea2370-3f97-4bc9-a64c-9bfe7c2de034 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:27.952542 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea2370-3f97-4bc9-a64c-9bfe7c2de034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:27.954359 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea2370-3f97-4bc9-a64c-9bfe7c2de034 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:27.970878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 953/1907] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:27.982120 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead686fb-ba9a-4e63-8a28-401388990280 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:27.987176 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead686fb-ba9a-4e63-8a28-401388990280 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:27.992098 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0210b3-e607-4adb-bb49-76c20babd7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:27.993265 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0210b3-e607-4adb-bb49-76c20babd7c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:27.993552 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0210b3-e607-4adb-bb49-76c20babd7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:27.993878 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0210b3-e607-4adb-bb49-76c20babd7c1 admin admin] PATH_INFO: `/v3/projects/155ecd4ebf26498886794f21e24506de/users/188d908ef11e42b4a558553678e97f9e/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:28.010193 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0210b3-e607-4adb-bb49-76c20babd7c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=155ecd4ebf26498886794f21e24506de, user_id=188d908ef11e42b4a558553678e97f9e, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:28.013039 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0210b3-e607-4adb-bb49-76c20babd7c1 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:28.026288 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 955/1908] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:27 2022] PUT /identity/v3/projects/155ecd4ebf26498886794f21e24506de/users/188d908ef11e42b4a558553678e97f9e/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:28.036811 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db274c-4053-44ea-97ea-38c401ba263e None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:28.037185 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db274c-4053-44ea-97ea-38c401ba263e None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:28.037381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db274c-4053-44ea-97ea-38c401ba263e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:28.076193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-50db274c-4053-44ea-97ea-38c401ba263e None None] MFA Rules not processed for user `188d908ef11e42b4a558553678e97f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:28.077682 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-50db274c-4053-44ea-97ea-38c401ba263e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:28.157827 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 954/1909] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:28.162674 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0210b3-e607-4adb-bb49-76c20babd7c1 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:28.238027 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0210b3-e607-4adb-bb49-76c20babd7c1 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:28.242955 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5c423-bc7f-4561-ade3-750ec9f3553d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:28.243632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5c423-bc7f-4561-ade3-750ec9f3553d admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:28.243905 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5c423-bc7f-4561-ade3-750ec9f3553d admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:28.244606 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5c423-bc7f-4561-ade3-750ec9f3553d admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:28.244888 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a5c423-bc7f-4561-ade3-750ec9f3553d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:28.246906 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a5c423-bc7f-4561-ade3-750ec9f3553d admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:28.286407 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 956/1910] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:34:28 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:28.291890 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db274c-4053-44ea-97ea-38c401ba263e None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:28.308465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db274c-4053-44ea-97ea-38c401ba263e None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:28.313638 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5c423-bc7f-4561-ade3-750ec9f3553d admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:28.316147 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-59a5c423-bc7f-4561-ade3-750ec9f3553d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:28.388480 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b93dd1-d232-43d5-9db4-f4d8086c9154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:28.389720 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b93dd1-d232-43d5-9db4-f4d8086c9154 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:28.390211 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b93dd1-d232-43d5-9db4-f4d8086c9154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:28.390990 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b93dd1-d232-43d5-9db4-f4d8086c9154 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:28.392295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b93dd1-d232-43d5-9db4-f4d8086c9154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:28.395292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b93dd1-d232-43d5-9db4-f4d8086c9154 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:28.411721 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5c423-bc7f-4561-ade3-750ec9f3553d admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:28.418637 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466646c-1bc0-41af-81f5-c346ad6d1021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:28.419569 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466646c-1bc0-41af-81f5-c346ad6d1021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:28.419974 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466646c-1bc0-41af-81f5-c346ad6d1021 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:28.420385 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466646c-1bc0-41af-81f5-c346ad6d1021 admin admin] PATH_INFO: `/v3/users/577753fb8fd84511b4f30a8179430aa5` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:28.421640 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e466646c-1bc0-41af-81f5-c346ad6d1021 admin admin] RBAC: Authorizing `identity:delete_user(user_id=577753fb8fd84511b4f30a8179430aa5)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:28.425469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 955/1911] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:34:28 2022] POST /identity/v3/users => generated 294 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:28.425605 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e466646c-1bc0-41af-81f5-c346ad6d1021 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:28.427083 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b93dd1-d232-43d5-9db4-f4d8086c9154 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:28.437769 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b93dd1-d232-43d5-9db4-f4d8086c9154 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:28.443280 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa11e11-73fe-4699-9543-f52962f0cce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:28.443495 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa11e11-73fe-4699-9543-f52962f0cce3 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:28.443782 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa11e11-73fe-4699-9543-f52962f0cce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:28.444055 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa11e11-73fe-4699-9543-f52962f0cce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:28.445343 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa11e11-73fe-4699-9543-f52962f0cce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:28.446947 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa11e11-73fe-4699-9543-f52962f0cce3 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:28.461946 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 956/1912] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:28.463655 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa11e11-73fe-4699-9543-f52962f0cce3 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:28.474717 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa11e11-73fe-4699-9543-f52962f0cce3 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:28.484402 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e466646c-1bc0-41af-81f5-c346ad6d1021 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '577753fb8fd84511b4f30a8179430aa5'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:28.485085 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56583f2-55c0-4bfb-a814-efa67d1916d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:28.485787 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56583f2-55c0-4bfb-a814-efa67d1916d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:28.486109 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56583f2-55c0-4bfb-a814-efa67d1916d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:28.486390 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56583f2-55c0-4bfb-a814-efa67d1916d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:28.487119 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56583f2-55c0-4bfb-a814-efa67d1916d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:28.489238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56583f2-55c0-4bfb-a814-efa67d1916d3 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:28.498170 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e466646c-1bc0-41af-81f5-c346ad6d1021 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '577753fb8fd84511b4f30a8179430aa5'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:28.499272 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e466646c-1bc0-41af-81f5-c346ad6d1021 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '577753fb8fd84511b4f30a8179430aa5'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:28.502707 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 957/1913] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:28.506657 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56583f2-55c0-4bfb-a814-efa67d1916d3 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:28.512343 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e466646c-1bc0-41af-81f5-c346ad6d1021 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '577753fb8fd84511b4f30a8179430aa5'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:28.519174 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56583f2-55c0-4bfb-a814-efa67d1916d3 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:28.529482 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e466646c-1bc0-41af-81f5-c346ad6d1021 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '577753fb8fd84511b4f30a8179430aa5'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:28.531887 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15036b5b-b8c8-4ce1-8f91-68d839953ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:28.532807 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15036b5b-b8c8-4ce1-8f91-68d839953ca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:28.533082 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15036b5b-b8c8-4ce1-8f91-68d839953ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:28.533423 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15036b5b-b8c8-4ce1-8f91-68d839953ca3 admin admin] PATH_INFO: `/v3/projects/0a572cce879e42488a00fbb1153d8b8e/users/2e59813f8d78462d8dc897bf0916da95/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:28.547982 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 957/1914] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:34:28 2022] DELETE /identity/v3/users/577753fb8fd84511b4f30a8179430aa5 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:28.549759 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15036b5b-b8c8-4ce1-8f91-68d839953ca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a572cce879e42488a00fbb1153d8b8e, user_id=2e59813f8d78462d8dc897bf0916da95, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:28.552267 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09907ba-7d6e-407e-89ba-65c58cbd5378 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:28.552459 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15036b5b-b8c8-4ce1-8f91-68d839953ca3 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:28.552641 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09907ba-7d6e-407e-89ba-65c58cbd5378 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:28.553332 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09907ba-7d6e-407e-89ba-65c58cbd5378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:28.576686 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 958/1915] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:28 2022] PUT /identity/v3/projects/0a572cce879e42488a00fbb1153d8b8e/users/2e59813f8d78462d8dc897bf0916da95/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:34:28.584175 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18800d-1eb2-4c8d-ab6b-b41b1c65c747 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:28.584470 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18800d-1eb2-4c8d-ab6b-b41b1c65c747 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:28.584903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18800d-1eb2-4c8d-ab6b-b41b1c65c747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:28.599106 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-b09907ba-7d6e-407e-89ba-65c58cbd5378 None None] MFA Rules not processed for user `7dd6d3e1b6ea49d4a75e5f7e105ea0f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:28.601389 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-b09907ba-7d6e-407e-89ba-65c58cbd5378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:28.607377 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-6f18800d-1eb2-4c8d-ab6b-b41b1c65c747 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:28.609010 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-6f18800d-1eb2-4c8d-ab6b-b41b1c65c747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:28.713244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 959/1916] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:28.717288 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd36088-a03f-42c2-aab9-c9000b5884c3 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:28.717288 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd36088-a03f-42c2-aab9-c9000b5884c3 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:28.717288 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd36088-a03f-42c2-aab9-c9000b5884c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:28.737252 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 958/1917] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:28.738113 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09907ba-7d6e-407e-89ba-65c58cbd5378 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:28.739664 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-b09907ba-7d6e-407e-89ba-65c58cbd5378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:28.753267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-3dd36088-a03f-42c2-aab9-c9000b5884c3 None None] MFA Rules not processed for user `2e59813f8d78462d8dc897bf0916da95`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:28.754893 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-3dd36088-a03f-42c2-aab9-c9000b5884c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:28.854486 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 960/1918] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:28.855769 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd36088-a03f-42c2-aab9-c9000b5884c3 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:28.858276 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-3dd36088-a03f-42c2-aab9-c9000b5884c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:28.859976 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09907ba-7d6e-407e-89ba-65c58cbd5378 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:28.873117 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18b325-83b9-4970-9bc8-4354023304fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:28.873890 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18b325-83b9-4970-9bc8-4354023304fc service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:28.874176 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18b325-83b9-4970-9bc8-4354023304fc service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:28.874454 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18b325-83b9-4970-9bc8-4354023304fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:28.892240 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18b325-83b9-4970-9bc8-4354023304fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:28.893685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18b325-83b9-4970-9bc8-4354023304fc service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:28.912923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 959/1919] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:28.914543 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18b325-83b9-4970-9bc8-4354023304fc service neutron] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:28.917919 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-be18b325-83b9-4970-9bc8-4354023304fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:28.936455 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18b325-83b9-4970-9bc8-4354023304fc service neutron] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:28.948084 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e4637-dbc3-4112-be58-5f971e52d870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:28.950483 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd36088-a03f-42c2-aab9-c9000b5884c3 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:28.951558 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e4637-dbc3-4112-be58-5f971e52d870 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:28.952016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e4637-dbc3-4112-be58-5f971e52d870 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:28.952304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e4637-dbc3-4112-be58-5f971e52d870 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:28.953019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e4637-dbc3-4112-be58-5f971e52d870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:28.954765 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d74f4-be23-4b5c-aa9a-b9217ea07b6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:28.955504 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d74f4-be23-4b5c-aa9a-b9217ea07b6e service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:28.956455 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d74f4-be23-4b5c-aa9a-b9217ea07b6e service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:28.956621 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e4637-dbc3-4112-be58-5f971e52d870 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:28.956850 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d74f4-be23-4b5c-aa9a-b9217ea07b6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:28.967105 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d74f4-be23-4b5c-aa9a-b9217ea07b6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:28.968703 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d74f4-be23-4b5c-aa9a-b9217ea07b6e service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:28.979616 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 961/1920] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:29.014120 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 960/1921] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:34:28 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:29.017970 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d74f4-be23-4b5c-aa9a-b9217ea07b6e service cinder] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:29.030693 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d74f4-be23-4b5c-aa9a-b9217ea07b6e service cinder] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:29.094876 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae89608a-1025-450a-8e8c-0ce763119d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:29.096301 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89608a-1025-450a-8e8c-0ce763119d50 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:29.096812 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89608a-1025-450a-8e8c-0ce763119d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:29.097280 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89608a-1025-450a-8e8c-0ce763119d50 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:29.098205 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae89608a-1025-450a-8e8c-0ce763119d50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:29.103650 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae89608a-1025-450a-8e8c-0ce763119d50 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:29.136664 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 962/1922] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:34:29 2022] POST /identity/v3/users => generated 300 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:34:29.140804 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e4637-dbc3-4112-be58-5f971e52d870 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:29.154587 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e4637-dbc3-4112-be58-5f971e52d870 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:29.166671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954cd4d-daf0-4ad4-93c1-3f193b34f671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:29.167631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954cd4d-daf0-4ad4-93c1-3f193b34f671 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:29.167984 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954cd4d-daf0-4ad4-93c1-3f193b34f671 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:29.168325 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954cd4d-daf0-4ad4-93c1-3f193b34f671 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:29.169321 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5954cd4d-daf0-4ad4-93c1-3f193b34f671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:29.170685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5954cd4d-daf0-4ad4-93c1-3f193b34f671 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:29.207680 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae89608a-1025-450a-8e8c-0ce763119d50 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:29.217468 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 961/1923] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:29.219974 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae89608a-1025-450a-8e8c-0ce763119d50 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:29.227676 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd684e4-339d-45e0-8372-251e20cbc6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:29.228568 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd684e4-339d-45e0-8372-251e20cbc6ad admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:29.229730 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd684e4-339d-45e0-8372-251e20cbc6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:29.230052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd684e4-339d-45e0-8372-251e20cbc6ad admin admin] PATH_INFO: `/v3/projects/887a7b553f9f40b2ba2487d0bee86bb5/users/f16f769632ac41fca9124197735dcd70/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:29.250378 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd684e4-339d-45e0-8372-251e20cbc6ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=887a7b553f9f40b2ba2487d0bee86bb5, user_id=f16f769632ac41fca9124197735dcd70, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:29.254072 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd684e4-339d-45e0-8372-251e20cbc6ad admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:29.274449 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 963/1924] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:29 2022] PUT /identity/v3/projects/887a7b553f9f40b2ba2487d0bee86bb5/users/f16f769632ac41fca9124197735dcd70/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:34:29.275716 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954cd4d-daf0-4ad4-93c1-3f193b34f671 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:29.287043 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954cd4d-daf0-4ad4-93c1-3f193b34f671 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:29.368376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93306411-668e-47e4-96a4-04c9dc3fa310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:29.369057 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93306411-668e-47e4-96a4-04c9dc3fa310 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:29.369344 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93306411-668e-47e4-96a4-04c9dc3fa310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:29.369617 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93306411-668e-47e4-96a4-04c9dc3fa310 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:29.372219 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93306411-668e-47e4-96a4-04c9dc3fa310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:29.374195 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93306411-668e-47e4-96a4-04c9dc3fa310 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:29.385929 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 962/1925] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:29.393040 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd684e4-339d-45e0-8372-251e20cbc6ad admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:29.393933 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93306411-668e-47e4-96a4-04c9dc3fa310 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:29.396009 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-93306411-668e-47e4-96a4-04c9dc3fa310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:29.404664 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd684e4-339d-45e0-8372-251e20cbc6ad admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:29.418353 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93306411-668e-47e4-96a4-04c9dc3fa310 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:29.423616 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e29f5f-6288-401c-8e24-2e8e1f03acce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:29.424743 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e29f5f-6288-401c-8e24-2e8e1f03acce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:29.425126 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e29f5f-6288-401c-8e24-2e8e1f03acce admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:29.425583 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e29f5f-6288-401c-8e24-2e8e1f03acce admin admin] PATH_INFO: `/v3/projects/bfbda12e4b664723a04097b2ca1e8698` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:29.427480 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e29f5f-6288-401c-8e24-2e8e1f03acce admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfbda12e4b664723a04097b2ca1e8698)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:29.430021 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e29f5f-6288-401c-8e24-2e8e1f03acce admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:29.430473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7717c78b-9dbd-439c-8047-2052d61b0231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:29.431383 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717c78b-9dbd-439c-8047-2052d61b0231 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:29.431662 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717c78b-9dbd-439c-8047-2052d61b0231 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:29.432055 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717c78b-9dbd-439c-8047-2052d61b0231 admin admin] PATH_INFO: `/v3/projects/887a7b553f9f40b2ba2487d0bee86bb5/users/f16f769632ac41fca9124197735dcd70/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:29.434094 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7717c78b-9dbd-439c-8047-2052d61b0231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=887a7b553f9f40b2ba2487d0bee86bb5, user_id=f16f769632ac41fca9124197735dcd70, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:29.437547 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7717c78b-9dbd-439c-8047-2052d61b0231 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:29.451474 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 964/1926] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:29 2022] PUT /identity/v3/projects/887a7b553f9f40b2ba2487d0bee86bb5/users/f16f769632ac41fca9124197735dcd70/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:29.461767 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f2ff5-15e0-4be9-bad2-19064587ca57 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:29.462171 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f2ff5-15e0-4be9-bad2-19064587ca57 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:29.462624 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f2ff5-15e0-4be9-bad2-19064587ca57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:29.495578 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-77e29f5f-6288-401c-8e24-2e8e1f03acce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfbda12e4b664723a04097b2ca1e8698', 'request_id': 'req-77e29f5f-6288-401c-8e24-2e8e1f03acce'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:29.500930 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-77e29f5f-6288-401c-8e24-2e8e1f03acce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfbda12e4b664723a04097b2ca1e8698', 'request_id': 'req-77e29f5f-6288-401c-8e24-2e8e1f03acce'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:29.501785 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-993f2ff5-15e0-4be9-bad2-19064587ca57 None None] MFA Rules not processed for user `f16f769632ac41fca9124197735dcd70`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:29.503537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-993f2ff5-15e0-4be9-bad2-19064587ca57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:29.510502 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-77e29f5f-6288-401c-8e24-2e8e1f03acce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfbda12e4b664723a04097b2ca1e8698', 'request_id': 'req-77e29f5f-6288-401c-8e24-2e8e1f03acce'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:29.523631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-77e29f5f-6288-401c-8e24-2e8e1f03acce admin admin] The token cache is being invalidate because project bfbda12e4b664723a04097b2ca1e8698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:34:29.523941 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-77e29f5f-6288-401c-8e24-2e8e1f03acce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:29.524582 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-77e29f5f-6288-401c-8e24-2e8e1f03acce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:29.529158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 963/1927] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:34:29 2022] DELETE /identity/v3/projects/bfbda12e4b664723a04097b2ca1e8698 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:29.531186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e29f5f-6288-401c-8e24-2e8e1f03acce admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:29.533129 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-77e29f5f-6288-401c-8e24-2e8e1f03acce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:29.578187 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 965/1928] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:29.589943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f2ff5-15e0-4be9-bad2-19064587ca57 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:29.591329 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-993f2ff5-15e0-4be9-bad2-19064587ca57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:29.599244 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e29f5f-6288-401c-8e24-2e8e1f03acce admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:29.604769 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4845f57-b470-4ca3-8a36-ddc7122e37d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:29.605699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4845f57-b470-4ca3-8a36-ddc7122e37d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:29.606034 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4845f57-b470-4ca3-8a36-ddc7122e37d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:29.606314 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4845f57-b470-4ca3-8a36-ddc7122e37d6 admin admin] PATH_INFO: `/v3/users/12bc70de878349adb976d5933820e02a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:29.607522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4845f57-b470-4ca3-8a36-ddc7122e37d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12bc70de878349adb976d5933820e02a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:29.609436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4845f57-b470-4ca3-8a36-ddc7122e37d6 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:29.646728 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f2ff5-15e0-4be9-bad2-19064587ca57 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:29.651080 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1b937-a6bb-406e-afb1-f5e3b4f11c6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:29.651736 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1b937-a6bb-406e-afb1-f5e3b4f11c6b service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:29.652015 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1b937-a6bb-406e-afb1-f5e3b4f11c6b service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:29.652290 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1b937-a6bb-406e-afb1-f5e3b4f11c6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:29.657280 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f4845f57-b470-4ca3-8a36-ddc7122e37d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12bc70de878349adb976d5933820e02a'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:29.661314 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1b937-a6bb-406e-afb1-f5e3b4f11c6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:29.662763 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1b937-a6bb-406e-afb1-f5e3b4f11c6b service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:29.669184 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f4845f57-b470-4ca3-8a36-ddc7122e37d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12bc70de878349adb976d5933820e02a'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:29.669854 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f4845f57-b470-4ca3-8a36-ddc7122e37d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12bc70de878349adb976d5933820e02a'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:29.672555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 966/1929] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 09:34:29.677111 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f4845f57-b470-4ca3-8a36-ddc7122e37d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12bc70de878349adb976d5933820e02a'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:29.684696 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f4845f57-b470-4ca3-8a36-ddc7122e37d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12bc70de878349adb976d5933820e02a'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:29.691238 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 964/1930] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:34:29 2022] DELETE /identity/v3/users/12bc70de878349adb976d5933820e02a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:30.011921 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1b937-a6bb-406e-afb1-f5e3b4f11c6b service cinder] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:30.029924 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1b937-a6bb-406e-afb1-f5e3b4f11c6b service cinder] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:30.121095 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837b01d-c245-4c81-ad63-5ce9a6d774a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:30.122366 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837b01d-c245-4c81-ad63-5ce9a6d774a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:30.122805 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837b01d-c245-4c81-ad63-5ce9a6d774a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:30.123046 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837b01d-c245-4c81-ad63-5ce9a6d774a1 admin admin] PATH_INFO: `/v3/projects/ee38dd0269464eba8d383fbe8731346e` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:30.124300 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837b01d-c245-4c81-ad63-5ce9a6d774a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee38dd0269464eba8d383fbe8731346e)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:30.126600 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837b01d-c245-4c81-ad63-5ce9a6d774a1 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:30.205943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-5837b01d-c245-4c81-ad63-5ce9a6d774a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee38dd0269464eba8d383fbe8731346e', 'request_id': 'req-5837b01d-c245-4c81-ad63-5ce9a6d774a1'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:30.212071 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-5837b01d-c245-4c81-ad63-5ce9a6d774a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee38dd0269464eba8d383fbe8731346e', 'request_id': 'req-5837b01d-c245-4c81-ad63-5ce9a6d774a1'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:30.220888 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-5837b01d-c245-4c81-ad63-5ce9a6d774a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee38dd0269464eba8d383fbe8731346e', 'request_id': 'req-5837b01d-c245-4c81-ad63-5ce9a6d774a1'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:30.240440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-5837b01d-c245-4c81-ad63-5ce9a6d774a1 admin admin] The token cache is being invalidate because project ee38dd0269464eba8d383fbe8731346e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:34:30.240829 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-5837b01d-c245-4c81-ad63-5ce9a6d774a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:30.242294 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-5837b01d-c245-4c81-ad63-5ce9a6d774a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:30.245943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 967/1931] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:34:30 2022] DELETE /identity/v3/projects/ee38dd0269464eba8d383fbe8731346e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:30.248969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ae8d7-eac5-4596-a5cc-f58e65b46da3 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:30.249443 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ae8d7-eac5-4596-a5cc-f58e65b46da3 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:30.249534 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ae8d7-eac5-4596-a5cc-f58e65b46da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:30.275291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-503ae8d7-eac5-4596-a5cc-f58e65b46da3 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:30.276393 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-503ae8d7-eac5-4596-a5cc-f58e65b46da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:30.360954 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 965/1932] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:30.362342 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f81250-7e24-4ad5-ae59-57462f025f03 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:30.362637 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f81250-7e24-4ad5-ae59-57462f025f03 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:30.362941 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f81250-7e24-4ad5-ae59-57462f025f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:30.385203 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ae8d7-eac5-4596-a5cc-f58e65b46da3 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:30.387194 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-503ae8d7-eac5-4596-a5cc-f58e65b46da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:30.400435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-79f81250-7e24-4ad5-ae59-57462f025f03 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:30.401622 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-79f81250-7e24-4ad5-ae59-57462f025f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:30.432697 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 968/1933] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:30.436689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f81250-7e24-4ad5-ae59-57462f025f03 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:30.449515 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f81250-7e24-4ad5-ae59-57462f025f03 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:30.455573 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c5cfd-219c-4a14-a7a0-19812ad1e291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:30.456407 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c5cfd-219c-4a14-a7a0-19812ad1e291 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:30.456700 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c5cfd-219c-4a14-a7a0-19812ad1e291 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:30.456975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c5cfd-219c-4a14-a7a0-19812ad1e291 admin admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:30.457777 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c5cfd-219c-4a14-a7a0-19812ad1e291 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:34:30.458144 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c5cfd-219c-4a14-a7a0-19812ad1e291 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:30.459776 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300c5cfd-219c-4a14-a7a0-19812ad1e291 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:30.471642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ae8d7-eac5-4596-a5cc-f58e65b46da3 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:30.477953 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 969/1934] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:34:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:34:30.479515 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c5cfd-219c-4a14-a7a0-19812ad1e291 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:30.480373 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759aaea-f893-4816-aabc-5723407cb8b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:30.481182 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759aaea-f893-4816-aabc-5723407cb8b9 service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:30.481537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759aaea-f893-4816-aabc-5723407cb8b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:30.481885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759aaea-f893-4816-aabc-5723407cb8b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:30.484164 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-7759aaea-f893-4816-aabc-5723407cb8b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:30.492206 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c5cfd-219c-4a14-a7a0-19812ad1e291 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:30.497521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc81d58-32bf-4de8-aab9-05a0e84687a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:30.498475 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc81d58-32bf-4de8-aab9-05a0e84687a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:30.500423 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc81d58-32bf-4de8-aab9-05a0e84687a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:30.500831 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc81d58-32bf-4de8-aab9-05a0e84687a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:30.501703 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc81d58-32bf-4de8-aab9-05a0e84687a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:30.503837 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc81d58-32bf-4de8-aab9-05a0e84687a9 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:30.542514 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 970/1935] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:34:30 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:34:30.544275 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc81d58-32bf-4de8-aab9-05a0e84687a9 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:30.586843 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759aaea-f893-4816-aabc-5723407cb8b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:30.588780 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759aaea-f893-4816-aabc-5723407cb8b9 service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:30.597932 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 966/1936] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:30.618439 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc81d58-32bf-4de8-aab9-05a0e84687a9 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:30.626209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af360f02-9288-47ad-8c07-2257b15805bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:30.627417 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af360f02-9288-47ad-8c07-2257b15805bd admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:30.627646 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af360f02-9288-47ad-8c07-2257b15805bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:30.628005 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af360f02-9288-47ad-8c07-2257b15805bd admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:30.629292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af360f02-9288-47ad-8c07-2257b15805bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:30.631301 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af360f02-9288-47ad-8c07-2257b15805bd admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:30.670434 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 971/1937] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:34:30 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:30.674819 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759aaea-f893-4816-aabc-5723407cb8b9 service cinder] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:30.690888 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759aaea-f893-4816-aabc-5723407cb8b9 service cinder] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:30.699784 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df698df6-f906-47ac-88a1-1acaaea9353b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:30.700581 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df698df6-f906-47ac-88a1-1acaaea9353b admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:30.700970 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df698df6-f906-47ac-88a1-1acaaea9353b admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:30.701325 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df698df6-f906-47ac-88a1-1acaaea9353b admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:30.702305 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df698df6-f906-47ac-88a1-1acaaea9353b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:30.705152 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df698df6-f906-47ac-88a1-1acaaea9353b admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:30.719736 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d0836-630c-4e9f-a1fc-bec87467465e None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:30.720029 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d0836-630c-4e9f-a1fc-bec87467465e None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:30.720314 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d0836-630c-4e9f-a1fc-bec87467465e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:30.724600 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 967/1938] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:30.729580 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df698df6-f906-47ac-88a1-1acaaea9353b admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:30.741795 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df698df6-f906-47ac-88a1-1acaaea9353b admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:30.750719 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582fa4b-0a6e-4219-8f99-fdd1e0e506fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:30.751586 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-e43d0836-630c-4e9f-a1fc-bec87467465e None None] MFA Rules not processed for user `7dd6d3e1b6ea49d4a75e5f7e105ea0f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:30.752925 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582fa4b-0a6e-4219-8f99-fdd1e0e506fa admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:30.753233 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582fa4b-0a6e-4219-8f99-fdd1e0e506fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:30.753491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582fa4b-0a6e-4219-8f99-fdd1e0e506fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:30.754516 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5582fa4b-0a6e-4219-8f99-fdd1e0e506fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:30.757864 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5582fa4b-0a6e-4219-8f99-fdd1e0e506fa admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:30.757977 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-e43d0836-630c-4e9f-a1fc-bec87467465e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:30.786318 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 968/1939] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:30.790368 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582fa4b-0a6e-4219-8f99-fdd1e0e506fa admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:30.805142 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582fa4b-0a6e-4219-8f99-fdd1e0e506fa admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:30.811097 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f40c5-b85e-4102-ba4e-8081c5b93b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:30.812288 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f40c5-b85e-4102-ba4e-8081c5b93b65 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:30.812821 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f40c5-b85e-4102-ba4e-8081c5b93b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:30.813258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f40c5-b85e-4102-ba4e-8081c5b93b65 admin admin] PATH_INFO: `/v3/projects/cbf41ee78db54b7aa8543ca7a4a31c27/users/d0acf2ba5c154ff2a848bec27043744a/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:30.830210 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f40c5-b85e-4102-ba4e-8081c5b93b65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf41ee78db54b7aa8543ca7a4a31c27, user_id=d0acf2ba5c154ff2a848bec27043744a, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:30.833018 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f40c5-b85e-4102-ba4e-8081c5b93b65 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:30.836792 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 972/1940] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:34:30.853987 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 969/1941] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:30 2022] PUT /identity/v3/projects/cbf41ee78db54b7aa8543ca7a4a31c27/users/d0acf2ba5c154ff2a848bec27043744a/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:30.857559 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efa639-d19b-4406-bbdc-68a5bc3a1cf0 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:30.857971 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efa639-d19b-4406-bbdc-68a5bc3a1cf0 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:30.858252 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efa639-d19b-4406-bbdc-68a5bc3a1cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:30.899618 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-c4efa639-d19b-4406-bbdc-68a5bc3a1cf0 None None] MFA Rules not processed for user `d0acf2ba5c154ff2a848bec27043744a`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:30.900967 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-c4efa639-d19b-4406-bbdc-68a5bc3a1cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:30.983150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 973/1942] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:30.984575 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f40c5-b85e-4102-ba4e-8081c5b93b65 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:31.051770 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f40c5-b85e-4102-ba4e-8081c5b93b65 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:31.057117 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f28fb-d9ca-4b0b-807b-09ed316f8031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:31.057702 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f28fb-d9ca-4b0b-807b-09ed316f8031 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:31.058009 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f28fb-d9ca-4b0b-807b-09ed316f8031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:31.058308 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f28fb-d9ca-4b0b-807b-09ed316f8031 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:31.059139 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f28fb-d9ca-4b0b-807b-09ed316f8031 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:31.061032 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f28fb-d9ca-4b0b-807b-09ed316f8031 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:31.090353 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 970/1943] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:34:30 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:31.099017 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efa639-d19b-4406-bbdc-68a5bc3a1cf0 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:31.116829 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efa639-d19b-4406-bbdc-68a5bc3a1cf0 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:31.185485 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d38ae-6f8b-4550-abd1-3236b3eb4fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:31.186292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d38ae-6f8b-4550-abd1-3236b3eb4fab admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:31.186654 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d38ae-6f8b-4550-abd1-3236b3eb4fab admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:31.187007 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d38ae-6f8b-4550-abd1-3236b3eb4fab admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:31.187829 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d38ae-6f8b-4550-abd1-3236b3eb4fab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:31.190180 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d38ae-6f8b-4550-abd1-3236b3eb4fab admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:31.213532 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 974/1944] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:34:31 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:31.217274 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f28fb-d9ca-4b0b-807b-09ed316f8031 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:31.232751 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f28fb-d9ca-4b0b-807b-09ed316f8031 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:31.238820 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd13c8-f191-4420-b3c3-5d8b327dbc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:31.239920 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd13c8-f191-4420-b3c3-5d8b327dbc61 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:31.240348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd13c8-f191-4420-b3c3-5d8b327dbc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:31.240998 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd13c8-f191-4420-b3c3-5d8b327dbc61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:31.242355 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd13c8-f191-4420-b3c3-5d8b327dbc61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:31.244306 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd13c8-f191-4420-b3c3-5d8b327dbc61 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:31.260957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 971/1945] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:31.262286 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d38ae-6f8b-4550-abd1-3236b3eb4fab admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:31.274361 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d38ae-6f8b-4550-abd1-3236b3eb4fab admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:31.279799 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad4134-aceb-4802-8797-a3a39fe84bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:31.280541 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad4134-aceb-4802-8797-a3a39fe84bca admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:31.280825 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad4134-aceb-4802-8797-a3a39fe84bca admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:31.281100 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad4134-aceb-4802-8797-a3a39fe84bca admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:31.282248 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad4134-aceb-4802-8797-a3a39fe84bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:31.283904 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad4134-aceb-4802-8797-a3a39fe84bca admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:31.302428 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 975/1946] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:31.306716 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd13c8-f191-4420-b3c3-5d8b327dbc61 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:31.317643 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd13c8-f191-4420-b3c3-5d8b327dbc61 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:31.323150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0339c0-a802-45c6-baac-f5a7c8323453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:31.324110 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0339c0-a802-45c6-baac-f5a7c8323453 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:31.324487 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0339c0-a802-45c6-baac-f5a7c8323453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:31.324770 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0339c0-a802-45c6-baac-f5a7c8323453 admin admin] PATH_INFO: `/v3/projects/08ef2be518b04e46b90364024d061e48/users/924412694dd64e3dbb3a6cb29d48a88a/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:31.340801 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0339c0-a802-45c6-baac-f5a7c8323453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08ef2be518b04e46b90364024d061e48, user_id=924412694dd64e3dbb3a6cb29d48a88a, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:31.343567 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0339c0-a802-45c6-baac-f5a7c8323453 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:31.373500 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 972/1947] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:31 2022] PUT /identity/v3/projects/08ef2be518b04e46b90364024d061e48/users/924412694dd64e3dbb3a6cb29d48a88a/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:34:31.386068 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa451d1-6bea-41dd-b5f5-5eb08d0603a7 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:31.386442 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa451d1-6bea-41dd-b5f5-5eb08d0603a7 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:31.387256 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa451d1-6bea-41dd-b5f5-5eb08d0603a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:31.415408 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-daa451d1-6bea-41dd-b5f5-5eb08d0603a7 None None] MFA Rules not processed for user `924412694dd64e3dbb3a6cb29d48a88a`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:31.416636 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-daa451d1-6bea-41dd-b5f5-5eb08d0603a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:31.495264 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 976/1948] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:31.500214 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0339c0-a802-45c6-baac-f5a7c8323453 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:31.583267 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0339c0-a802-45c6-baac-f5a7c8323453 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:31.592505 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fede77-0a67-4014-b145-a923c86a5369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:31.594244 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fede77-0a67-4014-b145-a923c86a5369 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:31.594625 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fede77-0a67-4014-b145-a923c86a5369 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:31.595167 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fede77-0a67-4014-b145-a923c86a5369 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:31.596013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fede77-0a67-4014-b145-a923c86a5369 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:31.598191 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fede77-0a67-4014-b145-a923c86a5369 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:31.629885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 973/1949] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:34:31 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:34:31.633859 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa451d1-6bea-41dd-b5f5-5eb08d0603a7 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:31.653307 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa451d1-6bea-41dd-b5f5-5eb08d0603a7 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:31.722256 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a736da-9130-48e5-b243-30dc0d4916fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:31.722938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a736da-9130-48e5-b243-30dc0d4916fc admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:31.723218 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a736da-9130-48e5-b243-30dc0d4916fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:31.723488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a736da-9130-48e5-b243-30dc0d4916fc admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:31.724180 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a736da-9130-48e5-b243-30dc0d4916fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:31.730296 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a736da-9130-48e5-b243-30dc0d4916fc admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:31.764562 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 977/1950] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:34:31 2022] POST /identity/v3/users => generated 298 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:31.768857 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fede77-0a67-4014-b145-a923c86a5369 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:31.781360 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fede77-0a67-4014-b145-a923c86a5369 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:31.789221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fa3ef-df68-4871-adf3-598ee2b7dd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:31.790152 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fa3ef-df68-4871-adf3-598ee2b7dd4b admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:31.790960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fa3ef-df68-4871-adf3-598ee2b7dd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:31.791308 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fa3ef-df68-4871-adf3-598ee2b7dd4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:31.792051 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fa3ef-df68-4871-adf3-598ee2b7dd4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:31.793857 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fa3ef-df68-4871-adf3-598ee2b7dd4b admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:31.814686 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 974/1951] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:31.815838 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a736da-9130-48e5-b243-30dc0d4916fc admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:31.831024 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a736da-9130-48e5-b243-30dc0d4916fc admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:31.839057 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc916ca-bb3d-46dc-aa8a-515dd3bd3887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:31.840029 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc916ca-bb3d-46dc-aa8a-515dd3bd3887 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:31.840455 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc916ca-bb3d-46dc-aa8a-515dd3bd3887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:31.840800 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc916ca-bb3d-46dc-aa8a-515dd3bd3887 admin admin] PATH_INFO: `/v3/projects/e97be5c9a89a486288ed294a6258c17a/users/d74c9d21b83c45be9b61de783fe6212d/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:31.858283 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc916ca-bb3d-46dc-aa8a-515dd3bd3887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e97be5c9a89a486288ed294a6258c17a, user_id=d74c9d21b83c45be9b61de783fe6212d, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:31.861119 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc916ca-bb3d-46dc-aa8a-515dd3bd3887 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:31.876188 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 978/1952] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:31 2022] PUT /identity/v3/projects/e97be5c9a89a486288ed294a6258c17a/users/d74c9d21b83c45be9b61de783fe6212d/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:34:31.879986 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fa3ef-df68-4871-adf3-598ee2b7dd4b admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:31.894811 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fa3ef-df68-4871-adf3-598ee2b7dd4b admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:31.972659 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280383a-9cdd-4343-b14c-0d635048d559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:31.973707 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280383a-9cdd-4343-b14c-0d635048d559 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:31.973707 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280383a-9cdd-4343-b14c-0d635048d559 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:31.974444 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280383a-9cdd-4343-b14c-0d635048d559 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:31.975247 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280383a-9cdd-4343-b14c-0d635048d559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:31.977403 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280383a-9cdd-4343-b14c-0d635048d559 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:31.990181 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 975/1953] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:31.994499 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc916ca-bb3d-46dc-aa8a-515dd3bd3887 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:32.009732 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc916ca-bb3d-46dc-aa8a-515dd3bd3887 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:32.017619 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3234f3a-cfa5-48fe-b159-fce44f7c5dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:32.018857 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3234f3a-cfa5-48fe-b159-fce44f7c5dc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:32.019303 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3234f3a-cfa5-48fe-b159-fce44f7c5dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:32.020318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3234f3a-cfa5-48fe-b159-fce44f7c5dc8 admin admin] PATH_INFO: `/v3/projects/e97be5c9a89a486288ed294a6258c17a/users/d74c9d21b83c45be9b61de783fe6212d/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:32.023133 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3234f3a-cfa5-48fe-b159-fce44f7c5dc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e97be5c9a89a486288ed294a6258c17a, user_id=d74c9d21b83c45be9b61de783fe6212d, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:32.029291 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3234f3a-cfa5-48fe-b159-fce44f7c5dc8 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:32.041990 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 979/1954] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:31 2022] PUT /identity/v3/projects/e97be5c9a89a486288ed294a6258c17a/users/d74c9d21b83c45be9b61de783fe6212d/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:32.052614 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad8fa1-05cf-4982-9912-fa2d59b40c77 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:32.052888 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad8fa1-05cf-4982-9912-fa2d59b40c77 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:32.053177 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad8fa1-05cf-4982-9912-fa2d59b40c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:32.087402 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-f1ad8fa1-05cf-4982-9912-fa2d59b40c77 None None] MFA Rules not processed for user `d74c9d21b83c45be9b61de783fe6212d`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:32.088223 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-f1ad8fa1-05cf-4982-9912-fa2d59b40c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:32.167484 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3234f3a-cfa5-48fe-b159-fce44f7c5dc8 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:32.170451 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-a3234f3a-cfa5-48fe-b159-fce44f7c5dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:32.174671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 976/1955] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:32.191589 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad8fa1-05cf-4982-9912-fa2d59b40c77 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:32.237293 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3234f3a-cfa5-48fe-b159-fce44f7c5dc8 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:32.243317 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbec3f-c470-459c-81b3-10718c807066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:32.244190 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbec3f-c470-459c-81b3-10718c807066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:32.244470 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbec3f-c470-459c-81b3-10718c807066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:32.244740 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbec3f-c470-459c-81b3-10718c807066 admin admin] PATH_INFO: `/v3/users/422a67aaa9b34c29bd287df35e363529` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:32.246047 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fbec3f-c470-459c-81b3-10718c807066 admin admin] RBAC: Authorizing `identity:delete_user(user_id=422a67aaa9b34c29bd287df35e363529)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:32.248078 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fbec3f-c470-459c-81b3-10718c807066 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:32.250099 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad8fa1-05cf-4982-9912-fa2d59b40c77 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:32.253912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7e1ae-77ea-453e-8fba-f0dbaad00635 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:32.254584 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7e1ae-77ea-453e-8fba-f0dbaad00635 service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:32.254866 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7e1ae-77ea-453e-8fba-f0dbaad00635 service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:32.255140 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7e1ae-77ea-453e-8fba-f0dbaad00635 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:32.292422 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e1fbec3f-c470-459c-81b3-10718c807066 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '422a67aaa9b34c29bd287df35e363529'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:32.303419 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e1fbec3f-c470-459c-81b3-10718c807066 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '422a67aaa9b34c29bd287df35e363529'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:32.304194 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e1fbec3f-c470-459c-81b3-10718c807066 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '422a67aaa9b34c29bd287df35e363529'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:32.313689 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7e1ae-77ea-453e-8fba-f0dbaad00635 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:32.314804 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e1fbec3f-c470-459c-81b3-10718c807066 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '422a67aaa9b34c29bd287df35e363529'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:32.315265 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7e1ae-77ea-453e-8fba-f0dbaad00635 service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:32.323286 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e1fbec3f-c470-459c-81b3-10718c807066 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '422a67aaa9b34c29bd287df35e363529'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:32.325048 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 977/1956] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:32.331541 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 980/1957] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:34:32 2022] DELETE /identity/v3/users/422a67aaa9b34c29bd287df35e363529 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:34:32.336623 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca332a7e-ee1d-43af-a560-26e715570774 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:32.336911 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca332a7e-ee1d-43af-a560-26e715570774 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:32.337245 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca332a7e-ee1d-43af-a560-26e715570774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:32.354804 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-ca332a7e-ee1d-43af-a560-26e715570774 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:32.356020 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-ca332a7e-ee1d-43af-a560-26e715570774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:32.431497 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 978/1958] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:34:32.439396 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbec3f-c470-459c-81b3-10718c807066 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:32.442604 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-e1fbec3f-c470-459c-81b3-10718c807066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:32.525369 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbec3f-c470-459c-81b3-10718c807066 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:32.529381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fa6a4-6a8b-4b34-8e75-206e9f85e05f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:32.530074 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fa6a4-6a8b-4b34-8e75-206e9f85e05f service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:32.530360 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fa6a4-6a8b-4b34-8e75-206e9f85e05f service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:32.530641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fa6a4-6a8b-4b34-8e75-206e9f85e05f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:32.541458 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12fa6a4-6a8b-4b34-8e75-206e9f85e05f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:32.543126 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12fa6a4-6a8b-4b34-8e75-206e9f85e05f service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:32.553232 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 981/1959] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:32.923036 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca332a7e-ee1d-43af-a560-26e715570774 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:32.924486 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-ca332a7e-ee1d-43af-a560-26e715570774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:32.936309 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca332a7e-ee1d-43af-a560-26e715570774 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:32.940911 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2725bc-8aba-4528-94f0-488053ca6196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:32.941997 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2725bc-8aba-4528-94f0-488053ca6196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:32.942274 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2725bc-8aba-4528-94f0-488053ca6196 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:32.942652 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2725bc-8aba-4528-94f0-488053ca6196 admin admin] PATH_INFO: `/v3/projects/896b421dbd0e4ac4b576926da45b2053` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:32.946763 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2725bc-8aba-4528-94f0-488053ca6196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=896b421dbd0e4ac4b576926da45b2053)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:32.963622 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2725bc-8aba-4528-94f0-488053ca6196 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:33.011062 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-7a2725bc-8aba-4528-94f0-488053ca6196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '896b421dbd0e4ac4b576926da45b2053', 'request_id': 'req-7a2725bc-8aba-4528-94f0-488053ca6196'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:33.016375 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-7a2725bc-8aba-4528-94f0-488053ca6196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '896b421dbd0e4ac4b576926da45b2053', 'request_id': 'req-7a2725bc-8aba-4528-94f0-488053ca6196'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:33.024557 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-7a2725bc-8aba-4528-94f0-488053ca6196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '896b421dbd0e4ac4b576926da45b2053', 'request_id': 'req-7a2725bc-8aba-4528-94f0-488053ca6196'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:33.035418 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-7a2725bc-8aba-4528-94f0-488053ca6196 admin admin] The token cache is being invalidate because project 896b421dbd0e4ac4b576926da45b2053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:34:33.035699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-7a2725bc-8aba-4528-94f0-488053ca6196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:33.036326 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-7a2725bc-8aba-4528-94f0-488053ca6196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:33.038710 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 979/1960] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:34:32 2022] DELETE /identity/v3/projects/896b421dbd0e4ac4b576926da45b2053 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:33.042507 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fa6a4-6a8b-4b34-8e75-206e9f85e05f service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:33.052555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fa6a4-6a8b-4b34-8e75-206e9f85e05f service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:33.133730 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6d7df-c835-495a-b48e-705f0cd244d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:33.135110 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6d7df-c835-495a-b48e-705f0cd244d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:33.135254 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6d7df-c835-495a-b48e-705f0cd244d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:33.135499 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6d7df-c835-495a-b48e-705f0cd244d0 admin admin] PATH_INFO: `/v3/users/415ec208ee844bedb449c3358766b7de` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:33.136801 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6d7df-c835-495a-b48e-705f0cd244d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=415ec208ee844bedb449c3358766b7de)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:33.140061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6d7df-c835-495a-b48e-705f0cd244d0 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:33.231727 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-34d6d7df-c835-495a-b48e-705f0cd244d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '415ec208ee844bedb449c3358766b7de'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:33.265323 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-34d6d7df-c835-495a-b48e-705f0cd244d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '415ec208ee844bedb449c3358766b7de'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:33.266147 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-34d6d7df-c835-495a-b48e-705f0cd244d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '415ec208ee844bedb449c3358766b7de'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:33.275201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-34d6d7df-c835-495a-b48e-705f0cd244d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '415ec208ee844bedb449c3358766b7de'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:33.283044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-34d6d7df-c835-495a-b48e-705f0cd244d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '415ec208ee844bedb449c3358766b7de'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:33.291582 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 982/1961] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:34:33 2022] DELETE /identity/v3/users/415ec208ee844bedb449c3358766b7de => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:34:33.942873 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2725bc-8aba-4528-94f0-488053ca6196 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:33.945432 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-7a2725bc-8aba-4528-94f0-488053ca6196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:34.034890 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2725bc-8aba-4528-94f0-488053ca6196 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:34.119140 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ba198-d612-4b76-b0c4-d154ffe83969 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:34.119802 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ba198-d612-4b76-b0c4-d154ffe83969 service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:34.120168 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ba198-d612-4b76-b0c4-d154ffe83969 service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:34.120356 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ba198-d612-4b76-b0c4-d154ffe83969 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:34.122436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-622ba198-d612-4b76-b0c4-d154ffe83969 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:34.198638 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ba198-d612-4b76-b0c4-d154ffe83969 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:34.201071 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ba198-d612-4b76-b0c4-d154ffe83969 service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:34.215417 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 980/1962] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:34.743819 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6d7df-c835-495a-b48e-705f0cd244d0 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:34.745260 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-34d6d7df-c835-495a-b48e-705f0cd244d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:34.854275 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6d7df-c835-495a-b48e-705f0cd244d0 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:34.865704 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb350187-b2d3-4e90-b47a-e1d2d3e736ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:34.868411 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb350187-b2d3-4e90-b47a-e1d2d3e736ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:34.868755 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb350187-b2d3-4e90-b47a-e1d2d3e736ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:34.869863 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb350187-b2d3-4e90-b47a-e1d2d3e736ff admin admin] PATH_INFO: `/v3/projects/5f1b1495c43645a49fa3b5c3c187d657` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:34.873056 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb350187-b2d3-4e90-b47a-e1d2d3e736ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f1b1495c43645a49fa3b5c3c187d657)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:34.877335 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb350187-b2d3-4e90-b47a-e1d2d3e736ff admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:34.949174 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-bb350187-b2d3-4e90-b47a-e1d2d3e736ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f1b1495c43645a49fa3b5c3c187d657', 'request_id': 'req-bb350187-b2d3-4e90-b47a-e1d2d3e736ff'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:34.959946 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-bb350187-b2d3-4e90-b47a-e1d2d3e736ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f1b1495c43645a49fa3b5c3c187d657', 'request_id': 'req-bb350187-b2d3-4e90-b47a-e1d2d3e736ff'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:34.968072 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ba198-d612-4b76-b0c4-d154ffe83969 service cinder] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:34.969028 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-bb350187-b2d3-4e90-b47a-e1d2d3e736ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f1b1495c43645a49fa3b5c3c187d657', 'request_id': 'req-bb350187-b2d3-4e90-b47a-e1d2d3e736ff'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:34.969477 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-622ba198-d612-4b76-b0c4-d154ffe83969 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:34.981777 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ba198-d612-4b76-b0c4-d154ffe83969 service cinder] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:34.982340 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-bb350187-b2d3-4e90-b47a-e1d2d3e736ff admin admin] The token cache is being invalidate because project 5f1b1495c43645a49fa3b5c3c187d657 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:34:34.982631 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-bb350187-b2d3-4e90-b47a-e1d2d3e736ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:34.983276 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-bb350187-b2d3-4e90-b47a-e1d2d3e736ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:34.984826 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 983/1963] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:34:34 2022] DELETE /identity/v3/projects/5f1b1495c43645a49fa3b5c3c187d657 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:34.985593 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb350187-b2d3-4e90-b47a-e1d2d3e736ff admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:34.986955 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-bb350187-b2d3-4e90-b47a-e1d2d3e736ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:35.030257 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882121b4-0de0-47a8-ab80-51f89f642ea4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:35.030908 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882121b4-0de0-47a8-ab80-51f89f642ea4 service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:35.031217 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882121b4-0de0-47a8-ab80-51f89f642ea4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:35.031523 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882121b4-0de0-47a8-ab80-51f89f642ea4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:35.033284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-882121b4-0de0-47a8-ab80-51f89f642ea4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:35.041794 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb350187-b2d3-4e90-b47a-e1d2d3e736ff admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:35.045675 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8040a6-ea80-4709-a47b-514dc16d53f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:35.046364 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8040a6-ea80-4709-a47b-514dc16d53f6 service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:35.046645 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8040a6-ea80-4709-a47b-514dc16d53f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:35.046922 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8040a6-ea80-4709-a47b-514dc16d53f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:35.048780 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-ec8040a6-ea80-4709-a47b-514dc16d53f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:35.091698 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882121b4-0de0-47a8-ab80-51f89f642ea4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:35.093153 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882121b4-0de0-47a8-ab80-51f89f642ea4 service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:35.103644 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 981/1964] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:35.104468 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fdea1-ed2d-4f8d-b0aa-23e44b653be2 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:35.104753 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fdea1-ed2d-4f8d-b0aa-23e44b653be2 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:35.105018 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fdea1-ed2d-4f8d-b0aa-23e44b653be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:35.123166 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8040a6-ea80-4709-a47b-514dc16d53f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:35.126125 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8040a6-ea80-4709-a47b-514dc16d53f6 service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:35.133015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-478fdea1-ed2d-4f8d-b0aa-23e44b653be2 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:35.135887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-478fdea1-ed2d-4f8d-b0aa-23e44b653be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:35.139923 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 984/1965] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:35.232065 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 982/1966] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:35.242359 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbf116-c346-459a-bad3-5fd1cdc02dec None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:35.242927 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbf116-c346-459a-bad3-5fd1cdc02dec None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:35.243359 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbf116-c346-459a-bad3-5fd1cdc02dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:35.272969 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-f6dbf116-c346-459a-bad3-5fd1cdc02dec None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:35.274325 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-f6dbf116-c346-459a-bad3-5fd1cdc02dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:35.285727 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 985/1967] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:35.289854 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fdea1-ed2d-4f8d-b0aa-23e44b653be2 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:35.310703 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fdea1-ed2d-4f8d-b0aa-23e44b653be2 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:35.317679 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4fa9e-933a-4d29-9bae-890b69609789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:35.318602 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4fa9e-933a-4d29-9bae-890b69609789 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:35.318997 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4fa9e-933a-4d29-9bae-890b69609789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:35.320149 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4fa9e-933a-4d29-9bae-890b69609789 admin admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:35.320487 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c4fa9e-933a-4d29-9bae-890b69609789 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:34:35.320907 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c4fa9e-933a-4d29-9bae-890b69609789 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:35.323386 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c4fa9e-933a-4d29-9bae-890b69609789 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:35.340710 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 983/1968] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:34:35.344402 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbf116-c346-459a-bad3-5fd1cdc02dec None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:35.355924 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbf116-c346-459a-bad3-5fd1cdc02dec None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:35.363720 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9be31-6008-4486-a962-eb4a68e0a596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:35.364935 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9be31-6008-4486-a962-eb4a68e0a596 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:35.365322 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9be31-6008-4486-a962-eb4a68e0a596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:35.365730 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9be31-6008-4486-a962-eb4a68e0a596 admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:35.366919 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9be31-6008-4486-a962-eb4a68e0a596 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:35.368970 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9be31-6008-4486-a962-eb4a68e0a596 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:35.409833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 986/1969] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:34:35 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:35.414521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4fa9e-933a-4d29-9bae-890b69609789 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:35.427210 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4fa9e-933a-4d29-9bae-890b69609789 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:35.542413 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32862a61-3961-4c37-9692-64ccc045fbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:35.543260 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32862a61-3961-4c37-9692-64ccc045fbcd admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:35.544229 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32862a61-3961-4c37-9692-64ccc045fbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:35.544853 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32862a61-3961-4c37-9692-64ccc045fbcd admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:35.545773 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32862a61-3961-4c37-9692-64ccc045fbcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:35.549346 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32862a61-3961-4c37-9692-64ccc045fbcd admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:35.590076 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 984/1970] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:34:35 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:34:35.594352 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9be31-6008-4486-a962-eb4a68e0a596 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:35.612878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9be31-6008-4486-a962-eb4a68e0a596 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:35.619996 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3bdd7-e793-4cbb-b49f-de58f3ddbf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:35.621268 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3bdd7-e793-4cbb-b49f-de58f3ddbf22 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:35.622378 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3bdd7-e793-4cbb-b49f-de58f3ddbf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:35.623076 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3bdd7-e793-4cbb-b49f-de58f3ddbf22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:35.624017 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3bdd7-e793-4cbb-b49f-de58f3ddbf22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:35.627478 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3bdd7-e793-4cbb-b49f-de58f3ddbf22 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:35.645359 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 987/1971] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:35.649936 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32862a61-3961-4c37-9692-64ccc045fbcd admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:35.664516 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32862a61-3961-4c37-9692-64ccc045fbcd admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:35.671030 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9c915-c1b0-4436-b529-cde6a74da804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:35.672181 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9c915-c1b0-4436-b529-cde6a74da804 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:35.672667 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9c915-c1b0-4436-b529-cde6a74da804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:35.673295 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9c915-c1b0-4436-b529-cde6a74da804 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:35.674644 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9c915-c1b0-4436-b529-cde6a74da804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:35.676726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9c915-c1b0-4436-b529-cde6a74da804 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:35.698965 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 985/1972] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:35.700875 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3bdd7-e793-4cbb-b49f-de58f3ddbf22 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:35.719185 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3bdd7-e793-4cbb-b49f-de58f3ddbf22 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:35.727443 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8af61c-c56e-468c-a8e0-b4c6a5421332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:35.728367 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8af61c-c56e-468c-a8e0-b4c6a5421332 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:35.728647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8af61c-c56e-468c-a8e0-b4c6a5421332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:35.728924 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8af61c-c56e-468c-a8e0-b4c6a5421332 admin admin] PATH_INFO: `/v3/projects/5338e4ba741c47c18b7fa2a8d72c07f9/users/952c745ed8f447b991c7a1cf95c322d0/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:35.747834 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8af61c-c56e-468c-a8e0-b4c6a5421332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5338e4ba741c47c18b7fa2a8d72c07f9, user_id=952c745ed8f447b991c7a1cf95c322d0, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:35.751262 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8af61c-c56e-468c-a8e0-b4c6a5421332 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:35.767940 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 988/1973] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:35 2022] PUT /identity/v3/projects/5338e4ba741c47c18b7fa2a8d72c07f9/users/952c745ed8f447b991c7a1cf95c322d0/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:35.780717 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7fb59-f84c-4ada-87d7-d14b92195f71 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:35.781097 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7fb59-f84c-4ada-87d7-d14b92195f71 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:35.781576 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7fb59-f84c-4ada-87d7-d14b92195f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:35.816891 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-a1a7fb59-f84c-4ada-87d7-d14b92195f71 None None] MFA Rules not processed for user `952c745ed8f447b991c7a1cf95c322d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:35.818235 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-a1a7fb59-f84c-4ada-87d7-d14b92195f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:35.986345 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 986/1974] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:35.989333 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8af61c-c56e-468c-a8e0-b4c6a5421332 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:36.103254 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8af61c-c56e-468c-a8e0-b4c6a5421332 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:36.108282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90548210-a358-4354-a3ae-2cc81fa3edeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:36.109157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90548210-a358-4354-a3ae-2cc81fa3edeb admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:36.109595 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90548210-a358-4354-a3ae-2cc81fa3edeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:36.110138 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90548210-a358-4354-a3ae-2cc81fa3edeb admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:36.110997 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90548210-a358-4354-a3ae-2cc81fa3edeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:36.113061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90548210-a358-4354-a3ae-2cc81fa3edeb admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:36.172897 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 989/1975] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:34:35 2022] POST /identity/v3/projects => generated 377 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:34:36.175246 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7fb59-f84c-4ada-87d7-d14b92195f71 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:36.216155 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7fb59-f84c-4ada-87d7-d14b92195f71 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:36.337890 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0635b16-974f-4382-99b0-097dc3929dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:36.357021 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0635b16-974f-4382-99b0-097dc3929dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:36.359357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0635b16-974f-4382-99b0-097dc3929dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:36.365030 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0635b16-974f-4382-99b0-097dc3929dc4 admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:36.387328 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0635b16-974f-4382-99b0-097dc3929dc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:36.395179 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0635b16-974f-4382-99b0-097dc3929dc4 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:36.443494 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 987/1976] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:34:36 2022] POST /identity/v3/users => generated 295 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:36.448115 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90548210-a358-4354-a3ae-2cc81fa3edeb admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:36.464754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90548210-a358-4354-a3ae-2cc81fa3edeb admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:36.477209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010db37-e5dc-43b9-b791-470d45d56f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:36.478108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010db37-e5dc-43b9-b791-470d45d56f67 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:36.478493 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010db37-e5dc-43b9-b791-470d45d56f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:36.478887 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010db37-e5dc-43b9-b791-470d45d56f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:36.479794 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010db37-e5dc-43b9-b791-470d45d56f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:36.486145 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010db37-e5dc-43b9-b791-470d45d56f67 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:36.525465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 990/1977] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:36.526635 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0635b16-974f-4382-99b0-097dc3929dc4 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:36.555061 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0635b16-974f-4382-99b0-097dc3929dc4 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:36.564085 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa8a16-c20d-4aa4-9f1b-9b325e5ceb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:36.565769 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa8a16-c20d-4aa4-9f1b-9b325e5ceb51 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:36.566368 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa8a16-c20d-4aa4-9f1b-9b325e5ceb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:36.566979 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa8a16-c20d-4aa4-9f1b-9b325e5ceb51 admin admin] PATH_INFO: `/v3/projects/e8a4e10d77ce4070989981f6bd442764/users/90051f2983f34bd68f0bdb5cb7c81a44/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:36.595637 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa8a16-c20d-4aa4-9f1b-9b325e5ceb51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8a4e10d77ce4070989981f6bd442764, user_id=90051f2983f34bd68f0bdb5cb7c81a44, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:36.600195 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa8a16-c20d-4aa4-9f1b-9b325e5ceb51 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:36.621349 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 988/1978] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:36 2022] PUT /identity/v3/projects/e8a4e10d77ce4070989981f6bd442764/users/90051f2983f34bd68f0bdb5cb7c81a44/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:36.625211 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010db37-e5dc-43b9-b791-470d45d56f67 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:36.640573 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010db37-e5dc-43b9-b791-470d45d56f67 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:36.749866 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212f473-6d29-4c37-b137-d9f132f605f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:36.751872 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212f473-6d29-4c37-b137-d9f132f605f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:36.753073 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212f473-6d29-4c37-b137-d9f132f605f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:36.753503 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212f473-6d29-4c37-b137-d9f132f605f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:36.754445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212f473-6d29-4c37-b137-d9f132f605f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:36.757789 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212f473-6d29-4c37-b137-d9f132f605f4 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:36.781968 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 991/1979] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:36.785928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa8a16-c20d-4aa4-9f1b-9b325e5ceb51 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:36.800536 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa8a16-c20d-4aa4-9f1b-9b325e5ceb51 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:36.822695 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5ef8f-822a-49d3-9eb0-d82967ed4f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:36.825153 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5ef8f-822a-49d3-9eb0-d82967ed4f0e admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:36.825446 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5ef8f-822a-49d3-9eb0-d82967ed4f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:36.825728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5ef8f-822a-49d3-9eb0-d82967ed4f0e admin admin] PATH_INFO: `/v3/projects/e8a4e10d77ce4070989981f6bd442764/users/90051f2983f34bd68f0bdb5cb7c81a44/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:36.831501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5ef8f-822a-49d3-9eb0-d82967ed4f0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8a4e10d77ce4070989981f6bd442764, user_id=90051f2983f34bd68f0bdb5cb7c81a44, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:36.833711 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5ef8f-822a-49d3-9eb0-d82967ed4f0e admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:36.854163 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 989/1980] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:36 2022] PUT /identity/v3/projects/e8a4e10d77ce4070989981f6bd442764/users/90051f2983f34bd68f0bdb5cb7c81a44/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:36.860308 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900646b-042d-4dac-aba5-8aea65a9f14b None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:36.860600 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900646b-042d-4dac-aba5-8aea65a9f14b None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:36.860870 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900646b-042d-4dac-aba5-8aea65a9f14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:36.904722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-8900646b-042d-4dac-aba5-8aea65a9f14b None None] MFA Rules not processed for user `90051f2983f34bd68f0bdb5cb7c81a44`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:36.906154 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-8900646b-042d-4dac-aba5-8aea65a9f14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:36.990857 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 992/1981] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:36 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:37.007769 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5ef8f-822a-49d3-9eb0-d82967ed4f0e admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:37.093241 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5ef8f-822a-49d3-9eb0-d82967ed4f0e admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:37.097251 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce8dec-a220-4261-8fdb-eadb31a50d03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:37.098374 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce8dec-a220-4261-8fdb-eadb31a50d03 service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:37.098627 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce8dec-a220-4261-8fdb-eadb31a50d03 service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:37.098899 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce8dec-a220-4261-8fdb-eadb31a50d03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:37.165229 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce8dec-a220-4261-8fdb-eadb31a50d03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:37.166714 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce8dec-a220-4261-8fdb-eadb31a50d03 service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:37.175938 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 990/1982] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:37.901667 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900646b-042d-4dac-aba5-8aea65a9f14b None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:37.903263 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-8900646b-042d-4dac-aba5-8aea65a9f14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:38.021400 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900646b-042d-4dac-aba5-8aea65a9f14b None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:38.035681 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8a6fe-6e95-4767-ac06-23bd74c082b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:38.036592 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8a6fe-6e95-4767-ac06-23bd74c082b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:38.036878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8a6fe-6e95-4767-ac06-23bd74c082b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:38.037152 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8a6fe-6e95-4767-ac06-23bd74c082b6 admin admin] PATH_INFO: `/v3/users/188d908ef11e42b4a558553678e97f9e` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:38.041095 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8a6fe-6e95-4767-ac06-23bd74c082b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=188d908ef11e42b4a558553678e97f9e)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:38.043099 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8a6fe-6e95-4767-ac06-23bd74c082b6 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:38.125323 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-a5f8a6fe-6e95-4767-ac06-23bd74c082b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '188d908ef11e42b4a558553678e97f9e'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:38.138874 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-a5f8a6fe-6e95-4767-ac06-23bd74c082b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '188d908ef11e42b4a558553678e97f9e'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:38.140343 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-a5f8a6fe-6e95-4767-ac06-23bd74c082b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '188d908ef11e42b4a558553678e97f9e'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:38.148548 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-a5f8a6fe-6e95-4767-ac06-23bd74c082b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '188d908ef11e42b4a558553678e97f9e'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:38.156865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-a5f8a6fe-6e95-4767-ac06-23bd74c082b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '188d908ef11e42b4a558553678e97f9e'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:38.179370 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 993/1983] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:34:37 2022] DELETE /identity/v3/users/188d908ef11e42b4a558553678e97f9e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:38.183804 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96c220-7bfb-4d7b-8038-aa677aa3baa4 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:38.184289 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96c220-7bfb-4d7b-8038-aa677aa3baa4 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:38.184400 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96c220-7bfb-4d7b-8038-aa677aa3baa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:38.213494 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-3b96c220-7bfb-4d7b-8038-aa677aa3baa4 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:38.215584 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-3b96c220-7bfb-4d7b-8038-aa677aa3baa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:38.309225 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 991/1984] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:38.324932 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8a6fe-6e95-4767-ac06-23bd74c082b6 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:38.326445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-a5f8a6fe-6e95-4767-ac06-23bd74c082b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:38.426499 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8a6fe-6e95-4767-ac06-23bd74c082b6 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:38.448481 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb5d24-61b8-43fe-adc0-08b13f1fc0b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:38.449373 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb5d24-61b8-43fe-adc0-08b13f1fc0b1 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:38.449833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb5d24-61b8-43fe-adc0-08b13f1fc0b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:38.450118 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb5d24-61b8-43fe-adc0-08b13f1fc0b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:38.462518 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb5d24-61b8-43fe-adc0-08b13f1fc0b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:38.464028 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb5d24-61b8-43fe-adc0-08b13f1fc0b1 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:38.479204 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 994/1985] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:38.970772 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96c220-7bfb-4d7b-8038-aa677aa3baa4 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:38.972299 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-3b96c220-7bfb-4d7b-8038-aa677aa3baa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:38.986739 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96c220-7bfb-4d7b-8038-aa677aa3baa4 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:38.991487 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8880ce7-d976-4ba7-aec8-c69190aa1139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:38.992374 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8880ce7-d976-4ba7-aec8-c69190aa1139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:38.992628 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8880ce7-d976-4ba7-aec8-c69190aa1139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:38.992909 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8880ce7-d976-4ba7-aec8-c69190aa1139 admin admin] PATH_INFO: `/v3/projects/155ecd4ebf26498886794f21e24506de` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:38.994864 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8880ce7-d976-4ba7-aec8-c69190aa1139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=155ecd4ebf26498886794f21e24506de)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:38.996829 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8880ce7-d976-4ba7-aec8-c69190aa1139 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:39.046753 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f8880ce7-d976-4ba7-aec8-c69190aa1139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '155ecd4ebf26498886794f21e24506de', 'request_id': 'req-f8880ce7-d976-4ba7-aec8-c69190aa1139'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:39.052291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f8880ce7-d976-4ba7-aec8-c69190aa1139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '155ecd4ebf26498886794f21e24506de', 'request_id': 'req-f8880ce7-d976-4ba7-aec8-c69190aa1139'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:39.060712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f8880ce7-d976-4ba7-aec8-c69190aa1139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '155ecd4ebf26498886794f21e24506de', 'request_id': 'req-f8880ce7-d976-4ba7-aec8-c69190aa1139'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:39.072226 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f8880ce7-d976-4ba7-aec8-c69190aa1139 admin admin] The token cache is being invalidate because project 155ecd4ebf26498886794f21e24506de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:34:39.072509 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f8880ce7-d976-4ba7-aec8-c69190aa1139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:39.073129 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f8880ce7-d976-4ba7-aec8-c69190aa1139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:39.074684 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 992/1986] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:34:38 2022] DELETE /identity/v3/projects/155ecd4ebf26498886794f21e24506de => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:39.080727 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb5d24-61b8-43fe-adc0-08b13f1fc0b1 service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:39.090295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb5d24-61b8-43fe-adc0-08b13f1fc0b1 service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:39.150837 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5136abe-b408-4747-8331-bdd1b971a63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:39.152026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5136abe-b408-4747-8331-bdd1b971a63c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:39.152278 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5136abe-b408-4747-8331-bdd1b971a63c admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:39.152557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5136abe-b408-4747-8331-bdd1b971a63c admin admin] PATH_INFO: `/v3/users/2e59813f8d78462d8dc897bf0916da95` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:39.153733 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5136abe-b408-4747-8331-bdd1b971a63c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e59813f8d78462d8dc897bf0916da95)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:39.155656 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5136abe-b408-4747-8331-bdd1b971a63c admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:39.205452 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-b5136abe-b408-4747-8331-bdd1b971a63c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e59813f8d78462d8dc897bf0916da95'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:39.217799 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-b5136abe-b408-4747-8331-bdd1b971a63c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e59813f8d78462d8dc897bf0916da95'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:39.218472 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-b5136abe-b408-4747-8331-bdd1b971a63c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e59813f8d78462d8dc897bf0916da95'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:39.227275 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-b5136abe-b408-4747-8331-bdd1b971a63c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e59813f8d78462d8dc897bf0916da95'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:39.234638 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-b5136abe-b408-4747-8331-bdd1b971a63c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e59813f8d78462d8dc897bf0916da95'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:39.240659 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 995/1987] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:34:39 2022] DELETE /identity/v3/users/2e59813f8d78462d8dc897bf0916da95 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:39.592663 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8880ce7-d976-4ba7-aec8-c69190aa1139 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:39.595716 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-f8880ce7-d976-4ba7-aec8-c69190aa1139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:39.614087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8880ce7-d976-4ba7-aec8-c69190aa1139 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:39.629712 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5136abe-b408-4747-8331-bdd1b971a63c admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:39.631835 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-b5136abe-b408-4747-8331-bdd1b971a63c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:39.723437 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2795314-1949-4ada-9b70-c2810d3ce9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:39.724599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2795314-1949-4ada-9b70-c2810d3ce9bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:39.725072 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2795314-1949-4ada-9b70-c2810d3ce9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:39.726080 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2795314-1949-4ada-9b70-c2810d3ce9bd admin admin] PATH_INFO: `/v3/users/d0acf2ba5c154ff2a848bec27043744a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:39.727518 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2795314-1949-4ada-9b70-c2810d3ce9bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0acf2ba5c154ff2a848bec27043744a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:39.734223 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2795314-1949-4ada-9b70-c2810d3ce9bd admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:39.743819 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5136abe-b408-4747-8331-bdd1b971a63c admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:39.748980 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2962cd3-915f-4f68-aa31-265f0d9aac27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:39.749857 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2962cd3-915f-4f68-aa31-265f0d9aac27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:39.750171 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2962cd3-915f-4f68-aa31-265f0d9aac27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:39.750446 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2962cd3-915f-4f68-aa31-265f0d9aac27 admin admin] PATH_INFO: `/v3/projects/0a572cce879e42488a00fbb1153d8b8e` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:39.753033 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2962cd3-915f-4f68-aa31-265f0d9aac27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a572cce879e42488a00fbb1153d8b8e)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:39.755298 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2962cd3-915f-4f68-aa31-265f0d9aac27 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:39.791159 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d2795314-1949-4ada-9b70-c2810d3ce9bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0acf2ba5c154ff2a848bec27043744a'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:39.807754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d2795314-1949-4ada-9b70-c2810d3ce9bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0acf2ba5c154ff2a848bec27043744a'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:39.808699 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d2795314-1949-4ada-9b70-c2810d3ce9bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0acf2ba5c154ff2a848bec27043744a'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:39.817502 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-c2962cd3-915f-4f68-aa31-265f0d9aac27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a572cce879e42488a00fbb1153d8b8e', 'request_id': 'req-c2962cd3-915f-4f68-aa31-265f0d9aac27'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:39.826977 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-c2962cd3-915f-4f68-aa31-265f0d9aac27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a572cce879e42488a00fbb1153d8b8e', 'request_id': 'req-c2962cd3-915f-4f68-aa31-265f0d9aac27'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:39.835856 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d2795314-1949-4ada-9b70-c2810d3ce9bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0acf2ba5c154ff2a848bec27043744a'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:39.843682 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-c2962cd3-915f-4f68-aa31-265f0d9aac27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a572cce879e42488a00fbb1153d8b8e', 'request_id': 'req-c2962cd3-915f-4f68-aa31-265f0d9aac27'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:39.853488 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d2795314-1949-4ada-9b70-c2810d3ce9bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0acf2ba5c154ff2a848bec27043744a'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:39.859248 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-c2962cd3-915f-4f68-aa31-265f0d9aac27 admin admin] The token cache is being invalidate because project 0a572cce879e42488a00fbb1153d8b8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:34:39.859585 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-c2962cd3-915f-4f68-aa31-265f0d9aac27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:39.860499 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-c2962cd3-915f-4f68-aa31-265f0d9aac27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:39.865127 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 993/1989] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:34:39 2022] DELETE /identity/v3/users/d0acf2ba5c154ff2a848bec27043744a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:39.866673 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 996/1989] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:34:39 2022] DELETE /identity/v3/projects/0a572cce879e42488a00fbb1153d8b8e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:34:39.866887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2795314-1949-4ada-9b70-c2810d3ce9bd admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:39.868686 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9a60c-8bd6-47f7-aaae-07e989f3179a None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:39.869289 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9a60c-8bd6-47f7-aaae-07e989f3179a None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:39.869615 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9a60c-8bd6-47f7-aaae-07e989f3179a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:39.869855 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-d2795314-1949-4ada-9b70-c2810d3ce9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:39.899042 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-86b9a60c-8bd6-47f7-aaae-07e989f3179a None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:39.900655 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-86b9a60c-8bd6-47f7-aaae-07e989f3179a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:39.970631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2795314-1949-4ada-9b70-c2810d3ce9bd admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:39.979886 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 997/1990] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:39.982789 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcebf3-cd50-4c1c-8524-497de0c11642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:39.983844 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcebf3-cd50-4c1c-8524-497de0c11642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:39.983942 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcebf3-cd50-4c1c-8524-497de0c11642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:39.984220 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcebf3-cd50-4c1c-8524-497de0c11642 admin admin] PATH_INFO: `/v3/users/f16f769632ac41fca9124197735dcd70` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:39.985484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfcebf3-cd50-4c1c-8524-497de0c11642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f16f769632ac41fca9124197735dcd70)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:39.987443 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfcebf3-cd50-4c1c-8524-497de0c11642 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:39.990819 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9a60c-8bd6-47f7-aaae-07e989f3179a None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:39.991682 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-86b9a60c-8bd6-47f7-aaae-07e989f3179a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:40.056542 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-0bfcebf3-cd50-4c1c-8524-497de0c11642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f16f769632ac41fca9124197735dcd70'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:40.059917 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9a60c-8bd6-47f7-aaae-07e989f3179a None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:40.063924 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6169b-af3e-4f9e-ac1e-84a6bf5086c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:40.064588 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6169b-af3e-4f9e-ac1e-84a6bf5086c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:40.064865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6169b-af3e-4f9e-ac1e-84a6bf5086c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:40.065155 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6169b-af3e-4f9e-ac1e-84a6bf5086c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:40.071858 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-0bfcebf3-cd50-4c1c-8524-497de0c11642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f16f769632ac41fca9124197735dcd70'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:40.072565 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-0bfcebf3-cd50-4c1c-8524-497de0c11642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f16f769632ac41fca9124197735dcd70'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:40.075243 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a6169b-af3e-4f9e-ac1e-84a6bf5086c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:40.077067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a6169b-af3e-4f9e-ac1e-84a6bf5086c9 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:40.082097 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-0bfcebf3-cd50-4c1c-8524-497de0c11642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f16f769632ac41fca9124197735dcd70'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:40.087820 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 998/1991] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:40.089971 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-0bfcebf3-cd50-4c1c-8524-497de0c11642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f16f769632ac41fca9124197735dcd70'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:40.108054 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 994/1992] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:34:39 2022] DELETE /identity/v3/users/f16f769632ac41fca9124197735dcd70 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:40.405491 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6169b-af3e-4f9e-ac1e-84a6bf5086c9 service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:40.407834 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-b6a6169b-af3e-4f9e-ac1e-84a6bf5086c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:40.424805 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6169b-af3e-4f9e-ac1e-84a6bf5086c9 service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:40.454407 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcebf3-cd50-4c1c-8524-497de0c11642 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:40.455966 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-0bfcebf3-cd50-4c1c-8524-497de0c11642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:40.491867 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75a154-10f8-41c7-91cd-a25246e2183c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:40.492737 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75a154-10f8-41c7-91cd-a25246e2183c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:40.493015 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75a154-10f8-41c7-91cd-a25246e2183c admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:40.493287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75a154-10f8-41c7-91cd-a25246e2183c admin admin] PATH_INFO: `/v3/projects/cbf41ee78db54b7aa8543ca7a4a31c27` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:40.494582 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75a154-10f8-41c7-91cd-a25246e2183c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbf41ee78db54b7aa8543ca7a4a31c27)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:40.496478 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75a154-10f8-41c7-91cd-a25246e2183c admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:40.523518 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcebf3-cd50-4c1c-8524-497de0c11642 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:40.528472 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3b0fc-68dc-45aa-a27a-1a4f97f8585d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:40.529366 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3b0fc-68dc-45aa-a27a-1a4f97f8585d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:40.529648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3b0fc-68dc-45aa-a27a-1a4f97f8585d admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:40.529948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3b0fc-68dc-45aa-a27a-1a4f97f8585d admin admin] PATH_INFO: `/v3/projects/887a7b553f9f40b2ba2487d0bee86bb5` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:40.531142 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3b0fc-68dc-45aa-a27a-1a4f97f8585d admin admin] RBAC: Authorizing `identity:delete_project(project_id=887a7b553f9f40b2ba2487d0bee86bb5)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:40.533081 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3b0fc-68dc-45aa-a27a-1a4f97f8585d admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:40.543443 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-7c75a154-10f8-41c7-91cd-a25246e2183c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbf41ee78db54b7aa8543ca7a4a31c27', 'request_id': 'req-7c75a154-10f8-41c7-91cd-a25246e2183c'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:40.548961 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-7c75a154-10f8-41c7-91cd-a25246e2183c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbf41ee78db54b7aa8543ca7a4a31c27', 'request_id': 'req-7c75a154-10f8-41c7-91cd-a25246e2183c'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:40.557591 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-7c75a154-10f8-41c7-91cd-a25246e2183c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbf41ee78db54b7aa8543ca7a4a31c27', 'request_id': 'req-7c75a154-10f8-41c7-91cd-a25246e2183c'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:40.569055 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-7c75a154-10f8-41c7-91cd-a25246e2183c admin admin] The token cache is being invalidate because project cbf41ee78db54b7aa8543ca7a4a31c27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:34:40.569340 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-7c75a154-10f8-41c7-91cd-a25246e2183c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:40.569990 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-7c75a154-10f8-41c7-91cd-a25246e2183c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:40.571517 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 999/1993] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:34:40 2022] DELETE /identity/v3/projects/cbf41ee78db54b7aa8543ca7a4a31c27 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:40.575270 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75a154-10f8-41c7-91cd-a25246e2183c admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:40.576531 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-7c75a154-10f8-41c7-91cd-a25246e2183c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:40.581519 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e7b3b0fc-68dc-45aa-a27a-1a4f97f8585d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '887a7b553f9f40b2ba2487d0bee86bb5', 'request_id': 'req-e7b3b0fc-68dc-45aa-a27a-1a4f97f8585d'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:40.588662 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e7b3b0fc-68dc-45aa-a27a-1a4f97f8585d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '887a7b553f9f40b2ba2487d0bee86bb5', 'request_id': 'req-e7b3b0fc-68dc-45aa-a27a-1a4f97f8585d'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:40.596157 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e7b3b0fc-68dc-45aa-a27a-1a4f97f8585d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '887a7b553f9f40b2ba2487d0bee86bb5', 'request_id': 'req-e7b3b0fc-68dc-45aa-a27a-1a4f97f8585d'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:40.608360 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e7b3b0fc-68dc-45aa-a27a-1a4f97f8585d admin admin] The token cache is being invalidate because project 887a7b553f9f40b2ba2487d0bee86bb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:34:40.608667 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e7b3b0fc-68dc-45aa-a27a-1a4f97f8585d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:40.609336 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e7b3b0fc-68dc-45aa-a27a-1a4f97f8585d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:40.612136 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 995/1994] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:34:40 2022] DELETE /identity/v3/projects/887a7b553f9f40b2ba2487d0bee86bb5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:40.618013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5dbaf-3702-45bb-87a2-cb78aa982107 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:40.618306 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5dbaf-3702-45bb-87a2-cb78aa982107 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:40.618586 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5dbaf-3702-45bb-87a2-cb78aa982107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:40.636201 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-d4b5dbaf-3702-45bb-87a2-cb78aa982107 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:40.637388 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-d4b5dbaf-3702-45bb-87a2-cb78aa982107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:40.641269 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75a154-10f8-41c7-91cd-a25246e2183c admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:40.697785 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376b426-1ca4-4244-a489-e1f01feb4a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:40.698373 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 996/1995] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:34:40.698803 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376b426-1ca4-4244-a489-e1f01feb4a83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:40.699156 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376b426-1ca4-4244-a489-e1f01feb4a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:40.699441 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376b426-1ca4-4244-a489-e1f01feb4a83 admin admin] PATH_INFO: `/v3/users/924412694dd64e3dbb3a6cb29d48a88a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:40.700671 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376b426-1ca4-4244-a489-e1f01feb4a83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=924412694dd64e3dbb3a6cb29d48a88a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:40.702631 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376b426-1ca4-4244-a489-e1f01feb4a83 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:40.706811 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d2e30-f96d-4217-8b87-ec863ef4ee22 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:40.707102 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d2e30-f96d-4217-8b87-ec863ef4ee22 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:40.707380 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d2e30-f96d-4217-8b87-ec863ef4ee22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:40.726192 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-da3d2e30-f96d-4217-8b87-ec863ef4ee22 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:40.727417 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-da3d2e30-f96d-4217-8b87-ec863ef4ee22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:40.736161 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 997/1996] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:34:40.741445 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d2e30-f96d-4217-8b87-ec863ef4ee22 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:40.750150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-8376b426-1ca4-4244-a489-e1f01feb4a83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '924412694dd64e3dbb3a6cb29d48a88a'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:40.750317 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d2e30-f96d-4217-8b87-ec863ef4ee22 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:40.755198 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0eea9-2b44-472e-870c-5999304fbf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:40.755853 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0eea9-2b44-472e-870c-5999304fbf83 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:40.756132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0eea9-2b44-472e-870c-5999304fbf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:40.756402 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0eea9-2b44-472e-870c-5999304fbf83 admin admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:40.757153 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0eea9-2b44-472e-870c-5999304fbf83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:34:40.757458 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0eea9-2b44-472e-870c-5999304fbf83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:40.759327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0eea9-2b44-472e-870c-5999304fbf83 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:40.766699 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-8376b426-1ca4-4244-a489-e1f01feb4a83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '924412694dd64e3dbb3a6cb29d48a88a'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:40.767435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-8376b426-1ca4-4244-a489-e1f01feb4a83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '924412694dd64e3dbb3a6cb29d48a88a'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:40.771061 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 998/1997] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:34:40.775737 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0eea9-2b44-472e-870c-5999304fbf83 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:40.777045 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-8376b426-1ca4-4244-a489-e1f01feb4a83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '924412694dd64e3dbb3a6cb29d48a88a'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:40.784549 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-8376b426-1ca4-4244-a489-e1f01feb4a83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '924412694dd64e3dbb3a6cb29d48a88a'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:40.785177 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0eea9-2b44-472e-870c-5999304fbf83 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:40.790384 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75bbbe-9b38-427f-bdd7-bcc3e04448d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:40.791030 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75bbbe-9b38-427f-bdd7-bcc3e04448d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:40.791310 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75bbbe-9b38-427f-bdd7-bcc3e04448d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:40.791586 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75bbbe-9b38-427f-bdd7-bcc3e04448d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:40.794907 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac75bbbe-9b38-427f-bdd7-bcc3e04448d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:40.795031 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1000/1998] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:34:40 2022] DELETE /identity/v3/users/924412694dd64e3dbb3a6cb29d48a88a => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:34:40.795144 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac75bbbe-9b38-427f-bdd7-bcc3e04448d2 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:40.822912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 999/1999] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:34:40 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:34:40.826958 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376b426-1ca4-4244-a489-e1f01feb4a83 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:40.828378 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-8376b426-1ca4-4244-a489-e1f01feb4a83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:40.899638 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376b426-1ca4-4244-a489-e1f01feb4a83 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:40.971199 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efee555-8a48-4a34-9b0b-34dd4fe9f0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:40.971891 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efee555-8a48-4a34-9b0b-34dd4fe9f0a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:40.972192 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efee555-8a48-4a34-9b0b-34dd4fe9f0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:40.972453 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efee555-8a48-4a34-9b0b-34dd4fe9f0a8 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:40.973152 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efee555-8a48-4a34-9b0b-34dd4fe9f0a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:40.976230 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efee555-8a48-4a34-9b0b-34dd4fe9f0a8 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:41.000824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1001/2000] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:34:40 2022] POST /identity/v3/users => generated 296 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:34:41.002102 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75bbbe-9b38-427f-bdd7-bcc3e04448d2 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:41.014065 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75bbbe-9b38-427f-bdd7-bcc3e04448d2 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:41.018917 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5e51e-e829-4b17-a178-aec3f4a6b70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:41.019574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5e51e-e829-4b17-a178-aec3f4a6b70c admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:41.019852 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5e51e-e829-4b17-a178-aec3f4a6b70c admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:41.020123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5e51e-e829-4b17-a178-aec3f4a6b70c admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:41.020838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea5e51e-e829-4b17-a178-aec3f4a6b70c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:41.023053 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea5e51e-e829-4b17-a178-aec3f4a6b70c admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:41.033093 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1000/2001] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:41.036804 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efee555-8a48-4a34-9b0b-34dd4fe9f0a8 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:41.046851 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efee555-8a48-4a34-9b0b-34dd4fe9f0a8 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:41.051959 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d01a1-f33e-4e6b-875b-5683b5a1deb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:41.052633 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d01a1-f33e-4e6b-875b-5683b5a1deb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:41.052966 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d01a1-f33e-4e6b-875b-5683b5a1deb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:41.053169 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d01a1-f33e-4e6b-875b-5683b5a1deb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:41.053952 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d01a1-f33e-4e6b-875b-5683b5a1deb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:41.055528 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d01a1-f33e-4e6b-875b-5683b5a1deb1 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:41.066903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1002/2002] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:41.071681 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5e51e-e829-4b17-a178-aec3f4a6b70c admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:41.082039 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5e51e-e829-4b17-a178-aec3f4a6b70c admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:41.088052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac743737-673d-47b1-8388-edb958dc3e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:41.089009 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac743737-673d-47b1-8388-edb958dc3e51 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:41.089289 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac743737-673d-47b1-8388-edb958dc3e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:41.089560 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac743737-673d-47b1-8388-edb958dc3e51 admin admin] PATH_INFO: `/v3/projects/1b6d7d04b2e541c490aba75d53c9609e/users/f2d43d0fedd54bd5899da96c93c99c1c/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:41.106087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac743737-673d-47b1-8388-edb958dc3e51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b6d7d04b2e541c490aba75d53c9609e, user_id=f2d43d0fedd54bd5899da96c93c99c1c, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:41.108878 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac743737-673d-47b1-8388-edb958dc3e51 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:41.125233 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1001/2003] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:41 2022] PUT /identity/v3/projects/1b6d7d04b2e541c490aba75d53c9609e/users/f2d43d0fedd54bd5899da96c93c99c1c/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:41.137357 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ce076-e71b-4453-85d4-8afd816d7ee4 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:41.137933 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ce076-e71b-4453-85d4-8afd816d7ee4 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:41.138049 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ce076-e71b-4453-85d4-8afd816d7ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:41.169571 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-4d5ce076-e71b-4453-85d4-8afd816d7ee4 None None] MFA Rules not processed for user `f2d43d0fedd54bd5899da96c93c99c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:41.171318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-4d5ce076-e71b-4453-85d4-8afd816d7ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:41.190228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac743737-673d-47b1-8388-edb958dc3e51 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:41.192562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-ac743737-673d-47b1-8388-edb958dc3e51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:41.259269 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1003/2004] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:41.264211 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ce076-e71b-4453-85d4-8afd816d7ee4 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:41.286938 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac743737-673d-47b1-8388-edb958dc3e51 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:41.292103 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd114d0-ff36-4d57-8eee-cc03ede809d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:41.292951 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd114d0-ff36-4d57-8eee-cc03ede809d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:41.293388 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd114d0-ff36-4d57-8eee-cc03ede809d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:41.293860 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd114d0-ff36-4d57-8eee-cc03ede809d1 admin admin] PATH_INFO: `/v3/projects/08ef2be518b04e46b90364024d061e48` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:41.295087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd114d0-ff36-4d57-8eee-cc03ede809d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08ef2be518b04e46b90364024d061e48)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:41.296968 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd114d0-ff36-4d57-8eee-cc03ede809d1 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:41.329232 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ce076-e71b-4453-85d4-8afd816d7ee4 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:41.336160 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f973bca-a2e0-457e-a116-b270b325caf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:41.336909 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f973bca-a2e0-457e-a116-b270b325caf3 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:41.337214 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f973bca-a2e0-457e-a116-b270b325caf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:41.337487 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f973bca-a2e0-457e-a116-b270b325caf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:41.338279 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f973bca-a2e0-457e-a116-b270b325caf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:41.340222 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f973bca-a2e0-457e-a116-b270b325caf3 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:41.345122 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-8fd114d0-ff36-4d57-8eee-cc03ede809d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08ef2be518b04e46b90364024d061e48', 'request_id': 'req-8fd114d0-ff36-4d57-8eee-cc03ede809d1'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:41.352312 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-8fd114d0-ff36-4d57-8eee-cc03ede809d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08ef2be518b04e46b90364024d061e48', 'request_id': 'req-8fd114d0-ff36-4d57-8eee-cc03ede809d1'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:41.360845 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-8fd114d0-ff36-4d57-8eee-cc03ede809d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08ef2be518b04e46b90364024d061e48', 'request_id': 'req-8fd114d0-ff36-4d57-8eee-cc03ede809d1'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:41.372332 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-8fd114d0-ff36-4d57-8eee-cc03ede809d1 admin admin] The token cache is being invalidate because project 08ef2be518b04e46b90364024d061e48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:34:41.372802 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-8fd114d0-ff36-4d57-8eee-cc03ede809d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:41.373356 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-8fd114d0-ff36-4d57-8eee-cc03ede809d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:41.373461 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1004/2005] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:34:41 2022] POST /identity/v3/projects => generated 393 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:41.374309 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f973bca-a2e0-457e-a116-b270b325caf3 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:41.375240 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1002/2006] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:34:41 2022] DELETE /identity/v3/projects/08ef2be518b04e46b90364024d061e48 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:34:41.377073 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-7f973bca-a2e0-457e-a116-b270b325caf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:41.378706 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd114d0-ff36-4d57-8eee-cc03ede809d1 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:41.380171 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-8fd114d0-ff36-4d57-8eee-cc03ede809d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:41.441518 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f973bca-a2e0-457e-a116-b270b325caf3 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:41.446168 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdc321-dca3-41a0-a479-370f9a6c1207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:41.446840 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdc321-dca3-41a0-a479-370f9a6c1207 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:41.447117 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdc321-dca3-41a0-a479-370f9a6c1207 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:41.447215 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd114d0-ff36-4d57-8eee-cc03ede809d1 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:41.447388 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fdc321-dca3-41a0-a479-370f9a6c1207 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:41.448066 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fdc321-dca3-41a0-a479-370f9a6c1207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:41.450002 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fdc321-dca3-41a0-a479-370f9a6c1207 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:41.451748 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436419f-ffc0-427c-98cf-a91234926dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:41.452606 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436419f-ffc0-427c-98cf-a91234926dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:41.452882 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436419f-ffc0-427c-98cf-a91234926dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:41.453152 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436419f-ffc0-427c-98cf-a91234926dfd admin admin] PATH_INFO: `/v3/users/d74c9d21b83c45be9b61de783fe6212d` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:41.454371 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436419f-ffc0-427c-98cf-a91234926dfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d74c9d21b83c45be9b61de783fe6212d)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:41.456338 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436419f-ffc0-427c-98cf-a91234926dfd admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:41.470282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1005/2007] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:34:41 2022] POST /identity/v3/users => generated 303 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:41.474093 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdc321-dca3-41a0-a479-370f9a6c1207 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:41.485209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fdc321-dca3-41a0-a479-370f9a6c1207 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:41.490629 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc9cec-2914-4a28-9394-e98a98c11680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:41.491317 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc9cec-2914-4a28-9394-e98a98c11680 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:41.491595 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc9cec-2914-4a28-9394-e98a98c11680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:41.491865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc9cec-2914-4a28-9394-e98a98c11680 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:41.492582 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc9cec-2914-4a28-9394-e98a98c11680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:41.494183 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc9cec-2914-4a28-9394-e98a98c11680 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:41.503815 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-7436419f-ffc0-427c-98cf-a91234926dfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd74c9d21b83c45be9b61de783fe6212d'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:41.503953 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1006/2008] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:41.508762 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc9cec-2914-4a28-9394-e98a98c11680 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:41.515929 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-7436419f-ffc0-427c-98cf-a91234926dfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd74c9d21b83c45be9b61de783fe6212d'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:41.516612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-7436419f-ffc0-427c-98cf-a91234926dfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd74c9d21b83c45be9b61de783fe6212d'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:41.518126 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc9cec-2914-4a28-9394-e98a98c11680 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:41.523433 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7c73c-9e7b-47f3-a5c4-1b1e3c4e0613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:41.524286 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7c73c-9e7b-47f3-a5c4-1b1e3c4e0613 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:41.524565 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7c73c-9e7b-47f3-a5c4-1b1e3c4e0613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:41.524853 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7c73c-9e7b-47f3-a5c4-1b1e3c4e0613 admin admin] PATH_INFO: `/v3/projects/fb76b72b4f1d4ed4811b68befe6c49a7/users/72fe4fa126724a4fb2de6402fa6fe6e9/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:41.525007 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-7436419f-ffc0-427c-98cf-a91234926dfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd74c9d21b83c45be9b61de783fe6212d'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:41.531693 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-7436419f-ffc0-427c-98cf-a91234926dfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd74c9d21b83c45be9b61de783fe6212d'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:41.537534 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1003/2009] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:34:41 2022] DELETE /identity/v3/users/d74c9d21b83c45be9b61de783fe6212d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:34:41.539671 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7c73c-9e7b-47f3-a5c4-1b1e3c4e0613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb76b72b4f1d4ed4811b68befe6c49a7, user_id=72fe4fa126724a4fb2de6402fa6fe6e9, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:41.542366 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7c73c-9e7b-47f3-a5c4-1b1e3c4e0613 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:41.555060 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1007/2010] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:41 2022] PUT /identity/v3/projects/fb76b72b4f1d4ed4811b68befe6c49a7/users/72fe4fa126724a4fb2de6402fa6fe6e9/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:41.558872 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436419f-ffc0-427c-98cf-a91234926dfd admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:41.560526 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-7436419f-ffc0-427c-98cf-a91234926dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:41.629477 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436419f-ffc0-427c-98cf-a91234926dfd admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:41.685961 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee269d-82d9-447b-be35-f483f16f52c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:41.687062 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee269d-82d9-447b-be35-f483f16f52c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:41.687286 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee269d-82d9-447b-be35-f483f16f52c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:41.687564 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee269d-82d9-447b-be35-f483f16f52c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:41.688333 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee269d-82d9-447b-be35-f483f16f52c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:41.690116 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee269d-82d9-447b-be35-f483f16f52c0 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:41.701684 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1004/2011] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:41.705874 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7c73c-9e7b-47f3-a5c4-1b1e3c4e0613 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:41.716552 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7c73c-9e7b-47f3-a5c4-1b1e3c4e0613 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:41.721202 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6dcc19-16e4-480b-a075-6c09d94ae3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:41.722104 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6dcc19-16e4-480b-a075-6c09d94ae3ac admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:41.722386 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6dcc19-16e4-480b-a075-6c09d94ae3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:41.722657 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6dcc19-16e4-480b-a075-6c09d94ae3ac admin admin] PATH_INFO: `/v3/projects/fb76b72b4f1d4ed4811b68befe6c49a7/users/72fe4fa126724a4fb2de6402fa6fe6e9/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:41.724882 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6dcc19-16e4-480b-a075-6c09d94ae3ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb76b72b4f1d4ed4811b68befe6c49a7, user_id=72fe4fa126724a4fb2de6402fa6fe6e9, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:41.727574 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6dcc19-16e4-480b-a075-6c09d94ae3ac admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:41.737641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1008/2012] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:41 2022] PUT /identity/v3/projects/fb76b72b4f1d4ed4811b68befe6c49a7/users/72fe4fa126724a4fb2de6402fa6fe6e9/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:41.747849 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69798860-219e-4c46-b698-5477ea5ac1d2 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:41.748137 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69798860-219e-4c46-b698-5477ea5ac1d2 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:41.748409 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69798860-219e-4c46-b698-5477ea5ac1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:41.775229 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-69798860-219e-4c46-b698-5477ea5ac1d2 None None] MFA Rules not processed for user `72fe4fa126724a4fb2de6402fa6fe6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:41.776423 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-69798860-219e-4c46-b698-5477ea5ac1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:41.810996 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6dcc19-16e4-480b-a075-6c09d94ae3ac admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:41.812830 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-4e6dcc19-16e4-480b-a075-6c09d94ae3ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:41.847570 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1005/2013] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:41.859074 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69798860-219e-4c46-b698-5477ea5ac1d2 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:41.860641 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-69798860-219e-4c46-b698-5477ea5ac1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:41.893209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6dcc19-16e4-480b-a075-6c09d94ae3ac admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:41.898111 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e8eed-1a79-472a-8342-e72e7519111c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:41.899072 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e8eed-1a79-472a-8342-e72e7519111c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:41.899363 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e8eed-1a79-472a-8342-e72e7519111c admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:41.899637 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e8eed-1a79-472a-8342-e72e7519111c admin admin] PATH_INFO: `/v3/projects/e97be5c9a89a486288ed294a6258c17a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:41.900827 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e8eed-1a79-472a-8342-e72e7519111c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e97be5c9a89a486288ed294a6258c17a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:41.902771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e8eed-1a79-472a-8342-e72e7519111c admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:41.914981 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69798860-219e-4c46-b698-5477ea5ac1d2 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:41.918786 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae98c0b-8b36-4ea7-941e-3520d2524f63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:41.919431 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae98c0b-8b36-4ea7-941e-3520d2524f63 service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:41.919709 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae98c0b-8b36-4ea7-941e-3520d2524f63 service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:41.919979 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae98c0b-8b36-4ea7-941e-3520d2524f63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:41.930550 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae98c0b-8b36-4ea7-941e-3520d2524f63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:41.931546 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae98c0b-8b36-4ea7-941e-3520d2524f63 service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:41.941531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1006/2014] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 09:34:41.958249 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-1d2e8eed-1a79-472a-8342-e72e7519111c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e97be5c9a89a486288ed294a6258c17a', 'request_id': 'req-1d2e8eed-1a79-472a-8342-e72e7519111c'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:41.965833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-1d2e8eed-1a79-472a-8342-e72e7519111c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e97be5c9a89a486288ed294a6258c17a', 'request_id': 'req-1d2e8eed-1a79-472a-8342-e72e7519111c'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:41.975009 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-1d2e8eed-1a79-472a-8342-e72e7519111c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e97be5c9a89a486288ed294a6258c17a', 'request_id': 'req-1d2e8eed-1a79-472a-8342-e72e7519111c'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:41.988495 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-1d2e8eed-1a79-472a-8342-e72e7519111c admin admin] The token cache is being invalidate because project e97be5c9a89a486288ed294a6258c17a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:34:41.988787 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-1d2e8eed-1a79-472a-8342-e72e7519111c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:41.989468 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-1d2e8eed-1a79-472a-8342-e72e7519111c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:41.991943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1009/2015] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:34:41 2022] DELETE /identity/v3/projects/e97be5c9a89a486288ed294a6258c17a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:41.996555 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d86e9-81da-462a-bf12-b2f325d8e5ac None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:41.996846 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d86e9-81da-462a-bf12-b2f325d8e5ac None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:41.997122 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d86e9-81da-462a-bf12-b2f325d8e5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:42.021964 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e8eed-1a79-472a-8342-e72e7519111c admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:42.023424 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-1d2e8eed-1a79-472a-8342-e72e7519111c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:42.028439 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-4c9d86e9-81da-462a-bf12-b2f325d8e5ac None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:42.029694 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-4c9d86e9-81da-462a-bf12-b2f325d8e5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:42.082626 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e8eed-1a79-472a-8342-e72e7519111c admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:42.091434 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59760c-a24e-47c5-9824-a5f902490808 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:42.092819 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59760c-a24e-47c5-9824-a5f902490808 service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:42.093107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59760c-a24e-47c5-9824-a5f902490808 service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:42.093432 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59760c-a24e-47c5-9824-a5f902490808 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:42.093887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1007/2016] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:42.095626 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-2d59760c-a24e-47c5-9824-a5f902490808 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:42.103256 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7f086-081a-4bec-b404-1fac361cb4c5 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:42.103543 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7f086-081a-4bec-b404-1fac361cb4c5 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:42.103776 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7f086-081a-4bec-b404-1fac361cb4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:42.122827 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-afb7f086-081a-4bec-b404-1fac361cb4c5 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:42.124082 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-afb7f086-081a-4bec-b404-1fac361cb4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:42.132126 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1008/2017] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:42.136595 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7f086-081a-4bec-b404-1fac361cb4c5 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:42.145497 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7f086-081a-4bec-b404-1fac361cb4c5 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:42.150778 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcf49c-d45e-4698-9b49-0883f00e2346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:42.151415 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcf49c-d45e-4698-9b49-0883f00e2346 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:42.151698 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcf49c-d45e-4698-9b49-0883f00e2346 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:42.151977 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcf49c-d45e-4698-9b49-0883f00e2346 admin admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:42.152697 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcf49c-d45e-4698-9b49-0883f00e2346 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:34:42.153002 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcf49c-d45e-4698-9b49-0883f00e2346 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:42.154647 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcf49c-d45e-4698-9b49-0883f00e2346 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:42.160159 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59760c-a24e-47c5-9824-a5f902490808 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:42.161583 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59760c-a24e-47c5-9824-a5f902490808 service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:42.166557 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1009/2018] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:34:42.170528 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcf49c-d45e-4698-9b49-0883f00e2346 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:42.171531 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1010/2019] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 09:34:42.180730 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcf49c-d45e-4698-9b49-0883f00e2346 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:42.185412 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3f86a-6331-4695-a1fa-c719b1e1934f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:42.186084 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3f86a-6331-4695-a1fa-c719b1e1934f admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:42.186363 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3f86a-6331-4695-a1fa-c719b1e1934f admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:42.186637 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3f86a-6331-4695-a1fa-c719b1e1934f admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:42.187317 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3f86a-6331-4695-a1fa-c719b1e1934f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:42.189244 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3f86a-6331-4695-a1fa-c719b1e1934f admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:42.215579 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1010/2020] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:34:42 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:42.219518 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59760c-a24e-47c5-9824-a5f902490808 service cinder] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:42.230603 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59760c-a24e-47c5-9824-a5f902490808 service cinder] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:42.294457 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7569dd-6087-47e0-9d02-09e491c4be92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:42.295186 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7569dd-6087-47e0-9d02-09e491c4be92 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:42.295473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7569dd-6087-47e0-9d02-09e491c4be92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:42.295773 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7569dd-6087-47e0-9d02-09e491c4be92 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:42.296523 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7569dd-6087-47e0-9d02-09e491c4be92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:42.298493 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7569dd-6087-47e0-9d02-09e491c4be92 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:42.323807 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1011/2021] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:34:42 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:34:42.328190 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3f86a-6331-4695-a1fa-c719b1e1934f admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:42.341008 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3f86a-6331-4695-a1fa-c719b1e1934f admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:42.346274 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216e76c-3864-4f4b-82d5-ae4500f00777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:42.347860 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216e76c-3864-4f4b-82d5-ae4500f00777 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:42.348121 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216e76c-3864-4f4b-82d5-ae4500f00777 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:42.348406 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216e76c-3864-4f4b-82d5-ae4500f00777 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:42.349149 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216e76c-3864-4f4b-82d5-ae4500f00777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:42.351501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216e76c-3864-4f4b-82d5-ae4500f00777 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:42.361891 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1011/2022] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:42.365879 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7569dd-6087-47e0-9d02-09e491c4be92 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:42.375909 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7569dd-6087-47e0-9d02-09e491c4be92 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:42.380998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748a36d-c841-4048-960f-4384ffea7a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:42.381737 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748a36d-c841-4048-960f-4384ffea7a42 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:42.382064 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748a36d-c841-4048-960f-4384ffea7a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:42.382333 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748a36d-c841-4048-960f-4384ffea7a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:42.383089 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748a36d-c841-4048-960f-4384ffea7a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:42.385009 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748a36d-c841-4048-960f-4384ffea7a42 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:42.396193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1012/2023] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:42.401206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216e76c-3864-4f4b-82d5-ae4500f00777 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:42.414801 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216e76c-3864-4f4b-82d5-ae4500f00777 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:42.429752 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b02e3-1c42-40df-b043-688da7cdf769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:42.431829 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b02e3-1c42-40df-b043-688da7cdf769 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:42.432111 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b02e3-1c42-40df-b043-688da7cdf769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:42.432386 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b02e3-1c42-40df-b043-688da7cdf769 admin admin] PATH_INFO: `/v3/projects/bdc48145acde413e99299f029ad0cea9/users/1174087be0a7412d8dbba6f4f56c3424/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:42.453006 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b02e3-1c42-40df-b043-688da7cdf769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdc48145acde413e99299f029ad0cea9, user_id=1174087be0a7412d8dbba6f4f56c3424, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:42.455365 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b02e3-1c42-40df-b043-688da7cdf769 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:42.474827 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1012/2024] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:42 2022] PUT /identity/v3/projects/bdc48145acde413e99299f029ad0cea9/users/1174087be0a7412d8dbba6f4f56c3424/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:42.480150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed8845-2203-4e96-bc96-d191014adacf None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:42.480431 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed8845-2203-4e96-bc96-d191014adacf None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:42.480781 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed8845-2203-4e96-bc96-d191014adacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:42.511178 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-a4ed8845-2203-4e96-bc96-d191014adacf None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:42.512924 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-a4ed8845-2203-4e96-bc96-d191014adacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:42.575417 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1013/2025] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:42.585551 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b02e3-1c42-40df-b043-688da7cdf769 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:42.588403 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-415b02e3-1c42-40df-b043-688da7cdf769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:42.645375 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b02e3-1c42-40df-b043-688da7cdf769 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:42.649072 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37f7ec-0f54-4128-bfed-1eabadeaf0b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:42.649724 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37f7ec-0f54-4128-bfed-1eabadeaf0b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:42.650055 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37f7ec-0f54-4128-bfed-1eabadeaf0b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:42.650484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37f7ec-0f54-4128-bfed-1eabadeaf0b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:42.659704 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37f7ec-0f54-4128-bfed-1eabadeaf0b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:42.661173 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37f7ec-0f54-4128-bfed-1eabadeaf0b9 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:42.671153 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1013/2026] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:44.127319 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed8845-2203-4e96-bc96-d191014adacf None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:44.128980 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-a4ed8845-2203-4e96-bc96-d191014adacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:44.205346 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed8845-2203-4e96-bc96-d191014adacf None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:44.211064 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31ce0e-7d8a-4c2c-b677-50c94dfa0cb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:44.211810 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31ce0e-7d8a-4c2c-b677-50c94dfa0cb5 service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:44.212162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31ce0e-7d8a-4c2c-b677-50c94dfa0cb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:44.212524 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31ce0e-7d8a-4c2c-b677-50c94dfa0cb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:44.215436 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-1d31ce0e-7d8a-4c2c-b677-50c94dfa0cb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:44.339286 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31ce0e-7d8a-4c2c-b677-50c94dfa0cb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:44.340730 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31ce0e-7d8a-4c2c-b677-50c94dfa0cb5 service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:44.361986 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1014/2027] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:47.554857 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f946758-8c8b-4d05-8208-32f851820eb5 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:47.555447 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f946758-8c8b-4d05-8208-32f851820eb5 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:47.555447 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f946758-8c8b-4d05-8208-32f851820eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:47.587247 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-4f946758-8c8b-4d05-8208-32f851820eb5 None None] MFA Rules not processed for user `1174087be0a7412d8dbba6f4f56c3424`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:47.588715 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-4f946758-8c8b-4d05-8208-32f851820eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:47.665205 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1014/2028] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:47.669800 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31ce0e-7d8a-4c2c-b677-50c94dfa0cb5 service cinder] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:47.681311 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31ce0e-7d8a-4c2c-b677-50c94dfa0cb5 service cinder] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:47.686120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754f637-625c-42b3-bf4a-e5b20da42759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:47.686884 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754f637-625c-42b3-bf4a-e5b20da42759 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:47.687229 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754f637-625c-42b3-bf4a-e5b20da42759 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:47.687587 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754f637-625c-42b3-bf4a-e5b20da42759 admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:47.688367 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754f637-625c-42b3-bf4a-e5b20da42759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:47.690618 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754f637-625c-42b3-bf4a-e5b20da42759 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:47.719305 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1015/2029] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:34:47 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:47.723416 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f946758-8c8b-4d05-8208-32f851820eb5 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:47.738411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f946758-8c8b-4d05-8208-32f851820eb5 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:47.826669 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a623cce-1692-4e0c-ba74-36d8fd6d39cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:47.827351 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a623cce-1692-4e0c-ba74-36d8fd6d39cc admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:47.827637 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a623cce-1692-4e0c-ba74-36d8fd6d39cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:47.827913 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a623cce-1692-4e0c-ba74-36d8fd6d39cc admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:47.828647 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a623cce-1692-4e0c-ba74-36d8fd6d39cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:47.830792 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a623cce-1692-4e0c-ba74-36d8fd6d39cc admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:47.854192 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1015/2030] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:34:47 2022] POST /identity/v3/users => generated 298 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:47.857831 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754f637-625c-42b3-bf4a-e5b20da42759 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:47.868894 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754f637-625c-42b3-bf4a-e5b20da42759 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:47.875055 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660293d2-2afb-4e07-95a8-6aeb04852980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:47.875840 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660293d2-2afb-4e07-95a8-6aeb04852980 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:47.876133 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660293d2-2afb-4e07-95a8-6aeb04852980 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:47.876415 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660293d2-2afb-4e07-95a8-6aeb04852980 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:47.877206 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660293d2-2afb-4e07-95a8-6aeb04852980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:47.879158 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660293d2-2afb-4e07-95a8-6aeb04852980 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:47.894646 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1016/2031] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:47.896271 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a623cce-1692-4e0c-ba74-36d8fd6d39cc admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:47.908061 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a623cce-1692-4e0c-ba74-36d8fd6d39cc admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:47.913209 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d656d3-650a-405b-8c91-578167c271a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:47.914153 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d656d3-650a-405b-8c91-578167c271a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:47.914438 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d656d3-650a-405b-8c91-578167c271a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:47.915191 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d656d3-650a-405b-8c91-578167c271a6 admin admin] PATH_INFO: `/v3/projects/328818592443490ba5be8d13f0adba97/users/923b1ab49fd74a94b664583a4d713b06/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:47.931527 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d656d3-650a-405b-8c91-578167c271a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=328818592443490ba5be8d13f0adba97, user_id=923b1ab49fd74a94b664583a4d713b06, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:47.934720 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d656d3-650a-405b-8c91-578167c271a6 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:47.948942 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1016/2032] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:47 2022] PUT /identity/v3/projects/328818592443490ba5be8d13f0adba97/users/923b1ab49fd74a94b664583a4d713b06/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:47.952924 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660293d2-2afb-4e07-95a8-6aeb04852980 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:47.976921 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660293d2-2afb-4e07-95a8-6aeb04852980 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:48.046419 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327730a5-9b8f-478d-a8c0-bf9de656d3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:48.047377 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327730a5-9b8f-478d-a8c0-bf9de656d3bd admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:48.047877 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327730a5-9b8f-478d-a8c0-bf9de656d3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:48.048330 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327730a5-9b8f-478d-a8c0-bf9de656d3bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:48.049075 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327730a5-9b8f-478d-a8c0-bf9de656d3bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:48.051278 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327730a5-9b8f-478d-a8c0-bf9de656d3bd admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:48.061767 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1017/2033] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:48.065679 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d656d3-650a-405b-8c91-578167c271a6 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:48.076504 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d656d3-650a-405b-8c91-578167c271a6 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:48.081238 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445643c3-37ba-4036-8c1e-4d45ce371d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:48.082161 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445643c3-37ba-4036-8c1e-4d45ce371d1c admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:48.082441 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445643c3-37ba-4036-8c1e-4d45ce371d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:48.082720 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445643c3-37ba-4036-8c1e-4d45ce371d1c admin admin] PATH_INFO: `/v3/projects/328818592443490ba5be8d13f0adba97/users/923b1ab49fd74a94b664583a4d713b06/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:48.084879 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445643c3-37ba-4036-8c1e-4d45ce371d1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=328818592443490ba5be8d13f0adba97, user_id=923b1ab49fd74a94b664583a4d713b06, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:48.087539 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445643c3-37ba-4036-8c1e-4d45ce371d1c admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:48.107731 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1017/2034] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:48 2022] PUT /identity/v3/projects/328818592443490ba5be8d13f0adba97/users/923b1ab49fd74a94b664583a4d713b06/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:51.383698 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327730a5-9b8f-478d-a8c0-bf9de656d3bd admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:51.386933 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-327730a5-9b8f-478d-a8c0-bf9de656d3bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:51.406448 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327730a5-9b8f-478d-a8c0-bf9de656d3bd admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:51.526990 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140243ea-1878-4566-93f2-855629669c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:51.527964 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140243ea-1878-4566-93f2-855629669c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:51.529795 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140243ea-1878-4566-93f2-855629669c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:51.530276 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140243ea-1878-4566-93f2-855629669c71 admin admin] PATH_INFO: `/v3/users/f2d43d0fedd54bd5899da96c93c99c1c` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:51.534004 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140243ea-1878-4566-93f2-855629669c71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2d43d0fedd54bd5899da96c93c99c1c)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:51.536818 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140243ea-1878-4566-93f2-855629669c71 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:51.672054 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-140243ea-1878-4566-93f2-855629669c71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2d43d0fedd54bd5899da96c93c99c1c'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:51.701718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-140243ea-1878-4566-93f2-855629669c71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2d43d0fedd54bd5899da96c93c99c1c'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:51.703479 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-140243ea-1878-4566-93f2-855629669c71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2d43d0fedd54bd5899da96c93c99c1c'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:51.736639 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-140243ea-1878-4566-93f2-855629669c71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2d43d0fedd54bd5899da96c93c99c1c'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:51.777244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-140243ea-1878-4566-93f2-855629669c71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2d43d0fedd54bd5899da96c93c99c1c'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:51.792113 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1018/2035] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:34:51 2022] DELETE /identity/v3/users/f2d43d0fedd54bd5899da96c93c99c1c => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:51.796216 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a0780-75c7-414e-a768-2a8f407510d4 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:51.797049 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a0780-75c7-414e-a768-2a8f407510d4 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:51.798684 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a0780-75c7-414e-a768-2a8f407510d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:51.860327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-9c6a0780-75c7-414e-a768-2a8f407510d4 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:51.861690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-9c6a0780-75c7-414e-a768-2a8f407510d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:51.999110 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1018/2036] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:52.032886 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140243ea-1878-4566-93f2-855629669c71 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:52.034690 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-140243ea-1878-4566-93f2-855629669c71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:52.176388 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140243ea-1878-4566-93f2-855629669c71 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:52.189788 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63fc31-5c7c-42cc-9d10-fd68e0037d6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:52.190621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63fc31-5c7c-42cc-9d10-fd68e0037d6d service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:52.190979 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63fc31-5c7c-42cc-9d10-fd68e0037d6d service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:52.191324 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63fc31-5c7c-42cc-9d10-fd68e0037d6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:52.209514 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63fc31-5c7c-42cc-9d10-fd68e0037d6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:52.214944 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c63fc31-5c7c-42cc-9d10-fd68e0037d6d service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:52.242684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1019/2037] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:52.915773 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a0780-75c7-414e-a768-2a8f407510d4 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:52.917241 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-9c6a0780-75c7-414e-a768-2a8f407510d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:52.942849 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a0780-75c7-414e-a768-2a8f407510d4 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:52.951356 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ebf74-755d-41a6-bd87-427dc85b2556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:52.952824 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ebf74-755d-41a6-bd87-427dc85b2556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:52.953275 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ebf74-755d-41a6-bd87-427dc85b2556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:52.953755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ebf74-755d-41a6-bd87-427dc85b2556 admin admin] PATH_INFO: `/v3/projects/1b6d7d04b2e541c490aba75d53c9609e` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:52.955880 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ebf74-755d-41a6-bd87-427dc85b2556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b6d7d04b2e541c490aba75d53c9609e)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:52.958140 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ebf74-755d-41a6-bd87-427dc85b2556 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:53.079021 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-cd3ebf74-755d-41a6-bd87-427dc85b2556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b6d7d04b2e541c490aba75d53c9609e', 'request_id': 'req-cd3ebf74-755d-41a6-bd87-427dc85b2556'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:53.086875 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-cd3ebf74-755d-41a6-bd87-427dc85b2556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b6d7d04b2e541c490aba75d53c9609e', 'request_id': 'req-cd3ebf74-755d-41a6-bd87-427dc85b2556'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:53.106745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-cd3ebf74-755d-41a6-bd87-427dc85b2556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b6d7d04b2e541c490aba75d53c9609e', 'request_id': 'req-cd3ebf74-755d-41a6-bd87-427dc85b2556'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:53.136223 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-cd3ebf74-755d-41a6-bd87-427dc85b2556 admin admin] The token cache is being invalidate because project 1b6d7d04b2e541c490aba75d53c9609e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:34:53.136821 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-cd3ebf74-755d-41a6-bd87-427dc85b2556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:53.137736 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-cd3ebf74-755d-41a6-bd87-427dc85b2556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:53.144681 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1019/2038] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:34:52 2022] DELETE /identity/v3/projects/1b6d7d04b2e541c490aba75d53c9609e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:53.148786 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63fc31-5c7c-42cc-9d10-fd68e0037d6d service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:53.165545 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63fc31-5c7c-42cc-9d10-fd68e0037d6d service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:53.343887 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd7de5-61c4-41e7-b261-50452cc3bca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:53.344716 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd7de5-61c4-41e7-b261-50452cc3bca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:53.344997 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd7de5-61c4-41e7-b261-50452cc3bca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:53.345269 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd7de5-61c4-41e7-b261-50452cc3bca5 admin admin] PATH_INFO: `/v3/users/72fe4fa126724a4fb2de6402fa6fe6e9` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:53.346949 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd7de5-61c4-41e7-b261-50452cc3bca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72fe4fa126724a4fb2de6402fa6fe6e9)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:53.348921 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd7de5-61c4-41e7-b261-50452cc3bca5 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:53.503986 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-3bcd7de5-61c4-41e7-b261-50452cc3bca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72fe4fa126724a4fb2de6402fa6fe6e9'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:53.560951 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-3bcd7de5-61c4-41e7-b261-50452cc3bca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72fe4fa126724a4fb2de6402fa6fe6e9'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:53.562200 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-3bcd7de5-61c4-41e7-b261-50452cc3bca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72fe4fa126724a4fb2de6402fa6fe6e9'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:53.581636 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-3bcd7de5-61c4-41e7-b261-50452cc3bca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72fe4fa126724a4fb2de6402fa6fe6e9'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:53.626570 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-3bcd7de5-61c4-41e7-b261-50452cc3bca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72fe4fa126724a4fb2de6402fa6fe6e9'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:53.642116 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1020/2039] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:34:53 2022] DELETE /identity/v3/users/72fe4fa126724a4fb2de6402fa6fe6e9 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:54.271363 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26694a-c489-4e57-8a7c-f1f4f275e6e0 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:54.272089 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26694a-c489-4e57-8a7c-f1f4f275e6e0 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:54.272089 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26694a-c489-4e57-8a7c-f1f4f275e6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:54.318257 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-ff26694a-c489-4e57-8a7c-f1f4f275e6e0 None None] MFA Rules not processed for user `923b1ab49fd74a94b664583a4d713b06`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:54.319585 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-ff26694a-c489-4e57-8a7c-f1f4f275e6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:54.421637 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1020/2040] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:54.430313 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd7de5-61c4-41e7-b261-50452cc3bca5 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:54.433076 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-3bcd7de5-61c4-41e7-b261-50452cc3bca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:54.530331 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd7de5-61c4-41e7-b261-50452cc3bca5 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:54.536590 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c8ae9-73aa-497d-ac61-13e628de18de service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0981a8c6d9ac413b99aae95a6cdd3be5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:54.538014 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c8ae9-73aa-497d-ac61-13e628de18de service glance] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:54.538436 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c8ae9-73aa-497d-ac61-13e628de18de service glance] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:54.538683 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c8ae9-73aa-497d-ac61-13e628de18de service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:54.540685 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-427c8ae9-73aa-497d-ac61-13e628de18de service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:54.634305 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c8ae9-73aa-497d-ac61-13e628de18de service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:54.636030 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c8ae9-73aa-497d-ac61-13e628de18de service glance] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:54.648295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1021/2041] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:54.719242 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26694a-c489-4e57-8a7c-f1f4f275e6e0 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:54.721635 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-ff26694a-c489-4e57-8a7c-f1f4f275e6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:54.837188 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26694a-c489-4e57-8a7c-f1f4f275e6e0 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:54.842677 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f8a5e-b3e0-4bc1-afed-33890dbc20b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:54.843820 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f8a5e-b3e0-4bc1-afed-33890dbc20b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:54.844074 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f8a5e-b3e0-4bc1-afed-33890dbc20b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:54.844235 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f8a5e-b3e0-4bc1-afed-33890dbc20b9 admin admin] PATH_INFO: `/v3/projects/fb76b72b4f1d4ed4811b68befe6c49a7` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:54.845524 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f8a5e-b3e0-4bc1-afed-33890dbc20b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb76b72b4f1d4ed4811b68befe6c49a7)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:54.854253 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f8a5e-b3e0-4bc1-afed-33890dbc20b9 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:54.922852 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68a4e1-1381-42fb-9729-2fae1a1b238e None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:54.923353 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68a4e1-1381-42fb-9729-2fae1a1b238e None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:54.923727 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68a4e1-1381-42fb-9729-2fae1a1b238e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:54.939415 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-088f8a5e-b3e0-4bc1-afed-33890dbc20b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb76b72b4f1d4ed4811b68befe6c49a7', 'request_id': 'req-088f8a5e-b3e0-4bc1-afed-33890dbc20b9'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:54.948074 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-088f8a5e-b3e0-4bc1-afed-33890dbc20b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb76b72b4f1d4ed4811b68befe6c49a7', 'request_id': 'req-088f8a5e-b3e0-4bc1-afed-33890dbc20b9'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:54.950401 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-5c68a4e1-1381-42fb-9729-2fae1a1b238e None None] MFA Rules not processed for user `bd41f419750140268f4d4b77456065c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:54.951709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-5c68a4e1-1381-42fb-9729-2fae1a1b238e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:54.962712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-088f8a5e-b3e0-4bc1-afed-33890dbc20b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb76b72b4f1d4ed4811b68befe6c49a7', 'request_id': 'req-088f8a5e-b3e0-4bc1-afed-33890dbc20b9'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:54.989399 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-088f8a5e-b3e0-4bc1-afed-33890dbc20b9 admin admin] The token cache is being invalidate because project fb76b72b4f1d4ed4811b68befe6c49a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:34:54.989399 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-088f8a5e-b3e0-4bc1-afed-33890dbc20b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:54.990248 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-088f8a5e-b3e0-4bc1-afed-33890dbc20b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:54.993595 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1021/2042] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:34:54 2022] DELETE /identity/v3/projects/fb76b72b4f1d4ed4811b68befe6c49a7 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:55.002968 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661a4af-d336-42c3-b68d-f4af59767d1e None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:55.003463 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661a4af-d336-42c3-b68d-f4af59767d1e None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:55.003817 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661a4af-d336-42c3-b68d-f4af59767d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:55.037212 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-6661a4af-d336-42c3-b68d-f4af59767d1e None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:55.040178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-6661a4af-d336-42c3-b68d-f4af59767d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:55.060573 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1022/2043] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 12 09:34:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:55.076324 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68a4e1-1381-42fb-9729-2fae1a1b238e None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:55.079583 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-5c68a4e1-1381-42fb-9729-2fae1a1b238e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:55.170030 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1022/2044] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:34:55.186842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54756d-dbd3-4537-bb25-f8655f462c3c None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:55.187426 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54756d-dbd3-4537-bb25-f8655f462c3c None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:55.188016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54756d-dbd3-4537-bb25-f8655f462c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:55.201091 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68a4e1-1381-42fb-9729-2fae1a1b238e None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:55.212013 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5a67f-5a50-453b-9bfe-51aa3e34dee5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7693a31911346f9bb2c01efcd8e16e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:55.212698 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5a67f-5a50-453b-9bfe-51aa3e34dee5 service swift] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:55.212984 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5a67f-5a50-453b-9bfe-51aa3e34dee5 service swift] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:55.213286 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5a67f-5a50-453b-9bfe-51aa3e34dee5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:55.219492 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-ec54756d-dbd3-4537-bb25-f8655f462c3c None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:55.221715 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-ec54756d-dbd3-4537-bb25-f8655f462c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:55.231417 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5a67f-5a50-453b-9bfe-51aa3e34dee5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:55.233502 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5a67f-5a50-453b-9bfe-51aa3e34dee5 service swift] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:55.242352 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1023/2045] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:55.243344 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54756d-dbd3-4537-bb25-f8655f462c3c None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:55.254324 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54756d-dbd3-4537-bb25-f8655f462c3c None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:55.257578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1023/2046] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 12 09:34:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 09:34:55.262391 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09147e8c-64b7-455c-a9a5-eacacc13094b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:55.263859 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09147e8c-64b7-455c-a9a5-eacacc13094b admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:55.264215 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09147e8c-64b7-455c-a9a5-eacacc13094b admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:55.264555 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09147e8c-64b7-455c-a9a5-eacacc13094b admin admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:55.265683 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09147e8c-64b7-455c-a9a5-eacacc13094b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:34:55.266123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09147e8c-64b7-455c-a9a5-eacacc13094b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:55.268165 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09147e8c-64b7-455c-a9a5-eacacc13094b admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:55.283134 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1024/2047] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:34:55.286497 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5a67f-5a50-453b-9bfe-51aa3e34dee5 service swift] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:55.298911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5a67f-5a50-453b-9bfe-51aa3e34dee5 service swift] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:55.309006 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8f447-cc65-4749-9378-166f2854efbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:55.309811 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8f447-cc65-4749-9378-166f2854efbf admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:55.310211 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8f447-cc65-4749-9378-166f2854efbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:55.310693 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8f447-cc65-4749-9378-166f2854efbf admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:55.311439 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f8f447-cc65-4749-9378-166f2854efbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:55.313848 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f8f447-cc65-4749-9378-166f2854efbf admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:55.382218 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1024/2048] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:34:55 2022] POST /identity/v3/projects => generated 387 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:55.383528 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09147e8c-64b7-455c-a9a5-eacacc13094b admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:55.400407 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09147e8c-64b7-455c-a9a5-eacacc13094b admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:55.559421 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b74652-64e2-4be8-8cdc-00294adc6666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:55.560098 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b74652-64e2-4be8-8cdc-00294adc6666 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:55.560376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b74652-64e2-4be8-8cdc-00294adc6666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:55.560647 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b74652-64e2-4be8-8cdc-00294adc6666 admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:55.561346 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b74652-64e2-4be8-8cdc-00294adc6666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:55.563300 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b74652-64e2-4be8-8cdc-00294adc6666 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:55.607168 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1025/2049] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:34:55 2022] POST /identity/v3/users => generated 294 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:55.611148 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8f447-cc65-4749-9378-166f2854efbf admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:55.630499 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8f447-cc65-4749-9378-166f2854efbf admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:55.637641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54d0f9-e43e-4cf9-b216-f5d431869811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:55.638357 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54d0f9-e43e-4cf9-b216-f5d431869811 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:55.638642 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54d0f9-e43e-4cf9-b216-f5d431869811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:55.638912 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54d0f9-e43e-4cf9-b216-f5d431869811 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:55.640453 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f54d0f9-e43e-4cf9-b216-f5d431869811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:55.646986 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f54d0f9-e43e-4cf9-b216-f5d431869811 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:55.685612 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1025/2050] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:55.689209 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b74652-64e2-4be8-8cdc-00294adc6666 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:55.730402 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b74652-64e2-4be8-8cdc-00294adc6666 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:55.748570 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aef88b-b4ab-4f9c-8c13-78d87930978e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:55.750075 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aef88b-b4ab-4f9c-8c13-78d87930978e admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:55.750581 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aef88b-b4ab-4f9c-8c13-78d87930978e admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:55.751064 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aef88b-b4ab-4f9c-8c13-78d87930978e admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:55.752158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aef88b-b4ab-4f9c-8c13-78d87930978e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:55.754041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aef88b-b4ab-4f9c-8c13-78d87930978e admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:55.770163 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1026/2051] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:55.774604 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54d0f9-e43e-4cf9-b216-f5d431869811 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:55.784995 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54d0f9-e43e-4cf9-b216-f5d431869811 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:55.791815 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9d76f-588a-49ee-9f12-e1ffae97c908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:55.793206 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9d76f-588a-49ee-9f12-e1ffae97c908 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:55.793497 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9d76f-588a-49ee-9f12-e1ffae97c908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:55.793774 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9d76f-588a-49ee-9f12-e1ffae97c908 admin admin] PATH_INFO: `/v3/projects/caf75d489ed449a697b4f2ddd0aa4177/users/234536608975430184a6b4aeb1a32650/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:55.845780 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9d76f-588a-49ee-9f12-e1ffae97c908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caf75d489ed449a697b4f2ddd0aa4177, user_id=234536608975430184a6b4aeb1a32650, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:55.852455 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9d76f-588a-49ee-9f12-e1ffae97c908 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:55.886666 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1026/2052] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:55 2022] PUT /identity/v3/projects/caf75d489ed449a697b4f2ddd0aa4177/users/234536608975430184a6b4aeb1a32650/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:55.896628 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0a227-3e83-4172-b65c-74eb27d98f6a None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:55.897394 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0a227-3e83-4172-b65c-74eb27d98f6a None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:55.897716 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0a227-3e83-4172-b65c-74eb27d98f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:55.974494 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-e9c0a227-3e83-4172-b65c-74eb27d98f6a None None] MFA Rules not processed for user `234536608975430184a6b4aeb1a32650`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:55.976396 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-e9c0a227-3e83-4172-b65c-74eb27d98f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:56.103428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1027/2053] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:56.109824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9d76f-588a-49ee-9f12-e1ffae97c908 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:56.212241 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9d76f-588a-49ee-9f12-e1ffae97c908 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:56.223470 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c2d17-dbcc-4dc7-88d1-b517c3d56c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:56.224142 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c2d17-dbcc-4dc7-88d1-b517c3d56c3a admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:56.224439 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c2d17-dbcc-4dc7-88d1-b517c3d56c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:56.224699 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c2d17-dbcc-4dc7-88d1-b517c3d56c3a admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:56.226012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c2d17-dbcc-4dc7-88d1-b517c3d56c3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:56.227941 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c2d17-dbcc-4dc7-88d1-b517c3d56c3a admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:56.292236 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1027/2054] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:34:56 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:56.296138 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0a227-3e83-4172-b65c-74eb27d98f6a None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:56.308783 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0a227-3e83-4172-b65c-74eb27d98f6a None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:56.370150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b69324-a9ef-498e-a568-74b621439f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:56.370961 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b69324-a9ef-498e-a568-74b621439f4f admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:56.371359 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b69324-a9ef-498e-a568-74b621439f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:56.371652 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b69324-a9ef-498e-a568-74b621439f4f admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:56.372449 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b69324-a9ef-498e-a568-74b621439f4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:56.374687 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b69324-a9ef-498e-a568-74b621439f4f admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:56.401648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1028/2055] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:34:56 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:34:56.405349 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c2d17-dbcc-4dc7-88d1-b517c3d56c3a admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:56.417548 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c2d17-dbcc-4dc7-88d1-b517c3d56c3a admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:56.423295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712acdb7-0c23-493c-b293-2a1f72da9c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:56.424458 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712acdb7-0c23-493c-b293-2a1f72da9c4e admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:56.424914 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712acdb7-0c23-493c-b293-2a1f72da9c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:56.425500 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712acdb7-0c23-493c-b293-2a1f72da9c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:56.426600 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712acdb7-0c23-493c-b293-2a1f72da9c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:56.428996 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712acdb7-0c23-493c-b293-2a1f72da9c4e admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:56.444490 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1028/2056] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 09:34:56.448271 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b69324-a9ef-498e-a568-74b621439f4f admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:56.460396 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b69324-a9ef-498e-a568-74b621439f4f admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:56.465730 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b56e34-06cc-432a-b091-3c77666fca48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:56.467158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b56e34-06cc-432a-b091-3c77666fca48 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:56.467613 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b56e34-06cc-432a-b091-3c77666fca48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:56.468055 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b56e34-06cc-432a-b091-3c77666fca48 admin admin] PATH_INFO: `/v3/projects/0ec5d9ae7e9a4168904c157773b86557/users/4cce509bc1b845ee984057ebe7f34a5a/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:56.485732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b56e34-06cc-432a-b091-3c77666fca48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ec5d9ae7e9a4168904c157773b86557, user_id=4cce509bc1b845ee984057ebe7f34a5a, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:56.489149 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b56e34-06cc-432a-b091-3c77666fca48 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:56.512969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1029/2057] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:56 2022] PUT /identity/v3/projects/0ec5d9ae7e9a4168904c157773b86557/users/4cce509bc1b845ee984057ebe7f34a5a/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:34:56.516709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712acdb7-0c23-493c-b293-2a1f72da9c4e admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:56.532209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712acdb7-0c23-493c-b293-2a1f72da9c4e admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:56.680948 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573b7bd-0e0a-48ee-8ac5-a5c4cf28775a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:56.681803 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573b7bd-0e0a-48ee-8ac5-a5c4cf28775a admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:56.682233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573b7bd-0e0a-48ee-8ac5-a5c4cf28775a admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:56.682664 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573b7bd-0e0a-48ee-8ac5-a5c4cf28775a admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:56.684492 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e573b7bd-0e0a-48ee-8ac5-a5c4cf28775a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:56.688578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e573b7bd-0e0a-48ee-8ac5-a5c4cf28775a admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:56.718451 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b56e34-06cc-432a-b091-3c77666fca48 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:56.718722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1029/2058] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:34:56.732477 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b56e34-06cc-432a-b091-3c77666fca48 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:56.785525 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5522ebbd-655c-4f51-a58c-f3705ffae4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:56.787449 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522ebbd-655c-4f51-a58c-f3705ffae4f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:56.787731 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522ebbd-655c-4f51-a58c-f3705ffae4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:56.788003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522ebbd-655c-4f51-a58c-f3705ffae4f6 admin admin] PATH_INFO: `/v3/projects/0ec5d9ae7e9a4168904c157773b86557/users/4cce509bc1b845ee984057ebe7f34a5a/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:56.792132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5522ebbd-655c-4f51-a58c-f3705ffae4f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ec5d9ae7e9a4168904c157773b86557, user_id=4cce509bc1b845ee984057ebe7f34a5a, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:56.797266 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5522ebbd-655c-4f51-a58c-f3705ffae4f6 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:56.822097 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1030/2059] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:34:56 2022] PUT /identity/v3/projects/0ec5d9ae7e9a4168904c157773b86557/users/4cce509bc1b845ee984057ebe7f34a5a/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:34:56.823032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278beb4-5adc-4109-881c-fffc89a21059 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:56.823328 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278beb4-5adc-4109-881c-fffc89a21059 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:56.823610 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278beb4-5adc-4109-881c-fffc89a21059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:56.921957 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-1278beb4-5adc-4109-881c-fffc89a21059 None None] MFA Rules not processed for user `4cce509bc1b845ee984057ebe7f34a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:56.930189 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-1278beb4-5adc-4109-881c-fffc89a21059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:57.194730 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1030/2060] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:57.267241 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5522ebbd-655c-4f51-a58c-f3705ffae4f6 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:57.269163 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-5522ebbd-655c-4f51-a58c-f3705ffae4f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:57.370917 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5522ebbd-655c-4f51-a58c-f3705ffae4f6 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:57.387449 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92b3b8-bd20-47e1-b58f-ea1fbc579f94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:57.388995 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92b3b8-bd20-47e1-b58f-ea1fbc579f94 service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:57.389530 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92b3b8-bd20-47e1-b58f-ea1fbc579f94 service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:57.390048 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92b3b8-bd20-47e1-b58f-ea1fbc579f94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:57.413794 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92b3b8-bd20-47e1-b58f-ea1fbc579f94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:57.416432 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92b3b8-bd20-47e1-b58f-ea1fbc579f94 service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:57.460195 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1031/2061] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:34:58.913696 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278beb4-5adc-4109-881c-fffc89a21059 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:59.127240 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278beb4-5adc-4109-881c-fffc89a21059 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:59.143009 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58a00a-38ab-44eb-a010-8645ff5c3350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:59.144114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58a00a-38ab-44eb-a010-8645ff5c3350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:59.144571 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58a00a-38ab-44eb-a010-8645ff5c3350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:59.145014 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58a00a-38ab-44eb-a010-8645ff5c3350 admin admin] PATH_INFO: `/v3/users/234536608975430184a6b4aeb1a32650` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:59.148963 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58a00a-38ab-44eb-a010-8645ff5c3350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=234536608975430184a6b4aeb1a32650)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:59.150408 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58a00a-38ab-44eb-a010-8645ff5c3350 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:59.269665 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-9a58a00a-38ab-44eb-a010-8645ff5c3350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '234536608975430184a6b4aeb1a32650'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:59.298594 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-9a58a00a-38ab-44eb-a010-8645ff5c3350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '234536608975430184a6b4aeb1a32650'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:59.301179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-9a58a00a-38ab-44eb-a010-8645ff5c3350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '234536608975430184a6b4aeb1a32650'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:59.317996 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-9a58a00a-38ab-44eb-a010-8645ff5c3350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '234536608975430184a6b4aeb1a32650'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:59.334730 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-9a58a00a-38ab-44eb-a010-8645ff5c3350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '234536608975430184a6b4aeb1a32650'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:34:59.351315 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1031/2062] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:34:58 2022] DELETE /identity/v3/users/234536608975430184a6b4aeb1a32650 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:34:59.354965 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db1239-42b2-4a2d-8469-1bc4bab8b8d9 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:59.355449 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db1239-42b2-4a2d-8469-1bc4bab8b8d9 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:59.355713 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db1239-42b2-4a2d-8469-1bc4bab8b8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:59.383015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-78db1239-42b2-4a2d-8469-1bc4bab8b8d9 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:34:59.384942 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-78db1239-42b2-4a2d-8469-1bc4bab8b8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:59.494034 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1032/2063] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:34:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:34:59.504617 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58a00a-38ab-44eb-a010-8645ff5c3350 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:34:59.506625 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-9a58a00a-38ab-44eb-a010-8645ff5c3350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:34:59.572507 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58a00a-38ab-44eb-a010-8645ff5c3350 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:34:59.576894 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3141d5-407d-4621-9a70-3670d3105bbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:34:59.577713 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3141d5-407d-4621-9a70-3670d3105bbd service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:34:59.578333 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3141d5-407d-4621-9a70-3670d3105bbd service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:34:59.578607 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3141d5-407d-4621-9a70-3670d3105bbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:34:59.589673 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3141d5-407d-4621-9a70-3670d3105bbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:34:59.591178 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3141d5-407d-4621-9a70-3670d3105bbd service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:34:59.601740 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1032/2064] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:34:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:35:00.421513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db1239-42b2-4a2d-8469-1bc4bab8b8d9 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:00.423467 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-78db1239-42b2-4a2d-8469-1bc4bab8b8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:00.437740 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db1239-42b2-4a2d-8469-1bc4bab8b8d9 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:00.445749 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f995ea-4aaa-4241-964c-bcbca498bdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:00.447235 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f995ea-4aaa-4241-964c-bcbca498bdac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:00.447526 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f995ea-4aaa-4241-964c-bcbca498bdac admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:00.447815 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f995ea-4aaa-4241-964c-bcbca498bdac admin admin] PATH_INFO: `/v3/projects/caf75d489ed449a697b4f2ddd0aa4177` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:00.449746 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f995ea-4aaa-4241-964c-bcbca498bdac admin admin] RBAC: Authorizing `identity:delete_project(project_id=caf75d489ed449a697b4f2ddd0aa4177)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:00.451855 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f995ea-4aaa-4241-964c-bcbca498bdac admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:00.569692 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-64f995ea-4aaa-4241-964c-bcbca498bdac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caf75d489ed449a697b4f2ddd0aa4177', 'request_id': 'req-64f995ea-4aaa-4241-964c-bcbca498bdac'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:00.578628 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-64f995ea-4aaa-4241-964c-bcbca498bdac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caf75d489ed449a697b4f2ddd0aa4177', 'request_id': 'req-64f995ea-4aaa-4241-964c-bcbca498bdac'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:00.589842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-64f995ea-4aaa-4241-964c-bcbca498bdac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caf75d489ed449a697b4f2ddd0aa4177', 'request_id': 'req-64f995ea-4aaa-4241-964c-bcbca498bdac'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:00.607134 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-64f995ea-4aaa-4241-964c-bcbca498bdac admin admin] The token cache is being invalidate because project caf75d489ed449a697b4f2ddd0aa4177 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:35:00.607421 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-64f995ea-4aaa-4241-964c-bcbca498bdac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:00.608443 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-64f995ea-4aaa-4241-964c-bcbca498bdac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:00.613608 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1033/2065] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:35:00 2022] DELETE /identity/v3/projects/caf75d489ed449a697b4f2ddd0aa4177 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:35:00.614792 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3141d5-407d-4621-9a70-3670d3105bbd service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:00.626983 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3141d5-407d-4621-9a70-3670d3105bbd service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:00.774053 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f4db4-5fd8-4737-bb23-c8cfeca63ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:00.775095 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f4db4-5fd8-4737-bb23-c8cfeca63ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:00.777790 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f4db4-5fd8-4737-bb23-c8cfeca63ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:00.778746 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f4db4-5fd8-4737-bb23-c8cfeca63ed5 admin admin] PATH_INFO: `/v3/users/4cce509bc1b845ee984057ebe7f34a5a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:00.784028 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f4db4-5fd8-4737-bb23-c8cfeca63ed5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cce509bc1b845ee984057ebe7f34a5a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:00.786677 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f4db4-5fd8-4737-bb23-c8cfeca63ed5 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:00.874227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-d14f4db4-5fd8-4737-bb23-c8cfeca63ed5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cce509bc1b845ee984057ebe7f34a5a'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:00.924700 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-d14f4db4-5fd8-4737-bb23-c8cfeca63ed5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cce509bc1b845ee984057ebe7f34a5a'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:00.925866 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-d14f4db4-5fd8-4737-bb23-c8cfeca63ed5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cce509bc1b845ee984057ebe7f34a5a'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:00.949300 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-d14f4db4-5fd8-4737-bb23-c8cfeca63ed5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cce509bc1b845ee984057ebe7f34a5a'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:00.971310 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-d14f4db4-5fd8-4737-bb23-c8cfeca63ed5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cce509bc1b845ee984057ebe7f34a5a'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:00.999135 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1033/2066] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:35:00 2022] DELETE /identity/v3/users/4cce509bc1b845ee984057ebe7f34a5a => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:35:01.677001 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f995ea-4aaa-4241-964c-bcbca498bdac admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:01.679121 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-64f995ea-4aaa-4241-964c-bcbca498bdac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:01.700890 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f995ea-4aaa-4241-964c-bcbca498bdac admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:01.825853 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d9645-22a0-4cbb-9a1e-e86b059e1fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:01.829474 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d9645-22a0-4cbb-9a1e-e86b059e1fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:01.830036 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d9645-22a0-4cbb-9a1e-e86b059e1fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:01.833647 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d9645-22a0-4cbb-9a1e-e86b059e1fd9 admin admin] PATH_INFO: `/v3/projects/0ec5d9ae7e9a4168904c157773b86557` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:01.835397 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d9645-22a0-4cbb-9a1e-e86b059e1fd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ec5d9ae7e9a4168904c157773b86557)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:01.837475 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d9645-22a0-4cbb-9a1e-e86b059e1fd9 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:01.912914 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-7b2d9645-22a0-4cbb-9a1e-e86b059e1fd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ec5d9ae7e9a4168904c157773b86557', 'request_id': 'req-7b2d9645-22a0-4cbb-9a1e-e86b059e1fd9'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:01.926411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-7b2d9645-22a0-4cbb-9a1e-e86b059e1fd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ec5d9ae7e9a4168904c157773b86557', 'request_id': 'req-7b2d9645-22a0-4cbb-9a1e-e86b059e1fd9'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:01.957485 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-7b2d9645-22a0-4cbb-9a1e-e86b059e1fd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ec5d9ae7e9a4168904c157773b86557', 'request_id': 'req-7b2d9645-22a0-4cbb-9a1e-e86b059e1fd9'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:01.991242 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-7b2d9645-22a0-4cbb-9a1e-e86b059e1fd9 admin admin] The token cache is being invalidate because project 0ec5d9ae7e9a4168904c157773b86557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:35:01.991660 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-7b2d9645-22a0-4cbb-9a1e-e86b059e1fd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:01.992332 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-7b2d9645-22a0-4cbb-9a1e-e86b059e1fd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:01.994308 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1034/2067] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:35:01 2022] DELETE /identity/v3/projects/0ec5d9ae7e9a4168904c157773b86557 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:35:01.999133 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d96b1-0784-4331-bc5b-3c99ea0aaaf0 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:01.999706 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d96b1-0784-4331-bc5b-3c99ea0aaaf0 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:01.999706 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d96b1-0784-4331-bc5b-3c99ea0aaaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:02.032136 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-e96d96b1-0784-4331-bc5b-3c99ea0aaaf0 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:35:02.033727 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-e96d96b1-0784-4331-bc5b-3c99ea0aaaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:02.126705 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1034/2068] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:35:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:35:02.135710 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557a263-e4f7-400b-a8b3-a8d443534eb6 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:02.136284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557a263-e4f7-400b-a8b3-a8d443534eb6 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:02.136749 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557a263-e4f7-400b-a8b3-a8d443534eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:02.175870 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-1557a263-e4f7-400b-a8b3-a8d443534eb6 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:35:02.177155 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-1557a263-e4f7-400b-a8b3-a8d443534eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:02.202744 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1035/2069] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:35:02.203587 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d96b1-0784-4331-bc5b-3c99ea0aaaf0 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:02.215252 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d96b1-0784-4331-bc5b-3c99ea0aaaf0 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:02.220307 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81f711-200c-4776-a4b9-c8c0f16a2899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:02.221201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81f711-200c-4776-a4b9-c8c0f16a2899 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:02.221660 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81f711-200c-4776-a4b9-c8c0f16a2899 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:02.222139 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81f711-200c-4776-a4b9-c8c0f16a2899 admin admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:02.223319 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81f711-200c-4776-a4b9-c8c0f16a2899 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:35:02.223969 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81f711-200c-4776-a4b9-c8c0f16a2899 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:02.226149 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81f711-200c-4776-a4b9-c8c0f16a2899 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:02.246632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557a263-e4f7-400b-a8b3-a8d443534eb6 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:02.252504 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1035/2070] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:35:02.258217 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557a263-e4f7-400b-a8b3-a8d443534eb6 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:02.264131 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463f665-a9a2-4bc4-abbd-bb13ac825dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:02.265065 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463f665-a9a2-4bc4-abbd-bb13ac825dae admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:02.265415 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463f665-a9a2-4bc4-abbd-bb13ac825dae admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:02.265846 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463f665-a9a2-4bc4-abbd-bb13ac825dae admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:02.266767 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463f665-a9a2-4bc4-abbd-bb13ac825dae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:02.269342 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7463f665-a9a2-4bc4-abbd-bb13ac825dae admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:02.303371 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1036/2071] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:35:02 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:35:02.304706 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81f711-200c-4776-a4b9-c8c0f16a2899 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:02.317390 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81f711-200c-4776-a4b9-c8c0f16a2899 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:02.404211 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581e44d-5e17-488f-a7ef-fed2068876fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:02.405171 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581e44d-5e17-488f-a7ef-fed2068876fd admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:02.405641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581e44d-5e17-488f-a7ef-fed2068876fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:02.405940 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581e44d-5e17-488f-a7ef-fed2068876fd admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:02.406635 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581e44d-5e17-488f-a7ef-fed2068876fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:02.408759 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581e44d-5e17-488f-a7ef-fed2068876fd admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:02.448362 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1036/2072] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:35:02 2022] POST /identity/v3/users => generated 284 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:35:02.449053 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463f665-a9a2-4bc4-abbd-bb13ac825dae admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:02.460171 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463f665-a9a2-4bc4-abbd-bb13ac825dae admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:02.467164 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaff6cc-f217-4dc2-92b1-c846cd645773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:02.468096 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaff6cc-f217-4dc2-92b1-c846cd645773 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:02.468532 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaff6cc-f217-4dc2-92b1-c846cd645773 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:02.469079 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaff6cc-f217-4dc2-92b1-c846cd645773 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:02.470043 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaff6cc-f217-4dc2-92b1-c846cd645773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:02.471891 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaff6cc-f217-4dc2-92b1-c846cd645773 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:02.483392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1037/2073] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:35:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 09:35:02.487945 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581e44d-5e17-488f-a7ef-fed2068876fd admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:02.504174 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581e44d-5e17-488f-a7ef-fed2068876fd admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:02.509801 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f6480-b880-4e5f-b693-095e2cefe668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:02.510658 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f6480-b880-4e5f-b693-095e2cefe668 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:02.511035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f6480-b880-4e5f-b693-095e2cefe668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:02.511574 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f6480-b880-4e5f-b693-095e2cefe668 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:02.512709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f6480-b880-4e5f-b693-095e2cefe668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:02.515046 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f6480-b880-4e5f-b693-095e2cefe668 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:02.527995 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1037/2074] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:35:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:35:02.532232 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaff6cc-f217-4dc2-92b1-c846cd645773 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:02.545037 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaff6cc-f217-4dc2-92b1-c846cd645773 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:02.549861 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b1666-6d48-40a6-ab3b-29f1f5ce324f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:02.551024 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b1666-6d48-40a6-ab3b-29f1f5ce324f admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:02.551470 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b1666-6d48-40a6-ab3b-29f1f5ce324f admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:02.551891 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b1666-6d48-40a6-ab3b-29f1f5ce324f admin admin] PATH_INFO: `/v3/projects/a450c3a8771d4f89a595aa3eca210a8f/users/1707a9f4304e4ae18e79b244a5578126/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:02.571106 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b1666-6d48-40a6-ab3b-29f1f5ce324f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a450c3a8771d4f89a595aa3eca210a8f, user_id=1707a9f4304e4ae18e79b244a5578126, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:02.574131 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b1666-6d48-40a6-ab3b-29f1f5ce324f admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:02.594782 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1038/2075] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:35:02 2022] PUT /identity/v3/projects/a450c3a8771d4f89a595aa3eca210a8f/users/1707a9f4304e4ae18e79b244a5578126/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:35:02.608295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169e712-fc7b-4d5d-a705-72bd6367bbc5 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:02.608770 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169e712-fc7b-4d5d-a705-72bd6367bbc5 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:02.609150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169e712-fc7b-4d5d-a705-72bd6367bbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:02.643100 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-3169e712-fc7b-4d5d-a705-72bd6367bbc5 None None] MFA Rules not processed for user `1707a9f4304e4ae18e79b244a5578126`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:35:02.644506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-3169e712-fc7b-4d5d-a705-72bd6367bbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:02.813546 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1038/2076] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:35:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:35:02.831043 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b1666-6d48-40a6-ab3b-29f1f5ce324f admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:02.832939 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-e65b1666-6d48-40a6-ab3b-29f1f5ce324f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:02.923302 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b1666-6d48-40a6-ab3b-29f1f5ce324f admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:02.935380 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dcc76-2d04-45e7-a815-f7aaaede5b41 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0981a8c6d9ac413b99aae95a6cdd3be5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:02.936628 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dcc76-2d04-45e7-a815-f7aaaede5b41 service glance] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:02.937131 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dcc76-2d04-45e7-a815-f7aaaede5b41 service glance] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:02.937639 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dcc76-2d04-45e7-a815-f7aaaede5b41 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:02.958193 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0dcc76-2d04-45e7-a815-f7aaaede5b41 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:02.962839 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0dcc76-2d04-45e7-a815-f7aaaede5b41 service glance] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:02.981267 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1039/2077] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:35:02 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:35:08.053418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21426f3d-ca59-418a-bf84-e368fd82d706 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:08.054038 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21426f3d-ca59-418a-bf84-e368fd82d706 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:08.054038 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21426f3d-ca59-418a-bf84-e368fd82d706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:08.075371 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-21426f3d-ca59-418a-bf84-e368fd82d706 None None] MFA Rules not processed for user `1174087be0a7412d8dbba6f4f56c3424`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:35:08.076177 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-21426f3d-ca59-418a-bf84-e368fd82d706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:08.144865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1039/2078] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:35:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:35:25.233189 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dcc76-2d04-45e7-a815-f7aaaede5b41 service glance] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:25.234643 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-8b0dcc76-2d04-45e7-a815-f7aaaede5b41 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:25.299358 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dcc76-2d04-45e7-a815-f7aaaede5b41 service glance] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:25.304415 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addc1eb-bf33-411c-8e61-cfc721b5761a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:25.305268 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addc1eb-bf33-411c-8e61-cfc721b5761a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:25.305546 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addc1eb-bf33-411c-8e61-cfc721b5761a admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:25.305813 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addc1eb-bf33-411c-8e61-cfc721b5761a admin admin] PATH_INFO: `/v3/users/952c745ed8f447b991c7a1cf95c322d0` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:25.307015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addc1eb-bf33-411c-8e61-cfc721b5761a admin admin] RBAC: Authorizing `identity:delete_user(user_id=952c745ed8f447b991c7a1cf95c322d0)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:25.308903 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addc1eb-bf33-411c-8e61-cfc721b5761a admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:25.353852 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-8addc1eb-bf33-411c-8e61-cfc721b5761a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '952c745ed8f447b991c7a1cf95c322d0'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:25.365471 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-8addc1eb-bf33-411c-8e61-cfc721b5761a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '952c745ed8f447b991c7a1cf95c322d0'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:25.366181 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-8addc1eb-bf33-411c-8e61-cfc721b5761a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '952c745ed8f447b991c7a1cf95c322d0'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:25.373100 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-8addc1eb-bf33-411c-8e61-cfc721b5761a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '952c745ed8f447b991c7a1cf95c322d0'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:25.379816 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-8addc1eb-bf33-411c-8e61-cfc721b5761a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '952c745ed8f447b991c7a1cf95c322d0'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:25.385791 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1040/2079] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:35:25 2022] DELETE /identity/v3/users/952c745ed8f447b991c7a1cf95c322d0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:35:25.390270 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ac0f2-57b5-4e67-9de8-8fcd42d83893 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:25.390735 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ac0f2-57b5-4e67-9de8-8fcd42d83893 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:25.390850 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ac0f2-57b5-4e67-9de8-8fcd42d83893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:25.408589 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-7b3ac0f2-57b5-4e67-9de8-8fcd42d83893 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:35:25.409787 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-7b3ac0f2-57b5-4e67-9de8-8fcd42d83893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:25.468439 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1040/2080] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:35:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:35:25.478884 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addc1eb-bf33-411c-8e61-cfc721b5761a admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:25.480309 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-8addc1eb-bf33-411c-8e61-cfc721b5761a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:25.535875 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addc1eb-bf33-411c-8e61-cfc721b5761a admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:25.540321 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa213a1-884c-4b7d-ab3a-4bb6a8837207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:25.540958 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa213a1-884c-4b7d-ab3a-4bb6a8837207 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:25.541234 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa213a1-884c-4b7d-ab3a-4bb6a8837207 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:25.541504 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa213a1-884c-4b7d-ab3a-4bb6a8837207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:25.550385 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa213a1-884c-4b7d-ab3a-4bb6a8837207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:25.551832 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa213a1-884c-4b7d-ab3a-4bb6a8837207 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:25.561210 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1041/2081] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:35:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:35:25.888373 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ac0f2-57b5-4e67-9de8-8fcd42d83893 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:25.889830 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-7b3ac0f2-57b5-4e67-9de8-8fcd42d83893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:25.901953 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ac0f2-57b5-4e67-9de8-8fcd42d83893 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:25.906535 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163553d4-3b0d-4363-a476-6221672430bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:25.907399 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163553d4-3b0d-4363-a476-6221672430bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:25.907679 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163553d4-3b0d-4363-a476-6221672430bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:25.908555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163553d4-3b0d-4363-a476-6221672430bd admin admin] PATH_INFO: `/v3/projects/5338e4ba741c47c18b7fa2a8d72c07f9` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:25.918635 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163553d4-3b0d-4363-a476-6221672430bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5338e4ba741c47c18b7fa2a8d72c07f9)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:25.920645 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163553d4-3b0d-4363-a476-6221672430bd admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:25.985051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-163553d4-3b0d-4363-a476-6221672430bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5338e4ba741c47c18b7fa2a8d72c07f9', 'request_id': 'req-163553d4-3b0d-4363-a476-6221672430bd'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:25.992592 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-163553d4-3b0d-4363-a476-6221672430bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5338e4ba741c47c18b7fa2a8d72c07f9', 'request_id': 'req-163553d4-3b0d-4363-a476-6221672430bd'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:26.000466 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-163553d4-3b0d-4363-a476-6221672430bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5338e4ba741c47c18b7fa2a8d72c07f9', 'request_id': 'req-163553d4-3b0d-4363-a476-6221672430bd'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:26.020014 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-163553d4-3b0d-4363-a476-6221672430bd admin admin] The token cache is being invalidate because project 5338e4ba741c47c18b7fa2a8d72c07f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:35:26.020304 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-163553d4-3b0d-4363-a476-6221672430bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:26.021483 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-163553d4-3b0d-4363-a476-6221672430bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:26.023374 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1041/2082] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:35:25 2022] DELETE /identity/v3/projects/5338e4ba741c47c18b7fa2a8d72c07f9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:35:26.027186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa213a1-884c-4b7d-ab3a-4bb6a8837207 service neutron] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:26.038611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa213a1-884c-4b7d-ab3a-4bb6a8837207 service neutron] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:26.148887 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2469a4d-c791-4474-9f99-4b5c0415be71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:26.150017 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2469a4d-c791-4474-9f99-4b5c0415be71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:26.150320 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2469a4d-c791-4474-9f99-4b5c0415be71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:26.150648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2469a4d-c791-4474-9f99-4b5c0415be71 admin admin] PATH_INFO: `/v3/users/90051f2983f34bd68f0bdb5cb7c81a44` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:26.151845 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2469a4d-c791-4474-9f99-4b5c0415be71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90051f2983f34bd68f0bdb5cb7c81a44)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:26.153782 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2469a4d-c791-4474-9f99-4b5c0415be71 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:26.202550 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-b2469a4d-c791-4474-9f99-4b5c0415be71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90051f2983f34bd68f0bdb5cb7c81a44'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:26.214961 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-b2469a4d-c791-4474-9f99-4b5c0415be71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90051f2983f34bd68f0bdb5cb7c81a44'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:26.215644 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-b2469a4d-c791-4474-9f99-4b5c0415be71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90051f2983f34bd68f0bdb5cb7c81a44'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:26.222732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-b2469a4d-c791-4474-9f99-4b5c0415be71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90051f2983f34bd68f0bdb5cb7c81a44'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:26.230064 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-b2469a4d-c791-4474-9f99-4b5c0415be71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90051f2983f34bd68f0bdb5cb7c81a44'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:26.235773 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1042/2083] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:35:26 2022] DELETE /identity/v3/users/90051f2983f34bd68f0bdb5cb7c81a44 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:35:26.489404 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163553d4-3b0d-4363-a476-6221672430bd admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:26.490901 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-163553d4-3b0d-4363-a476-6221672430bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:26.503685 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163553d4-3b0d-4363-a476-6221672430bd admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:26.557849 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed579b74-d19b-4db2-8298-728de4d75547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:26.558743 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed579b74-d19b-4db2-8298-728de4d75547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:26.559114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed579b74-d19b-4db2-8298-728de4d75547 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:26.559443 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed579b74-d19b-4db2-8298-728de4d75547 admin admin] PATH_INFO: `/v3/projects/e8a4e10d77ce4070989981f6bd442764` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:26.560686 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed579b74-d19b-4db2-8298-728de4d75547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8a4e10d77ce4070989981f6bd442764)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:26.562623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed579b74-d19b-4db2-8298-728de4d75547 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:26.607301 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-ed579b74-d19b-4db2-8298-728de4d75547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8a4e10d77ce4070989981f6bd442764', 'request_id': 'req-ed579b74-d19b-4db2-8298-728de4d75547'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:26.612701 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-ed579b74-d19b-4db2-8298-728de4d75547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8a4e10d77ce4070989981f6bd442764', 'request_id': 'req-ed579b74-d19b-4db2-8298-728de4d75547'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:26.619826 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-ed579b74-d19b-4db2-8298-728de4d75547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8a4e10d77ce4070989981f6bd442764', 'request_id': 'req-ed579b74-d19b-4db2-8298-728de4d75547'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:26.630814 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-ed579b74-d19b-4db2-8298-728de4d75547 admin admin] The token cache is being invalidate because project e8a4e10d77ce4070989981f6bd442764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:35:26.631094 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-ed579b74-d19b-4db2-8298-728de4d75547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:26.631709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-ed579b74-d19b-4db2-8298-728de4d75547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:26.633226 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1042/2084] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:35:26 2022] DELETE /identity/v3/projects/e8a4e10d77ce4070989981f6bd442764 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:35:26.638316 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983b1fa-269c-42c9-be26-d5de071bfaf7 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:26.638604 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983b1fa-269c-42c9-be26-d5de071bfaf7 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:26.638879 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983b1fa-269c-42c9-be26-d5de071bfaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:26.656914 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-d983b1fa-269c-42c9-be26-d5de071bfaf7 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:35:26.658203 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-d983b1fa-269c-42c9-be26-d5de071bfaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:26.719236 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1043/2085] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:35:26.728458 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ddb0c-6f12-4245-bc93-4f008e567058 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:26.728858 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ddb0c-6f12-4245-bc93-4f008e567058 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:26.729141 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ddb0c-6f12-4245-bc93-4f008e567058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:26.747887 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-3c2ddb0c-6f12-4245-bc93-4f008e567058 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:35:26.749056 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-3c2ddb0c-6f12-4245-bc93-4f008e567058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:26.756946 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1043/2086] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:35:26.761190 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983b1fa-269c-42c9-be26-d5de071bfaf7 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:26.771311 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983b1fa-269c-42c9-be26-d5de071bfaf7 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:26.775815 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf784c-160e-46b1-8942-df6c5b95c3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:26.776454 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf784c-160e-46b1-8942-df6c5b95c3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:26.776730 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf784c-160e-46b1-8942-df6c5b95c3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:26.776996 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf784c-160e-46b1-8942-df6c5b95c3e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:26.777713 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf784c-160e-46b1-8942-df6c5b95c3e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:35:26.778056 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf784c-160e-46b1-8942-df6c5b95c3e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:26.779628 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf784c-160e-46b1-8942-df6c5b95c3e0 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:26.791191 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1044/2087] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:35:26.795315 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ddb0c-6f12-4245-bc93-4f008e567058 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:26.804409 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ddb0c-6f12-4245-bc93-4f008e567058 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:26.809074 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d59d3-0f73-4979-9b34-6dc855ee309a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:26.809718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d59d3-0f73-4979-9b34-6dc855ee309a admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:26.810044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d59d3-0f73-4979-9b34-6dc855ee309a admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:26.810324 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d59d3-0f73-4979-9b34-6dc855ee309a admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:26.811017 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d59d3-0f73-4979-9b34-6dc855ee309a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:26.812895 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d59d3-0f73-4979-9b34-6dc855ee309a admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:26.837462 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1044/2088] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:35:26 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:35:26.841469 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf784c-160e-46b1-8942-df6c5b95c3e0 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:26.851962 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf784c-160e-46b1-8942-df6c5b95c3e0 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:26.905757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8a675-88dd-4b5b-b860-3399a37e4f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:26.906444 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8a675-88dd-4b5b-b860-3399a37e4f36 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:26.906751 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8a675-88dd-4b5b-b860-3399a37e4f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:26.907024 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8a675-88dd-4b5b-b860-3399a37e4f36 admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:26.907711 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8a675-88dd-4b5b-b860-3399a37e4f36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:26.909618 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8a675-88dd-4b5b-b860-3399a37e4f36 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:26.930370 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1045/2089] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:35:26 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:35:26.935548 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d59d3-0f73-4979-9b34-6dc855ee309a admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:26.946210 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d59d3-0f73-4979-9b34-6dc855ee309a admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:26.951103 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0ee27-ac54-43ee-becb-d1a8b5f28004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:26.951769 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0ee27-ac54-43ee-becb-d1a8b5f28004 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:26.952048 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0ee27-ac54-43ee-becb-d1a8b5f28004 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:26.952318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0ee27-ac54-43ee-becb-d1a8b5f28004 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:26.953036 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca0ee27-ac54-43ee-becb-d1a8b5f28004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:26.954696 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca0ee27-ac54-43ee-becb-d1a8b5f28004 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:26.965399 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1045/2090] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:35:26.969487 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8a675-88dd-4b5b-b860-3399a37e4f36 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:26.983968 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8a675-88dd-4b5b-b860-3399a37e4f36 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:26.989191 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb724a10-6b70-44ef-b5af-a0eac5e639de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:26.990396 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb724a10-6b70-44ef-b5af-a0eac5e639de admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:26.990852 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb724a10-6b70-44ef-b5af-a0eac5e639de admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:26.990986 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb724a10-6b70-44ef-b5af-a0eac5e639de admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:26.991676 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb724a10-6b70-44ef-b5af-a0eac5e639de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:26.993309 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb724a10-6b70-44ef-b5af-a0eac5e639de admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:27.005852 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1046/2091] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:35:27.010366 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0ee27-ac54-43ee-becb-d1a8b5f28004 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:27.020329 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0ee27-ac54-43ee-becb-d1a8b5f28004 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:27.024908 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47331886-5aa4-4738-aabf-d85b6558d92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:27.025814 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47331886-5aa4-4738-aabf-d85b6558d92c admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:27.026123 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47331886-5aa4-4738-aabf-d85b6558d92c admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:27.026398 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47331886-5aa4-4738-aabf-d85b6558d92c admin admin] PATH_INFO: `/v3/projects/6d263900f7804e13bd7f90593e711125/users/554dd16c98264eec8c7819fdcce4ec3f/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:27.040768 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47331886-5aa4-4738-aabf-d85b6558d92c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d263900f7804e13bd7f90593e711125, user_id=554dd16c98264eec8c7819fdcce4ec3f, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:27.043423 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47331886-5aa4-4738-aabf-d85b6558d92c admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:27.058085 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1046/2092] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:35:27 2022] PUT /identity/v3/projects/6d263900f7804e13bd7f90593e711125/users/554dd16c98264eec8c7819fdcce4ec3f/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:35:27.069262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b1a50-d241-417c-93f3-948443e53783 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:27.069555 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b1a50-d241-417c-93f3-948443e53783 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:27.069832 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b1a50-d241-417c-93f3-948443e53783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:27.100012 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-d47b1a50-d241-417c-93f3-948443e53783 None None] MFA Rules not processed for user `554dd16c98264eec8c7819fdcce4ec3f`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:35:27.101547 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-d47b1a50-d241-417c-93f3-948443e53783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:27.166769 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1047/2093] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:35:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:35:27.171403 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47331886-5aa4-4738-aabf-d85b6558d92c admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:27.257031 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47331886-5aa4-4738-aabf-d85b6558d92c admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:27.263152 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8977835-4aff-4942-bd6d-6d84cc799289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:27.264045 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8977835-4aff-4942-bd6d-6d84cc799289 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:27.264620 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8977835-4aff-4942-bd6d-6d84cc799289 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:27.264995 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8977835-4aff-4942-bd6d-6d84cc799289 admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:27.267198 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8977835-4aff-4942-bd6d-6d84cc799289 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:27.269353 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8977835-4aff-4942-bd6d-6d84cc799289 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:27.300043 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1047/2094] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:35:27 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:35:27.304261 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b1a50-d241-417c-93f3-948443e53783 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:27.315085 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b1a50-d241-417c-93f3-948443e53783 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:27.371598 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df2f6c-d185-4c07-9a4c-9de0e71eda49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:27.372268 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df2f6c-d185-4c07-9a4c-9de0e71eda49 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:27.372552 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df2f6c-d185-4c07-9a4c-9de0e71eda49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:27.372822 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df2f6c-d185-4c07-9a4c-9de0e71eda49 admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:27.373519 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df2f6c-d185-4c07-9a4c-9de0e71eda49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:27.375471 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df2f6c-d185-4c07-9a4c-9de0e71eda49 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:27.397665 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1048/2095] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:35:27 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:35:27.401848 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8977835-4aff-4942-bd6d-6d84cc799289 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:27.412768 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8977835-4aff-4942-bd6d-6d84cc799289 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:27.417386 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bf014-6aac-4b87-b6d5-2171787c9a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:27.418078 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bf014-6aac-4b87-b6d5-2171787c9a2d admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:27.418363 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bf014-6aac-4b87-b6d5-2171787c9a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:27.418637 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bf014-6aac-4b87-b6d5-2171787c9a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:27.419361 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bf014-6aac-4b87-b6d5-2171787c9a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:27.420936 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bf014-6aac-4b87-b6d5-2171787c9a2d admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:27.431151 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1048/2096] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:35:27.435071 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df2f6c-d185-4c07-9a4c-9de0e71eda49 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:27.445366 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df2f6c-d185-4c07-9a4c-9de0e71eda49 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:27.449996 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f3658-a0a4-4063-b1c8-24f15c7fb0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:27.450864 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f3658-a0a4-4063-b1c8-24f15c7fb0fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:27.451142 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f3658-a0a4-4063-b1c8-24f15c7fb0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:27.451412 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f3658-a0a4-4063-b1c8-24f15c7fb0fe admin admin] PATH_INFO: `/v3/projects/4ac06347568e4fbc9d11c6624cce2925/users/be6297b666c6439ea81f81c02c7c4eea/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:27.466413 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f3658-a0a4-4063-b1c8-24f15c7fb0fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac06347568e4fbc9d11c6624cce2925, user_id=be6297b666c6439ea81f81c02c7c4eea, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:27.469039 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f3658-a0a4-4063-b1c8-24f15c7fb0fe admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:27.481294 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1049/2097] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:35:27 2022] PUT /identity/v3/projects/4ac06347568e4fbc9d11c6624cce2925/users/be6297b666c6439ea81f81c02c7c4eea/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:35:27.485094 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bf014-6aac-4b87-b6d5-2171787c9a2d admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:27.495573 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bf014-6aac-4b87-b6d5-2171787c9a2d admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:27.549564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d4a91-6855-40fd-8a75-c337684c35d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:27.550197 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d4a91-6855-40fd-8a75-c337684c35d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:27.550485 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d4a91-6855-40fd-8a75-c337684c35d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:27.550763 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d4a91-6855-40fd-8a75-c337684c35d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:27.551486 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d4a91-6855-40fd-8a75-c337684c35d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:27.553567 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d4a91-6855-40fd-8a75-c337684c35d0 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:27.563022 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1049/2098] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:35:27.567061 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f3658-a0a4-4063-b1c8-24f15c7fb0fe admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:27.577314 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f3658-a0a4-4063-b1c8-24f15c7fb0fe admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:27.581881 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16ad49-f1c0-48b9-9452-c76f2decd0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:27.582777 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16ad49-f1c0-48b9-9452-c76f2decd0ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:27.583057 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16ad49-f1c0-48b9-9452-c76f2decd0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:27.583825 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16ad49-f1c0-48b9-9452-c76f2decd0ee admin admin] PATH_INFO: `/v3/projects/4ac06347568e4fbc9d11c6624cce2925/users/be6297b666c6439ea81f81c02c7c4eea/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:27.585794 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16ad49-f1c0-48b9-9452-c76f2decd0ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac06347568e4fbc9d11c6624cce2925, user_id=be6297b666c6439ea81f81c02c7c4eea, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:27.588772 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16ad49-f1c0-48b9-9452-c76f2decd0ee admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:27.598579 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1050/2099] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:35:27 2022] PUT /identity/v3/projects/4ac06347568e4fbc9d11c6624cce2925/users/be6297b666c6439ea81f81c02c7c4eea/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:35:27.609102 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c38807-a982-4ef7-ba72-9882d918be04 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:27.609395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c38807-a982-4ef7-ba72-9882d918be04 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:27.609673 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c38807-a982-4ef7-ba72-9882d918be04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:27.634933 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-91c38807-a982-4ef7-ba72-9882d918be04 None None] MFA Rules not processed for user `be6297b666c6439ea81f81c02c7c4eea`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:35:27.636117 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-91c38807-a982-4ef7-ba72-9882d918be04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:27.702132 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1050/2100] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:35:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:35:27.714646 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16ad49-f1c0-48b9-9452-c76f2decd0ee admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:27.716325 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-cc16ad49-f1c0-48b9-9452-c76f2decd0ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:27.772947 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16ad49-f1c0-48b9-9452-c76f2decd0ee admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:27.776633 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de272bdb-1bb8-46fc-9306-03f12c1bf974 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:27.777270 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de272bdb-1bb8-46fc-9306-03f12c1bf974 service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:27.777554 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de272bdb-1bb8-46fc-9306-03f12c1bf974 service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:27.777833 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de272bdb-1bb8-46fc-9306-03f12c1bf974 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:27.787324 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de272bdb-1bb8-46fc-9306-03f12c1bf974 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:27.788756 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de272bdb-1bb8-46fc-9306-03f12c1bf974 service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:27.798136 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1051/2101] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:35:27 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:35:28.091121 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c38807-a982-4ef7-ba72-9882d918be04 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:28.102208 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c38807-a982-4ef7-ba72-9882d918be04 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:28.108183 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26044ba4-3e84-4094-b29c-8782d0e50e84 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be6297b666c6439ea81f81c02c7c4eea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ac06347568e4fbc9d11c6624cce2925', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:28.109404 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26044ba4-3e84-4094-b29c-8782d0e50e84 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:28.109772 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26044ba4-3e84-4094-b29c-8782d0e50e84 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:28.110087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26044ba4-3e84-4094-b29c-8782d0e50e84 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:28.110915 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26044ba4-3e84-4094-b29c-8782d0e50e84 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:35:28.111289 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26044ba4-3e84-4094-b29c-8782d0e50e84 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:28.113210 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26044ba4-3e84-4094-b29c-8782d0e50e84 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:28.126826 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1051/2102] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:35:28.131534 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de272bdb-1bb8-46fc-9306-03f12c1bf974 service cinder] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:28.140805 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de272bdb-1bb8-46fc-9306-03f12c1bf974 service cinder] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:28.145365 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1bedb0-6029-4c2e-a247-7d56b615d9a2 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be6297b666c6439ea81f81c02c7c4eea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ac06347568e4fbc9d11c6624cce2925', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:28.146595 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bedb0-6029-4c2e-a247-7d56b615d9a2 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:28.146881 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bedb0-6029-4c2e-a247-7d56b615d9a2 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:28.147154 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bedb0-6029-4c2e-a247-7d56b615d9a2 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:28.147853 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1bedb0-6029-4c2e-a247-7d56b615d9a2 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:28.149722 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1bedb0-6029-4c2e-a247-7d56b615d9a2 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:28.174749 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1052/2103] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:35:28 2022] POST /identity/v3/projects => generated 355 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:35:28.179385 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26044ba4-3e84-4094-b29c-8782d0e50e84 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:28.189115 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26044ba4-3e84-4094-b29c-8782d0e50e84 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:28.244746 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ffc65c-d1fe-4dc3-9f66-165038ded341 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be6297b666c6439ea81f81c02c7c4eea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ac06347568e4fbc9d11c6624cce2925', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:28.245525 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffc65c-d1fe-4dc3-9f66-165038ded341 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:28.245821 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffc65c-d1fe-4dc3-9f66-165038ded341 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:28.246128 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffc65c-d1fe-4dc3-9f66-165038ded341 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:28.247024 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ffc65c-d1fe-4dc3-9f66-165038ded341 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:35:28.247334 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ffc65c-d1fe-4dc3-9f66-165038ded341 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:28.248912 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ffc65c-d1fe-4dc3-9f66-165038ded341 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:28.261594 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1052/2104] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:35:28.305971 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1bedb0-6029-4c2e-a247-7d56b615d9a2 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:28.317050 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1bedb0-6029-4c2e-a247-7d56b615d9a2 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:28.321799 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bf2b8-a323-4220-9748-032667fa33b3 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be6297b666c6439ea81f81c02c7c4eea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ac06347568e4fbc9d11c6624cce2925', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:28.322971 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bf2b8-a323-4220-9748-032667fa33b3 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:28.323216 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bf2b8-a323-4220-9748-032667fa33b3 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:28.323588 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bf2b8-a323-4220-9748-032667fa33b3 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] PATH_INFO: `/v3/projects/9ec90810446f4b92a79c3ace45aafd7a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:28.325522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8bf2b8-a323-4220-9748-032667fa33b3 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9ec90810446f4b92a79c3ace45aafd7a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:28.327904 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8bf2b8-a323-4220-9748-032667fa33b3 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:28.376269 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-ac8bf2b8-a323-4220-9748-032667fa33b3 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ec90810446f4b92a79c3ace45aafd7a', 'request_id': 'req-ac8bf2b8-a323-4220-9748-032667fa33b3'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:28.383029 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-ac8bf2b8-a323-4220-9748-032667fa33b3 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ec90810446f4b92a79c3ace45aafd7a', 'request_id': 'req-ac8bf2b8-a323-4220-9748-032667fa33b3'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:28.394180 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-ac8bf2b8-a323-4220-9748-032667fa33b3 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ec90810446f4b92a79c3ace45aafd7a', 'request_id': 'req-ac8bf2b8-a323-4220-9748-032667fa33b3'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:28.419770 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-ac8bf2b8-a323-4220-9748-032667fa33b3 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] The token cache is being invalidate because project 9ec90810446f4b92a79c3ace45aafd7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:35:28.420624 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-ac8bf2b8-a323-4220-9748-032667fa33b3 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:28.421360 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-ac8bf2b8-a323-4220-9748-032667fa33b3 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:28.423458 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1053/2105] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:35:28 2022] DELETE /identity/v3/projects/9ec90810446f4b92a79c3ace45aafd7a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:35:28.657081 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ffc65c-d1fe-4dc3-9f66-165038ded341 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:28.659145 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-e2ffc65c-d1fe-4dc3-9f66-165038ded341 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:28.732080 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ffc65c-d1fe-4dc3-9f66-165038ded341 tempest-VolumeQuotaClassesTest-899025299 tempest-VolumeQuotaClassesTest-899025299-project-admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:28.791146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb49ad7-4a7c-4cb7-9a8f-e676f03afc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:28.792167 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb49ad7-4a7c-4cb7-9a8f-e676f03afc76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:28.792746 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb49ad7-4a7c-4cb7-9a8f-e676f03afc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:28.793072 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb49ad7-4a7c-4cb7-9a8f-e676f03afc76 admin admin] PATH_INFO: `/v3/users/554dd16c98264eec8c7819fdcce4ec3f` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:28.794561 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb49ad7-4a7c-4cb7-9a8f-e676f03afc76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=554dd16c98264eec8c7819fdcce4ec3f)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:28.797434 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb49ad7-4a7c-4cb7-9a8f-e676f03afc76 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:28.852894 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-ffb49ad7-4a7c-4cb7-9a8f-e676f03afc76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '554dd16c98264eec8c7819fdcce4ec3f'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:28.865358 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-ffb49ad7-4a7c-4cb7-9a8f-e676f03afc76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '554dd16c98264eec8c7819fdcce4ec3f'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:28.866124 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-ffb49ad7-4a7c-4cb7-9a8f-e676f03afc76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '554dd16c98264eec8c7819fdcce4ec3f'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:28.875556 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-ffb49ad7-4a7c-4cb7-9a8f-e676f03afc76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '554dd16c98264eec8c7819fdcce4ec3f'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:28.883465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-ffb49ad7-4a7c-4cb7-9a8f-e676f03afc76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '554dd16c98264eec8c7819fdcce4ec3f'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:28.889683 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1053/2106] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:35:28 2022] DELETE /identity/v3/users/554dd16c98264eec8c7819fdcce4ec3f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:35:28.894523 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921d118-1c37-4cca-b694-e33989e0b542 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:28.894881 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921d118-1c37-4cca-b694-e33989e0b542 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:28.895246 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921d118-1c37-4cca-b694-e33989e0b542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:28.913645 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-f921d118-1c37-4cca-b694-e33989e0b542 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:35:28.914883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-f921d118-1c37-4cca-b694-e33989e0b542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:28.976972 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1054/2107] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:35:28.987679 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb49ad7-4a7c-4cb7-9a8f-e676f03afc76 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:28.989039 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-ffb49ad7-4a7c-4cb7-9a8f-e676f03afc76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:29.046122 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb49ad7-4a7c-4cb7-9a8f-e676f03afc76 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:29.049919 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf7145-cf36-4171-9f9b-24ba85a674aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:29.050598 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf7145-cf36-4171-9f9b-24ba85a674aa service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:29.050993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf7145-cf36-4171-9f9b-24ba85a674aa service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:29.051311 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf7145-cf36-4171-9f9b-24ba85a674aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:29.060826 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf7145-cf36-4171-9f9b-24ba85a674aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:29.062291 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf7145-cf36-4171-9f9b-24ba85a674aa service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:29.072093 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1054/2108] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:35:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:35:29.325174 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921d118-1c37-4cca-b694-e33989e0b542 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:29.326730 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-f921d118-1c37-4cca-b694-e33989e0b542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:29.339159 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921d118-1c37-4cca-b694-e33989e0b542 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:29.343940 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c651260-8a4b-48cd-a0bd-2e5abee018c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:29.344915 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c651260-8a4b-48cd-a0bd-2e5abee018c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:29.345261 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c651260-8a4b-48cd-a0bd-2e5abee018c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:29.345693 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c651260-8a4b-48cd-a0bd-2e5abee018c4 admin admin] PATH_INFO: `/v3/projects/6d263900f7804e13bd7f90593e711125` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:29.347081 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c651260-8a4b-48cd-a0bd-2e5abee018c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d263900f7804e13bd7f90593e711125)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:29.349555 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c651260-8a4b-48cd-a0bd-2e5abee018c4 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:29.394979 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-2c651260-8a4b-48cd-a0bd-2e5abee018c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d263900f7804e13bd7f90593e711125', 'request_id': 'req-2c651260-8a4b-48cd-a0bd-2e5abee018c4'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:29.400783 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-2c651260-8a4b-48cd-a0bd-2e5abee018c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d263900f7804e13bd7f90593e711125', 'request_id': 'req-2c651260-8a4b-48cd-a0bd-2e5abee018c4'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:29.407993 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-2c651260-8a4b-48cd-a0bd-2e5abee018c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d263900f7804e13bd7f90593e711125', 'request_id': 'req-2c651260-8a4b-48cd-a0bd-2e5abee018c4'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:29.418782 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-2c651260-8a4b-48cd-a0bd-2e5abee018c4 admin admin] The token cache is being invalidate because project 6d263900f7804e13bd7f90593e711125 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:35:29.419070 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-2c651260-8a4b-48cd-a0bd-2e5abee018c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:29.419693 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-2c651260-8a4b-48cd-a0bd-2e5abee018c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:29.421512 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1055/2109] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:35:29 2022] DELETE /identity/v3/projects/6d263900f7804e13bd7f90593e711125 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:35:29.425244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf7145-cf36-4171-9f9b-24ba85a674aa service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:29.434837 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf7145-cf36-4171-9f9b-24ba85a674aa service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:29.524471 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e2fc5-4369-467c-8976-7ed2e6db52ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:29.525386 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e2fc5-4369-467c-8976-7ed2e6db52ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:29.525673 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e2fc5-4369-467c-8976-7ed2e6db52ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:29.525982 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e2fc5-4369-467c-8976-7ed2e6db52ef admin admin] PATH_INFO: `/v3/users/be6297b666c6439ea81f81c02c7c4eea` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:29.527237 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e2fc5-4369-467c-8976-7ed2e6db52ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=be6297b666c6439ea81f81c02c7c4eea)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:29.529166 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e2fc5-4369-467c-8976-7ed2e6db52ef admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:29.592983 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-ec2e2fc5-4369-467c-8976-7ed2e6db52ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be6297b666c6439ea81f81c02c7c4eea'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:29.605631 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-ec2e2fc5-4369-467c-8976-7ed2e6db52ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be6297b666c6439ea81f81c02c7c4eea'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:29.606417 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-ec2e2fc5-4369-467c-8976-7ed2e6db52ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be6297b666c6439ea81f81c02c7c4eea'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:29.616612 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-ec2e2fc5-4369-467c-8976-7ed2e6db52ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be6297b666c6439ea81f81c02c7c4eea'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:29.623814 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-ec2e2fc5-4369-467c-8976-7ed2e6db52ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be6297b666c6439ea81f81c02c7c4eea'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:29.629693 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1055/2110] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:35:29 2022] DELETE /identity/v3/users/be6297b666c6439ea81f81c02c7c4eea => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:35:29.968317 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c651260-8a4b-48cd-a0bd-2e5abee018c4 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:29.969751 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-2c651260-8a4b-48cd-a0bd-2e5abee018c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:29.986114 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c651260-8a4b-48cd-a0bd-2e5abee018c4 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:30.042567 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0629e-0f3f-43ec-9729-59a4d6a9f02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:30.043453 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0629e-0f3f-43ec-9729-59a4d6a9f02a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:30.043735 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0629e-0f3f-43ec-9729-59a4d6a9f02a admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:30.044009 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0629e-0f3f-43ec-9729-59a4d6a9f02a admin admin] PATH_INFO: `/v3/projects/4ac06347568e4fbc9d11c6624cce2925` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:30.045190 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0629e-0f3f-43ec-9729-59a4d6a9f02a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ac06347568e4fbc9d11c6624cce2925)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:30.047176 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0629e-0f3f-43ec-9729-59a4d6a9f02a admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:30.094012 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e0d0629e-0f3f-43ec-9729-59a4d6a9f02a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ac06347568e4fbc9d11c6624cce2925', 'request_id': 'req-e0d0629e-0f3f-43ec-9729-59a4d6a9f02a'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:30.099348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e0d0629e-0f3f-43ec-9729-59a4d6a9f02a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ac06347568e4fbc9d11c6624cce2925', 'request_id': 'req-e0d0629e-0f3f-43ec-9729-59a4d6a9f02a'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:30.109371 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e0d0629e-0f3f-43ec-9729-59a4d6a9f02a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ac06347568e4fbc9d11c6624cce2925', 'request_id': 'req-e0d0629e-0f3f-43ec-9729-59a4d6a9f02a'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:30.121205 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e0d0629e-0f3f-43ec-9729-59a4d6a9f02a admin admin] The token cache is being invalidate because project 4ac06347568e4fbc9d11c6624cce2925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:35:30.121489 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e0d0629e-0f3f-43ec-9729-59a4d6a9f02a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:30.122267 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e0d0629e-0f3f-43ec-9729-59a4d6a9f02a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:30.123850 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1056/2111] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:35:29 2022] DELETE /identity/v3/projects/4ac06347568e4fbc9d11c6624cce2925 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:35:30.128667 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22a932-5daf-4a79-a6d6-ef6c4716c0cd None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:30.129143 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22a932-5daf-4a79-a6d6-ef6c4716c0cd None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:30.129259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22a932-5daf-4a79-a6d6-ef6c4716c0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:30.149132 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-9b22a932-5daf-4a79-a6d6-ef6c4716c0cd None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:35:30.150349 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-9b22a932-5daf-4a79-a6d6-ef6c4716c0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:30.212237 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1056/2112] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:35:30.219521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88fa2f-41ed-4bfc-a70e-7f7c8c61afd4 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:30.219814 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88fa2f-41ed-4bfc-a70e-7f7c8c61afd4 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:30.220092 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88fa2f-41ed-4bfc-a70e-7f7c8c61afd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:30.241403 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-3e88fa2f-41ed-4bfc-a70e-7f7c8c61afd4 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:35:30.242636 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-3e88fa2f-41ed-4bfc-a70e-7f7c8c61afd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:30.250609 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1057/2113] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:35:30.254826 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22a932-5daf-4a79-a6d6-ef6c4716c0cd None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:30.264675 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22a932-5daf-4a79-a6d6-ef6c4716c0cd None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:30.269287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0c0b6-0698-4a0b-b53a-61b3b0e385bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:30.269969 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0c0b6-0698-4a0b-b53a-61b3b0e385bb admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:30.270255 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0c0b6-0698-4a0b-b53a-61b3b0e385bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:30.270528 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0c0b6-0698-4a0b-b53a-61b3b0e385bb admin admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:30.271253 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0c0b6-0698-4a0b-b53a-61b3b0e385bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:35:30.271557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0c0b6-0698-4a0b-b53a-61b3b0e385bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:30.273166 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0c0b6-0698-4a0b-b53a-61b3b0e385bb admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:30.284295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1057/2114] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:35:30.289007 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88fa2f-41ed-4bfc-a70e-7f7c8c61afd4 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:30.298249 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88fa2f-41ed-4bfc-a70e-7f7c8c61afd4 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:30.305169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4592f-d5aa-4bcd-9926-e30e6102d1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:30.305831 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4592f-d5aa-4bcd-9926-e30e6102d1ac admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:30.306151 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4592f-d5aa-4bcd-9926-e30e6102d1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:30.306428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4592f-d5aa-4bcd-9926-e30e6102d1ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:30.307131 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4592f-d5aa-4bcd-9926-e30e6102d1ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:30.309039 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4592f-d5aa-4bcd-9926-e30e6102d1ac admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:30.337449 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1058/2115] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:35:30 2022] POST /identity/v3/projects => generated 401 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:35:30.341957 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0c0b6-0698-4a0b-b53a-61b3b0e385bb admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:30.352285 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0c0b6-0698-4a0b-b53a-61b3b0e385bb admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:30.407373 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63cfbc-53d1-4183-a621-719b86465d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:30.408037 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63cfbc-53d1-4183-a621-719b86465d07 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:30.408321 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63cfbc-53d1-4183-a621-719b86465d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:30.408593 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63cfbc-53d1-4183-a621-719b86465d07 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:30.409271 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63cfbc-53d1-4183-a621-719b86465d07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:30.411247 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63cfbc-53d1-4183-a621-719b86465d07 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:30.429868 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1058/2116] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:35:30 2022] POST /identity/v3/users => generated 301 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:35:30.434010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4592f-d5aa-4bcd-9926-e30e6102d1ac admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:30.445314 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4592f-d5aa-4bcd-9926-e30e6102d1ac admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:30.450258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26a309-f8fe-47fa-b007-dd03601949d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:30.450905 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26a309-f8fe-47fa-b007-dd03601949d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:30.451182 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26a309-f8fe-47fa-b007-dd03601949d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:30.451453 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26a309-f8fe-47fa-b007-dd03601949d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:30.452169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26a309-f8fe-47fa-b007-dd03601949d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:30.453747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26a309-f8fe-47fa-b007-dd03601949d9 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:30.464512 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1059/2117] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 09:35:30.468481 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63cfbc-53d1-4183-a621-719b86465d07 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:30.478360 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63cfbc-53d1-4183-a621-719b86465d07 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:30.483005 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791e207-259d-4bfb-b490-d6f5ecc47c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:30.483660 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791e207-259d-4bfb-b490-d6f5ecc47c35 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:30.483946 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791e207-259d-4bfb-b490-d6f5ecc47c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:30.484225 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791e207-259d-4bfb-b490-d6f5ecc47c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:30.484947 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791e207-259d-4bfb-b490-d6f5ecc47c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:30.486555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791e207-259d-4bfb-b490-d6f5ecc47c35 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:30.496705 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1059/2118] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 09:35:30.500720 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26a309-f8fe-47fa-b007-dd03601949d9 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:30.511560 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26a309-f8fe-47fa-b007-dd03601949d9 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:30.516200 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c914e7b-fc25-4b0c-a49e-c2612592f18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:30.517073 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c914e7b-fc25-4b0c-a49e-c2612592f18c admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:30.517348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c914e7b-fc25-4b0c-a49e-c2612592f18c admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:30.517614 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c914e7b-fc25-4b0c-a49e-c2612592f18c admin admin] PATH_INFO: `/v3/projects/86d0842f8a5d478b9fb971497878520a/users/8ffbeb8eb34048c9b62d7213e44fc32c/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:30.532176 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c914e7b-fc25-4b0c-a49e-c2612592f18c admin admin] RBAC: Authorizing `identity:create_grant(project_id=86d0842f8a5d478b9fb971497878520a, user_id=8ffbeb8eb34048c9b62d7213e44fc32c, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:30.534853 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c914e7b-fc25-4b0c-a49e-c2612592f18c admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:30.548480 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1060/2119] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:35:30 2022] PUT /identity/v3/projects/86d0842f8a5d478b9fb971497878520a/users/8ffbeb8eb34048c9b62d7213e44fc32c/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:35:30.559243 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d994723-8cd1-4e4e-b1ad-4647507d916a None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:30.559555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d994723-8cd1-4e4e-b1ad-4647507d916a None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:30.559832 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d994723-8cd1-4e4e-b1ad-4647507d916a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:30.585924 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-3d994723-8cd1-4e4e-b1ad-4647507d916a None None] MFA Rules not processed for user `8ffbeb8eb34048c9b62d7213e44fc32c`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:35:30.587462 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-3d994723-8cd1-4e4e-b1ad-4647507d916a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:30.651233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1060/2120] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:35:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:35:30.655721 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c914e7b-fc25-4b0c-a49e-c2612592f18c admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:30.719904 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c914e7b-fc25-4b0c-a49e-c2612592f18c admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:30.725200 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b137bc7-e0fa-4064-ae0a-d626906d9233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:30.725864 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b137bc7-e0fa-4064-ae0a-d626906d9233 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:30.726177 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b137bc7-e0fa-4064-ae0a-d626906d9233 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:30.726510 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b137bc7-e0fa-4064-ae0a-d626906d9233 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:30.727217 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b137bc7-e0fa-4064-ae0a-d626906d9233 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:30.729120 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b137bc7-e0fa-4064-ae0a-d626906d9233 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:30.753752 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1061/2121] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:35:30 2022] POST /identity/v3/projects => generated 401 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:35:30.757728 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d994723-8cd1-4e4e-b1ad-4647507d916a None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:30.768727 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d994723-8cd1-4e4e-b1ad-4647507d916a None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:30.826627 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c3506-34c1-42b0-8c7a-74bb3d9c8237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:30.827308 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c3506-34c1-42b0-8c7a-74bb3d9c8237 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:30.827589 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c3506-34c1-42b0-8c7a-74bb3d9c8237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:30.827859 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c3506-34c1-42b0-8c7a-74bb3d9c8237 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:30.828583 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c3506-34c1-42b0-8c7a-74bb3d9c8237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:30.831334 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c3506-34c1-42b0-8c7a-74bb3d9c8237 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:30.858769 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1061/2122] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:35:30 2022] POST /identity/v3/users => generated 307 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:35:30.862374 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b137bc7-e0fa-4064-ae0a-d626906d9233 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:30.873418 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b137bc7-e0fa-4064-ae0a-d626906d9233 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:30.879166 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ec632-dcfc-4521-8d7d-78da5e4bd9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:30.879469 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ec632-dcfc-4521-8d7d-78da5e4bd9fd admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:30.879806 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ec632-dcfc-4521-8d7d-78da5e4bd9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:30.880555 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ec632-dcfc-4521-8d7d-78da5e4bd9fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:30.881603 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ec632-dcfc-4521-8d7d-78da5e4bd9fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:30.883468 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ec632-dcfc-4521-8d7d-78da5e4bd9fd admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:30.897935 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1062/2123] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:35:30.900853 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c3506-34c1-42b0-8c7a-74bb3d9c8237 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:30.910825 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c3506-34c1-42b0-8c7a-74bb3d9c8237 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:30.916125 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28e2bc-a7e8-479a-8a10-26597e649682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:30.917009 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28e2bc-a7e8-479a-8a10-26597e649682 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:30.917321 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28e2bc-a7e8-479a-8a10-26597e649682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:30.917602 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28e2bc-a7e8-479a-8a10-26597e649682 admin admin] PATH_INFO: `/v3/projects/8a63bc9d994a4ea496f382f3f42198ea/users/7ed5b37579f74b0e8f914949f63b5666/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:30.932913 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28e2bc-a7e8-479a-8a10-26597e649682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a63bc9d994a4ea496f382f3f42198ea, user_id=7ed5b37579f74b0e8f914949f63b5666, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:30.935646 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28e2bc-a7e8-479a-8a10-26597e649682 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:30.949154 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1062/2124] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:35:30 2022] PUT /identity/v3/projects/8a63bc9d994a4ea496f382f3f42198ea/users/7ed5b37579f74b0e8f914949f63b5666/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:35:30.953124 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ec632-dcfc-4521-8d7d-78da5e4bd9fd admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:30.967507 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ec632-dcfc-4521-8d7d-78da5e4bd9fd admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:31.026601 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87524d8f-3442-4d51-9bb6-6bc50c7eab29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:31.027294 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87524d8f-3442-4d51-9bb6-6bc50c7eab29 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:31.027567 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87524d8f-3442-4d51-9bb6-6bc50c7eab29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:31.027855 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87524d8f-3442-4d51-9bb6-6bc50c7eab29 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:31.028552 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87524d8f-3442-4d51-9bb6-6bc50c7eab29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:31.030166 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87524d8f-3442-4d51-9bb6-6bc50c7eab29 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:31.040235 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1063/2125] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 09:35:31.044441 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28e2bc-a7e8-479a-8a10-26597e649682 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:31.054621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28e2bc-a7e8-479a-8a10-26597e649682 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:31.059783 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d7c34-fefc-49cf-b6a4-f6eaef2ff2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:31.060662 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d7c34-fefc-49cf-b6a4-f6eaef2ff2d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:31.060944 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d7c34-fefc-49cf-b6a4-f6eaef2ff2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:31.061208 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d7c34-fefc-49cf-b6a4-f6eaef2ff2d0 admin admin] PATH_INFO: `/v3/projects/8a63bc9d994a4ea496f382f3f42198ea/users/7ed5b37579f74b0e8f914949f63b5666/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:31.063205 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d7c34-fefc-49cf-b6a4-f6eaef2ff2d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a63bc9d994a4ea496f382f3f42198ea, user_id=7ed5b37579f74b0e8f914949f63b5666, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:31.065973 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d7c34-fefc-49cf-b6a4-f6eaef2ff2d0 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:31.076177 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1063/2126] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:35:31 2022] PUT /identity/v3/projects/8a63bc9d994a4ea496f382f3f42198ea/users/7ed5b37579f74b0e8f914949f63b5666/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:35:31.087460 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2081f-a044-4b4f-9831-81a557a0681b None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:31.087752 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2081f-a044-4b4f-9831-81a557a0681b None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:31.088034 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2081f-a044-4b4f-9831-81a557a0681b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:31.117178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-e5e2081f-a044-4b4f-9831-81a557a0681b None None] MFA Rules not processed for user `7ed5b37579f74b0e8f914949f63b5666`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:35:31.118360 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-e5e2081f-a044-4b4f-9831-81a557a0681b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:31.197054 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1064/2127] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:35:31 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:35:31.209595 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d7c34-fefc-49cf-b6a4-f6eaef2ff2d0 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:31.212342 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-a68d7c34-fefc-49cf-b6a4-f6eaef2ff2d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:31.292450 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d7c34-fefc-49cf-b6a4-f6eaef2ff2d0 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:31.296911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc476cb5-0f16-4f24-8094-9a996c439fc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:31.298155 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc476cb5-0f16-4f24-8094-9a996c439fc6 service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:31.298437 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc476cb5-0f16-4f24-8094-9a996c439fc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:31.298710 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc476cb5-0f16-4f24-8094-9a996c439fc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:31.310808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc476cb5-0f16-4f24-8094-9a996c439fc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:31.312301 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc476cb5-0f16-4f24-8094-9a996c439fc6 service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:31.323060 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1064/2128] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:35:31 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:35:31.415794 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2081f-a044-4b4f-9831-81a557a0681b None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:31.425494 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2081f-a044-4b4f-9831-81a557a0681b None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:31.430881 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e856c47-a0ed-434c-ba9d-b43c56a92a54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:31.431598 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e856c47-a0ed-434c-ba9d-b43c56a92a54 service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:31.431947 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e856c47-a0ed-434c-ba9d-b43c56a92a54 service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:31.432289 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e856c47-a0ed-434c-ba9d-b43c56a92a54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:31.491181 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e856c47-a0ed-434c-ba9d-b43c56a92a54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:31.492637 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e856c47-a0ed-434c-ba9d-b43c56a92a54 service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:31.501627 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1065/2129] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:35:31 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:35:32.415240 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f805f-a88f-42b5-8b15-6211b3014605 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:32.415716 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f805f-a88f-42b5-8b15-6211b3014605 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:32.415971 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f805f-a88f-42b5-8b15-6211b3014605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:32.438441 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-d72f805f-a88f-42b5-8b15-6211b3014605 None None] MFA Rules not processed for user `bd41f419750140268f4d4b77456065c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:35:32.447466 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-d72f805f-a88f-42b5-8b15-6211b3014605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:32.534839 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1065/2130] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 12 09:35:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:35:32.550857 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e856c47-a0ed-434c-ba9d-b43c56a92a54 service cinder] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:32.552838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-4e856c47-a0ed-434c-ba9d-b43c56a92a54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:32.632955 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e856c47-a0ed-434c-ba9d-b43c56a92a54 service cinder] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:32.639434 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df65575-8b61-4963-b091-f0c38f0850f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7693a31911346f9bb2c01efcd8e16e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:32.640336 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df65575-8b61-4963-b091-f0c38f0850f9 service swift] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:32.640767 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df65575-8b61-4963-b091-f0c38f0850f9 service swift] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:32.641190 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df65575-8b61-4963-b091-f0c38f0850f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:32.653265 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df65575-8b61-4963-b091-f0c38f0850f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:32.655544 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df65575-8b61-4963-b091-f0c38f0850f9 service swift] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:32.684704 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1066/2131] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 12 09:35:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 09:35:36.818321 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f805f-a88f-42b5-8b15-6211b3014605 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:36.925213 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f805f-a88f-42b5-8b15-6211b3014605 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:36.930247 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f578b2-6728-42b0-98c9-f06324c82b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:36.931201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f578b2-6728-42b0-98c9-f06324c82b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:36.931484 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f578b2-6728-42b0-98c9-f06324c82b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:36.931756 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f578b2-6728-42b0-98c9-f06324c82b96 admin admin] PATH_INFO: `/v3/users/8ffbeb8eb34048c9b62d7213e44fc32c` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:36.932949 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f578b2-6728-42b0-98c9-f06324c82b96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ffbeb8eb34048c9b62d7213e44fc32c)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:36.934924 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f578b2-6728-42b0-98c9-f06324c82b96 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:36.983112 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-17f578b2-6728-42b0-98c9-f06324c82b96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ffbeb8eb34048c9b62d7213e44fc32c'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:36.995538 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-17f578b2-6728-42b0-98c9-f06324c82b96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ffbeb8eb34048c9b62d7213e44fc32c'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:36.996237 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-17f578b2-6728-42b0-98c9-f06324c82b96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ffbeb8eb34048c9b62d7213e44fc32c'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:37.005737 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-17f578b2-6728-42b0-98c9-f06324c82b96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ffbeb8eb34048c9b62d7213e44fc32c'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:37.042089 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-17f578b2-6728-42b0-98c9-f06324c82b96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ffbeb8eb34048c9b62d7213e44fc32c'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:37.067440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1066/2132] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:35:36 2022] DELETE /identity/v3/users/8ffbeb8eb34048c9b62d7213e44fc32c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:35:37.071942 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9481cfe-34ef-4789-8164-f8942dfa257e None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:37.073297 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9481cfe-34ef-4789-8164-f8942dfa257e None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:37.078321 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9481cfe-34ef-4789-8164-f8942dfa257e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:37.124937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-b9481cfe-34ef-4789-8164-f8942dfa257e None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:35:37.126604 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-b9481cfe-34ef-4789-8164-f8942dfa257e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:37.194578 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1067/2133] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:35:37.207165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f578b2-6728-42b0-98c9-f06324c82b96 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:37.208691 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-17f578b2-6728-42b0-98c9-f06324c82b96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:37.265066 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f578b2-6728-42b0-98c9-f06324c82b96 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:37.268770 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68753356-e2eb-41d6-8553-cf7edb6639e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:37.269411 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68753356-e2eb-41d6-8553-cf7edb6639e0 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:37.269691 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68753356-e2eb-41d6-8553-cf7edb6639e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:37.270005 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68753356-e2eb-41d6-8553-cf7edb6639e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:37.279380 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68753356-e2eb-41d6-8553-cf7edb6639e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:37.280794 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68753356-e2eb-41d6-8553-cf7edb6639e0 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:37.290762 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1067/2134] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:35:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:35:37.615840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9481cfe-34ef-4789-8164-f8942dfa257e None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:37.617403 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-b9481cfe-34ef-4789-8164-f8942dfa257e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:37.630727 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9481cfe-34ef-4789-8164-f8942dfa257e None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:37.635617 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa64d19-bf7f-4f78-8263-7e5f8ad916ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:37.636484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa64d19-bf7f-4f78-8263-7e5f8ad916ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:37.636768 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa64d19-bf7f-4f78-8263-7e5f8ad916ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:37.637165 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa64d19-bf7f-4f78-8263-7e5f8ad916ec admin admin] PATH_INFO: `/v3/projects/86d0842f8a5d478b9fb971497878520a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:37.638393 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa64d19-bf7f-4f78-8263-7e5f8ad916ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=86d0842f8a5d478b9fb971497878520a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:37.640384 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa64d19-bf7f-4f78-8263-7e5f8ad916ec admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:37.689370 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-ffa64d19-bf7f-4f78-8263-7e5f8ad916ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86d0842f8a5d478b9fb971497878520a', 'request_id': 'req-ffa64d19-bf7f-4f78-8263-7e5f8ad916ec'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:37.694959 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-ffa64d19-bf7f-4f78-8263-7e5f8ad916ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86d0842f8a5d478b9fb971497878520a', 'request_id': 'req-ffa64d19-bf7f-4f78-8263-7e5f8ad916ec'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:37.702303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-ffa64d19-bf7f-4f78-8263-7e5f8ad916ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86d0842f8a5d478b9fb971497878520a', 'request_id': 'req-ffa64d19-bf7f-4f78-8263-7e5f8ad916ec'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:37.713819 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-ffa64d19-bf7f-4f78-8263-7e5f8ad916ec admin admin] The token cache is being invalidate because project 86d0842f8a5d478b9fb971497878520a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:35:37.714069 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-ffa64d19-bf7f-4f78-8263-7e5f8ad916ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:37.714830 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-ffa64d19-bf7f-4f78-8263-7e5f8ad916ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:37.716609 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1068/2135] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:35:37 2022] DELETE /identity/v3/projects/86d0842f8a5d478b9fb971497878520a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:35:37.720349 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68753356-e2eb-41d6-8553-cf7edb6639e0 service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:37.730620 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68753356-e2eb-41d6-8553-cf7edb6639e0 service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:37.786981 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a51cc4-f096-4e55-85f5-2071f110b694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:37.787875 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a51cc4-f096-4e55-85f5-2071f110b694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:37.788137 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a51cc4-f096-4e55-85f5-2071f110b694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:37.788405 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a51cc4-f096-4e55-85f5-2071f110b694 admin admin] PATH_INFO: `/v3/users/7ed5b37579f74b0e8f914949f63b5666` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:37.789582 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a51cc4-f096-4e55-85f5-2071f110b694 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ed5b37579f74b0e8f914949f63b5666)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:37.791526 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a51cc4-f096-4e55-85f5-2071f110b694 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:37.835571 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-b0a51cc4-f096-4e55-85f5-2071f110b694 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ed5b37579f74b0e8f914949f63b5666'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:37.847797 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-b0a51cc4-f096-4e55-85f5-2071f110b694 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ed5b37579f74b0e8f914949f63b5666'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:37.849249 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-b0a51cc4-f096-4e55-85f5-2071f110b694 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ed5b37579f74b0e8f914949f63b5666'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:37.857313 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-b0a51cc4-f096-4e55-85f5-2071f110b694 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ed5b37579f74b0e8f914949f63b5666'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:37.865578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-b0a51cc4-f096-4e55-85f5-2071f110b694 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ed5b37579f74b0e8f914949f63b5666'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:37.871453 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1068/2136] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:35:37 2022] DELETE /identity/v3/users/7ed5b37579f74b0e8f914949f63b5666 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:35:38.192509 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa64d19-bf7f-4f78-8263-7e5f8ad916ec admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:38.196948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-ffa64d19-bf7f-4f78-8263-7e5f8ad916ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:38.218470 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa64d19-bf7f-4f78-8263-7e5f8ad916ec admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:38.324181 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc84b0-d5cd-46bf-b9cc-ae72e76842da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:38.325752 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc84b0-d5cd-46bf-b9cc-ae72e76842da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:38.326294 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc84b0-d5cd-46bf-b9cc-ae72e76842da admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:38.326714 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc84b0-d5cd-46bf-b9cc-ae72e76842da admin admin] PATH_INFO: `/v3/projects/8a63bc9d994a4ea496f382f3f42198ea` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:38.334291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc84b0-d5cd-46bf-b9cc-ae72e76842da admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a63bc9d994a4ea496f382f3f42198ea)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:38.337086 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc84b0-d5cd-46bf-b9cc-ae72e76842da admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:38.399732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-cfcc84b0-d5cd-46bf-b9cc-ae72e76842da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a63bc9d994a4ea496f382f3f42198ea', 'request_id': 'req-cfcc84b0-d5cd-46bf-b9cc-ae72e76842da'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:38.404952 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-cfcc84b0-d5cd-46bf-b9cc-ae72e76842da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a63bc9d994a4ea496f382f3f42198ea', 'request_id': 'req-cfcc84b0-d5cd-46bf-b9cc-ae72e76842da'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:38.417459 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-cfcc84b0-d5cd-46bf-b9cc-ae72e76842da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a63bc9d994a4ea496f382f3f42198ea', 'request_id': 'req-cfcc84b0-d5cd-46bf-b9cc-ae72e76842da'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:38.437340 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-cfcc84b0-d5cd-46bf-b9cc-ae72e76842da admin admin] The token cache is being invalidate because project 8a63bc9d994a4ea496f382f3f42198ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:35:38.437767 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-cfcc84b0-d5cd-46bf-b9cc-ae72e76842da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:38.438663 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-cfcc84b0-d5cd-46bf-b9cc-ae72e76842da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:35:38.441970 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1069/2137] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:35:38 2022] DELETE /identity/v3/projects/8a63bc9d994a4ea496f382f3f42198ea => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:35:38.445982 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be840701-965d-4797-9e56-eef2443ef615 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:38.446358 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be840701-965d-4797-9e56-eef2443ef615 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:38.446642 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be840701-965d-4797-9e56-eef2443ef615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:38.469686 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-be840701-965d-4797-9e56-eef2443ef615 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:35:38.470917 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-be840701-965d-4797-9e56-eef2443ef615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:38.539831 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1069/2138] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:35:38.547381 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebaf289-c591-49c9-98f0-7e144b901442 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:38.548192 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebaf289-c591-49c9-98f0-7e144b901442 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:38.548468 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebaf289-c591-49c9-98f0-7e144b901442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:38.591671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-9ebaf289-c591-49c9-98f0-7e144b901442 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:35:38.604177 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-9ebaf289-c591-49c9-98f0-7e144b901442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:38.622430 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1070/2139] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:35:38.626668 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be840701-965d-4797-9e56-eef2443ef615 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:38.643790 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be840701-965d-4797-9e56-eef2443ef615 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:38.651512 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc6eeb-a95a-4d8f-bd8b-2a511ec84bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:38.652983 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc6eeb-a95a-4d8f-bd8b-2a511ec84bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:38.653856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc6eeb-a95a-4d8f-bd8b-2a511ec84bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:38.654839 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc6eeb-a95a-4d8f-bd8b-2a511ec84bc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:38.656345 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc6eeb-a95a-4d8f-bd8b-2a511ec84bc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:35:38.658586 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc6eeb-a95a-4d8f-bd8b-2a511ec84bc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:38.659805 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc6eeb-a95a-4d8f-bd8b-2a511ec84bc4 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:38.689944 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1070/2140] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:35:38.691984 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebaf289-c591-49c9-98f0-7e144b901442 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:38.706407 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebaf289-c591-49c9-98f0-7e144b901442 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:38.728741 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bba608-faf3-4e45-a1af-fa62e5a29721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:38.729536 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bba608-faf3-4e45-a1af-fa62e5a29721 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:38.729945 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bba608-faf3-4e45-a1af-fa62e5a29721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:38.730300 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bba608-faf3-4e45-a1af-fa62e5a29721 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:38.731093 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bba608-faf3-4e45-a1af-fa62e5a29721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:38.733107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bba608-faf3-4e45-a1af-fa62e5a29721 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:38.796840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1071/2141] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:35:38 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:35:38.806762 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc6eeb-a95a-4d8f-bd8b-2a511ec84bc4 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:38.824588 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc6eeb-a95a-4d8f-bd8b-2a511ec84bc4 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:38.959208 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607edfa9-288c-420f-b361-908283ebe300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:38.961322 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607edfa9-288c-420f-b361-908283ebe300 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:38.961609 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607edfa9-288c-420f-b361-908283ebe300 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:38.964230 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607edfa9-288c-420f-b361-908283ebe300 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:38.964982 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607edfa9-288c-420f-b361-908283ebe300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:38.966998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607edfa9-288c-420f-b361-908283ebe300 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:39.006531 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1071/2142] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:35:38 2022] POST /identity/v3/users => generated 291 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:35:39.008821 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bba608-faf3-4e45-a1af-fa62e5a29721 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:39.021698 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bba608-faf3-4e45-a1af-fa62e5a29721 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:39.027106 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a48345-3e22-4101-a53c-3cba1d45929e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:39.027782 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a48345-3e22-4101-a53c-3cba1d45929e admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:39.028062 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a48345-3e22-4101-a53c-3cba1d45929e admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:39.028334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a48345-3e22-4101-a53c-3cba1d45929e admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:39.029239 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a48345-3e22-4101-a53c-3cba1d45929e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:39.032837 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a48345-3e22-4101-a53c-3cba1d45929e admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:39.045929 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1072/2143] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 09:35:39.049693 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607edfa9-288c-420f-b361-908283ebe300 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:39.064328 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607edfa9-288c-420f-b361-908283ebe300 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:39.073488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130065d-2c62-482b-9660-1955cb6229f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:39.074850 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130065d-2c62-482b-9660-1955cb6229f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:39.075227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130065d-2c62-482b-9660-1955cb6229f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:39.075876 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130065d-2c62-482b-9660-1955cb6229f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:39.077329 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130065d-2c62-482b-9660-1955cb6229f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:39.079382 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130065d-2c62-482b-9660-1955cb6229f7 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:39.102244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1072/2144] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 09:35:39.103085 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a48345-3e22-4101-a53c-3cba1d45929e admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:39.122338 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a48345-3e22-4101-a53c-3cba1d45929e admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:39.127315 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3be4c-db08-444d-813d-c17af013bcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:39.128248 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3be4c-db08-444d-813d-c17af013bcb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:39.128526 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3be4c-db08-444d-813d-c17af013bcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:39.128796 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3be4c-db08-444d-813d-c17af013bcb5 admin admin] PATH_INFO: `/v3/projects/dd377de7db9842c18153946c223a1893/users/2e92ae1b076942d5b4ca4b63b3023983/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:39.152511 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3be4c-db08-444d-813d-c17af013bcb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd377de7db9842c18153946c223a1893, user_id=2e92ae1b076942d5b4ca4b63b3023983, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:39.155637 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3be4c-db08-444d-813d-c17af013bcb5 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:39.187370 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1073/2145] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:35:39 2022] PUT /identity/v3/projects/dd377de7db9842c18153946c223a1893/users/2e92ae1b076942d5b4ca4b63b3023983/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:35:39.200310 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88faaf08-ec03-473d-a888-c2bbe5af49c9 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:39.200846 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88faaf08-ec03-473d-a888-c2bbe5af49c9 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:39.201480 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88faaf08-ec03-473d-a888-c2bbe5af49c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:39.236688 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-88faaf08-ec03-473d-a888-c2bbe5af49c9 None None] MFA Rules not processed for user `2e92ae1b076942d5b4ca4b63b3023983`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:35:39.237960 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-88faaf08-ec03-473d-a888-c2bbe5af49c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:39.303513 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1073/2146] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:35:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:35:39.307849 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3be4c-db08-444d-813d-c17af013bcb5 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:39.394199 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3be4c-db08-444d-813d-c17af013bcb5 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:39.400717 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b27767-ad6e-4ab8-9eea-f562c3680ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:39.401619 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b27767-ad6e-4ab8-9eea-f562c3680ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:39.402118 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b27767-ad6e-4ab8-9eea-f562c3680ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:39.402551 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b27767-ad6e-4ab8-9eea-f562c3680ae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:39.403574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b27767-ad6e-4ab8-9eea-f562c3680ae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:39.405877 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b27767-ad6e-4ab8-9eea-f562c3680ae9 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:39.443952 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1074/2147] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:35:39 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:35:39.447935 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88faaf08-ec03-473d-a888-c2bbe5af49c9 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:39.461096 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88faaf08-ec03-473d-a888-c2bbe5af49c9 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:39.523348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c452d-3671-4df5-aefa-25ca931dfafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:39.524030 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c452d-3671-4df5-aefa-25ca931dfafb admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:39.524307 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c452d-3671-4df5-aefa-25ca931dfafb admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:39.524577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c452d-3671-4df5-aefa-25ca931dfafb admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:39.525269 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c452d-3671-4df5-aefa-25ca931dfafb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:39.527353 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c452d-3671-4df5-aefa-25ca931dfafb admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:39.548950 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1074/2148] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:35:39 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:35:39.554762 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b27767-ad6e-4ab8-9eea-f562c3680ae9 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:39.564928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b27767-ad6e-4ab8-9eea-f562c3680ae9 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:39.570175 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2963f0d-d68d-4693-aa84-7c4b5863458b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:39.570861 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2963f0d-d68d-4693-aa84-7c4b5863458b admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:39.571320 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2963f0d-d68d-4693-aa84-7c4b5863458b admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:39.571599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2963f0d-d68d-4693-aa84-7c4b5863458b admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:39.572327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2963f0d-d68d-4693-aa84-7c4b5863458b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:39.574026 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2963f0d-d68d-4693-aa84-7c4b5863458b admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:39.584920 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1075/2149] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:35:39.589585 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c452d-3671-4df5-aefa-25ca931dfafb admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:39.602288 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c452d-3671-4df5-aefa-25ca931dfafb admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:39.616185 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc43091-a454-40e4-a808-5df0cbfb623d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:39.617302 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc43091-a454-40e4-a808-5df0cbfb623d admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:39.617709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc43091-a454-40e4-a808-5df0cbfb623d admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:39.618030 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc43091-a454-40e4-a808-5df0cbfb623d admin admin] PATH_INFO: `/v3/projects/895dc21859df4ac6b4d89406dfb6ab9e/users/1388769b6b9b4b9db7b8257466faac32/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:39.644259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc43091-a454-40e4-a808-5df0cbfb623d admin admin] RBAC: Authorizing `identity:create_grant(project_id=895dc21859df4ac6b4d89406dfb6ab9e, user_id=1388769b6b9b4b9db7b8257466faac32, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:39.647377 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc43091-a454-40e4-a808-5df0cbfb623d admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:39.674715 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1075/2150] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:35:39 2022] PUT /identity/v3/projects/895dc21859df4ac6b4d89406dfb6ab9e/users/1388769b6b9b4b9db7b8257466faac32/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:35:39.679073 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2963f0d-d68d-4693-aa84-7c4b5863458b admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:39.692213 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2963f0d-d68d-4693-aa84-7c4b5863458b admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:39.761582 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8049d-e29a-4be5-a8d2-5c067b6a118c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:39.762277 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8049d-e29a-4be5-a8d2-5c067b6a118c admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:39.762554 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8049d-e29a-4be5-a8d2-5c067b6a118c admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:39.762823 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8049d-e29a-4be5-a8d2-5c067b6a118c admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:39.763543 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c8049d-e29a-4be5-a8d2-5c067b6a118c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:39.765133 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c8049d-e29a-4be5-a8d2-5c067b6a118c admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:39.775030 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1076/2151] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:35:39.779241 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc43091-a454-40e4-a808-5df0cbfb623d admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:39.790333 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc43091-a454-40e4-a808-5df0cbfb623d admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:39.795773 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c874c-8aed-466e-b22c-f775af68ced9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:39.796781 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c874c-8aed-466e-b22c-f775af68ced9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:39.797131 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c874c-8aed-466e-b22c-f775af68ced9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:39.797408 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c874c-8aed-466e-b22c-f775af68ced9 admin admin] PATH_INFO: `/v3/projects/895dc21859df4ac6b4d89406dfb6ab9e/users/1388769b6b9b4b9db7b8257466faac32/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:39.799659 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c874c-8aed-466e-b22c-f775af68ced9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=895dc21859df4ac6b4d89406dfb6ab9e, user_id=1388769b6b9b4b9db7b8257466faac32, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:39.802445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c874c-8aed-466e-b22c-f775af68ced9 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:39.813303 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1076/2152] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:35:39 2022] PUT /identity/v3/projects/895dc21859df4ac6b4d89406dfb6ab9e/users/1388769b6b9b4b9db7b8257466faac32/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:35:39.824602 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a8f6d-1f94-4b0c-a5bb-4c2e36d3db63 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:39.824908 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a8f6d-1f94-4b0c-a5bb-4c2e36d3db63 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:39.825178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a8f6d-1f94-4b0c-a5bb-4c2e36d3db63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:39.851606 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-7d6a8f6d-1f94-4b0c-a5bb-4c2e36d3db63 None None] MFA Rules not processed for user `1388769b6b9b4b9db7b8257466faac32`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:35:39.852789 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-7d6a8f6d-1f94-4b0c-a5bb-4c2e36d3db63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:39.924422 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1077/2153] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:35:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:35:39.935713 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c874c-8aed-466e-b22c-f775af68ced9 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:39.937966 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-6f8c874c-8aed-466e-b22c-f775af68ced9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:35:40.009478 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c874c-8aed-466e-b22c-f775af68ced9 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:40.013286 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa1303-dbcb-49d8-8b79-22cb628fd616 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:40.013970 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa1303-dbcb-49d8-8b79-22cb628fd616 service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:40.014261 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa1303-dbcb-49d8-8b79-22cb628fd616 service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:40.014601 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa1303-dbcb-49d8-8b79-22cb628fd616 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:40.024530 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa1303-dbcb-49d8-8b79-22cb628fd616 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:40.026005 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa1303-dbcb-49d8-8b79-22cb628fd616 service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:40.035633 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1077/2154] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:35:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 09:35:40.150089 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a8f6d-1f94-4b0c-a5bb-4c2e36d3db63 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:35:40.168276 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a8f6d-1f94-4b0c-a5bb-4c2e36d3db63 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:35:40.173070 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdfeb23-beeb-49a7-9c01-3b1a3f3dc96e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:35:40.173735 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfeb23-beeb-49a7-9c01-3b1a3f3dc96e service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:35:40.174088 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfeb23-beeb-49a7-9c01-3b1a3f3dc96e service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:35:40.174415 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfeb23-beeb-49a7-9c01-3b1a3f3dc96e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:35:40.245327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdfeb23-beeb-49a7-9c01-3b1a3f3dc96e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:35:40.246959 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdfeb23-beeb-49a7-9c01-3b1a3f3dc96e service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:35:40.257948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1078/2155] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:35:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:36:01.745943 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa1303-dbcb-49d8-8b79-22cb628fd616 service cinder] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:01.845680 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa1303-dbcb-49d8-8b79-22cb628fd616 service cinder] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:01.850790 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78d8b0-f088-4b31-b793-fea2ad2b007b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:01.851676 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78d8b0-f088-4b31-b793-fea2ad2b007b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:01.851953 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78d8b0-f088-4b31-b793-fea2ad2b007b admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:01.852253 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78d8b0-f088-4b31-b793-fea2ad2b007b admin admin] PATH_INFO: `/v3/users/2e92ae1b076942d5b4ca4b63b3023983` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:01.853428 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78d8b0-f088-4b31-b793-fea2ad2b007b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e92ae1b076942d5b4ca4b63b3023983)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:01.855526 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78d8b0-f088-4b31-b793-fea2ad2b007b admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:01.901024 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-2b78d8b0-f088-4b31-b793-fea2ad2b007b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e92ae1b076942d5b4ca4b63b3023983'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:01.912813 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-2b78d8b0-f088-4b31-b793-fea2ad2b007b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e92ae1b076942d5b4ca4b63b3023983'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:01.913410 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-2b78d8b0-f088-4b31-b793-fea2ad2b007b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e92ae1b076942d5b4ca4b63b3023983'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:01.920009 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-2b78d8b0-f088-4b31-b793-fea2ad2b007b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e92ae1b076942d5b4ca4b63b3023983'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:01.928931 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-2b78d8b0-f088-4b31-b793-fea2ad2b007b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e92ae1b076942d5b4ca4b63b3023983'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:01.934768 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1078/2156] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:36:01 2022] DELETE /identity/v3/users/2e92ae1b076942d5b4ca4b63b3023983 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:36:01.939235 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03650d45-4b43-4efc-a8be-4d3fde7e537f None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:01.939766 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03650d45-4b43-4efc-a8be-4d3fde7e537f None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:01.939766 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03650d45-4b43-4efc-a8be-4d3fde7e537f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:01.987480 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-03650d45-4b43-4efc-a8be-4d3fde7e537f None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:36:01.989207 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-03650d45-4b43-4efc-a8be-4d3fde7e537f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:02.047588 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1079/2157] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:36:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:36:02.057330 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78d8b0-f088-4b31-b793-fea2ad2b007b admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:02.058878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-2b78d8b0-f088-4b31-b793-fea2ad2b007b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:02.154209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78d8b0-f088-4b31-b793-fea2ad2b007b admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:02.157776 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf3434-8f71-41c8-bee2-44eaf8b03621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:02.158446 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf3434-8f71-41c8-bee2-44eaf8b03621 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:02.158725 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf3434-8f71-41c8-bee2-44eaf8b03621 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:02.158996 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf3434-8f71-41c8-bee2-44eaf8b03621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:02.168411 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf3434-8f71-41c8-bee2-44eaf8b03621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:02.169774 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf3434-8f71-41c8-bee2-44eaf8b03621 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:02.178947 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1079/2158] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:36:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:36:02.439290 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03650d45-4b43-4efc-a8be-4d3fde7e537f None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:02.441227 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-03650d45-4b43-4efc-a8be-4d3fde7e537f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:02.454374 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03650d45-4b43-4efc-a8be-4d3fde7e537f None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:02.461573 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8ca8d-2893-4af7-bfbb-5303ac52aff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:02.462688 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8ca8d-2893-4af7-bfbb-5303ac52aff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:02.463311 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8ca8d-2893-4af7-bfbb-5303ac52aff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:02.463545 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8ca8d-2893-4af7-bfbb-5303ac52aff8 admin admin] PATH_INFO: `/v3/projects/dd377de7db9842c18153946c223a1893` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:02.464770 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8ca8d-2893-4af7-bfbb-5303ac52aff8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd377de7db9842c18153946c223a1893)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:02.466825 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8ca8d-2893-4af7-bfbb-5303ac52aff8 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:02.517163 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-13d8ca8d-2893-4af7-bfbb-5303ac52aff8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd377de7db9842c18153946c223a1893', 'request_id': 'req-13d8ca8d-2893-4af7-bfbb-5303ac52aff8'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:02.522734 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-13d8ca8d-2893-4af7-bfbb-5303ac52aff8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd377de7db9842c18153946c223a1893', 'request_id': 'req-13d8ca8d-2893-4af7-bfbb-5303ac52aff8'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:02.530422 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-13d8ca8d-2893-4af7-bfbb-5303ac52aff8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd377de7db9842c18153946c223a1893', 'request_id': 'req-13d8ca8d-2893-4af7-bfbb-5303ac52aff8'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:02.541858 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-13d8ca8d-2893-4af7-bfbb-5303ac52aff8 admin admin] The token cache is being invalidate because project dd377de7db9842c18153946c223a1893 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:36:02.542235 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-13d8ca8d-2893-4af7-bfbb-5303ac52aff8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:02.542863 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-13d8ca8d-2893-4af7-bfbb-5303ac52aff8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:02.544404 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1080/2159] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:36:02 2022] DELETE /identity/v3/projects/dd377de7db9842c18153946c223a1893 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:36:02.548339 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf3434-8f71-41c8-bee2-44eaf8b03621 service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:02.558243 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf3434-8f71-41c8-bee2-44eaf8b03621 service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:02.612397 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823696a5-0d3e-4a4a-acba-93ac0e0df968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:02.613268 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823696a5-0d3e-4a4a-acba-93ac0e0df968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:02.613580 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823696a5-0d3e-4a4a-acba-93ac0e0df968 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:02.613854 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823696a5-0d3e-4a4a-acba-93ac0e0df968 admin admin] PATH_INFO: `/v3/users/1388769b6b9b4b9db7b8257466faac32` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:02.615086 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823696a5-0d3e-4a4a-acba-93ac0e0df968 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1388769b6b9b4b9db7b8257466faac32)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:02.616994 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823696a5-0d3e-4a4a-acba-93ac0e0df968 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:02.660979 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-823696a5-0d3e-4a4a-acba-93ac0e0df968 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1388769b6b9b4b9db7b8257466faac32'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:02.672188 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-823696a5-0d3e-4a4a-acba-93ac0e0df968 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1388769b6b9b4b9db7b8257466faac32'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:02.672833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-823696a5-0d3e-4a4a-acba-93ac0e0df968 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1388769b6b9b4b9db7b8257466faac32'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:02.679522 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-823696a5-0d3e-4a4a-acba-93ac0e0df968 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1388769b6b9b4b9db7b8257466faac32'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:02.686138 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-823696a5-0d3e-4a4a-acba-93ac0e0df968 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1388769b6b9b4b9db7b8257466faac32'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:02.692372 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1080/2160] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:36:02 2022] DELETE /identity/v3/users/1388769b6b9b4b9db7b8257466faac32 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:36:03.028397 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8ca8d-2893-4af7-bfbb-5303ac52aff8 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:03.029970 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-13d8ca8d-2893-4af7-bfbb-5303ac52aff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:03.046361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8ca8d-2893-4af7-bfbb-5303ac52aff8 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:03.105304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18007b77-0cf3-473c-a87b-7faa524093d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:03.106224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18007b77-0cf3-473c-a87b-7faa524093d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:03.106504 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18007b77-0cf3-473c-a87b-7faa524093d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:03.106776 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18007b77-0cf3-473c-a87b-7faa524093d5 admin admin] PATH_INFO: `/v3/projects/895dc21859df4ac6b4d89406dfb6ab9e` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:03.107973 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18007b77-0cf3-473c-a87b-7faa524093d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=895dc21859df4ac6b4d89406dfb6ab9e)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:03.109931 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18007b77-0cf3-473c-a87b-7faa524093d5 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:03.157787 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-18007b77-0cf3-473c-a87b-7faa524093d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '895dc21859df4ac6b4d89406dfb6ab9e', 'request_id': 'req-18007b77-0cf3-473c-a87b-7faa524093d5'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:03.164778 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-18007b77-0cf3-473c-a87b-7faa524093d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '895dc21859df4ac6b4d89406dfb6ab9e', 'request_id': 'req-18007b77-0cf3-473c-a87b-7faa524093d5'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:03.172333 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-18007b77-0cf3-473c-a87b-7faa524093d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '895dc21859df4ac6b4d89406dfb6ab9e', 'request_id': 'req-18007b77-0cf3-473c-a87b-7faa524093d5'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:03.183989 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-18007b77-0cf3-473c-a87b-7faa524093d5 admin admin] The token cache is being invalidate because project 895dc21859df4ac6b4d89406dfb6ab9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:36:03.184283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-18007b77-0cf3-473c-a87b-7faa524093d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:03.185316 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-18007b77-0cf3-473c-a87b-7faa524093d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:03.186947 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1081/2161] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:36:03 2022] DELETE /identity/v3/projects/895dc21859df4ac6b4d89406dfb6ab9e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:36:03.193005 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2c4c8-d8c1-422a-9b7d-456a6ad5761d None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:03.193504 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2c4c8-d8c1-422a-9b7d-456a6ad5761d None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:03.194079 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2c4c8-d8c1-422a-9b7d-456a6ad5761d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:03.233913 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-6bc2c4c8-d8c1-422a-9b7d-456a6ad5761d None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:36:03.235213 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-6bc2c4c8-d8c1-422a-9b7d-456a6ad5761d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:03.306072 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1081/2162] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:36:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:36:03.313986 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3db3ad-d83a-482f-8db0-f7a53098112e None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:03.314315 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3db3ad-d83a-482f-8db0-f7a53098112e None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:03.314593 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3db3ad-d83a-482f-8db0-f7a53098112e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:03.332935 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-eb3db3ad-d83a-482f-8db0-f7a53098112e None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:36:03.334232 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-eb3db3ad-d83a-482f-8db0-f7a53098112e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:03.342116 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1082/2163] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:36:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:36:03.346291 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2c4c8-d8c1-422a-9b7d-456a6ad5761d None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:03.356321 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2c4c8-d8c1-422a-9b7d-456a6ad5761d None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:03.360872 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56044abd-d2ea-4e4b-b06e-456685f6ffad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:03.361525 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56044abd-d2ea-4e4b-b06e-456685f6ffad admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:03.361807 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56044abd-d2ea-4e4b-b06e-456685f6ffad admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:03.362121 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56044abd-d2ea-4e4b-b06e-456685f6ffad admin admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:03.362836 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56044abd-d2ea-4e4b-b06e-456685f6ffad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:36:03.363142 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56044abd-d2ea-4e4b-b06e-456685f6ffad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:03.365319 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56044abd-d2ea-4e4b-b06e-456685f6ffad admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:03.376505 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1082/2164] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:36:03.380572 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3db3ad-d83a-482f-8db0-f7a53098112e None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:03.389846 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3db3ad-d83a-482f-8db0-f7a53098112e None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:03.394716 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d011ce-1aa4-46a3-9088-6de4935d8f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:03.395353 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d011ce-1aa4-46a3-9088-6de4935d8f7a admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:03.395631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d011ce-1aa4-46a3-9088-6de4935d8f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:03.395902 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d011ce-1aa4-46a3-9088-6de4935d8f7a admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:03.396592 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d011ce-1aa4-46a3-9088-6de4935d8f7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:03.398500 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d011ce-1aa4-46a3-9088-6de4935d8f7a admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:03.423064 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1083/2165] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:36:03 2022] POST /identity/v3/projects => generated 365 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:36:03.427629 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56044abd-d2ea-4e4b-b06e-456685f6ffad admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:03.441090 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56044abd-d2ea-4e4b-b06e-456685f6ffad admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:03.496670 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66d0be-a72c-406d-aa10-7cc443967c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:03.497366 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66d0be-a72c-406d-aa10-7cc443967c7f admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:03.497649 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66d0be-a72c-406d-aa10-7cc443967c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:03.497956 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66d0be-a72c-406d-aa10-7cc443967c7f admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:03.498824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66d0be-a72c-406d-aa10-7cc443967c7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:03.500800 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66d0be-a72c-406d-aa10-7cc443967c7f admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:03.522833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1083/2166] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:36:03 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:36:03.526883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d011ce-1aa4-46a3-9088-6de4935d8f7a admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:03.538177 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d011ce-1aa4-46a3-9088-6de4935d8f7a admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:03.549067 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1fe6c-5626-40ea-a6f7-6456d441cbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:03.549742 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1fe6c-5626-40ea-a6f7-6456d441cbb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:03.550066 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1fe6c-5626-40ea-a6f7-6456d441cbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:03.550342 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1fe6c-5626-40ea-a6f7-6456d441cbb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:03.551110 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1fe6c-5626-40ea-a6f7-6456d441cbb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:03.552697 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1fe6c-5626-40ea-a6f7-6456d441cbb8 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:03.564278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1084/2167] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:36:03.567938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66d0be-a72c-406d-aa10-7cc443967c7f admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:03.579738 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66d0be-a72c-406d-aa10-7cc443967c7f admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:03.589754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a66cd-bb1b-4fe0-ae54-d7321c508b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:03.590495 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a66cd-bb1b-4fe0-ae54-d7321c508b68 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:03.590860 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a66cd-bb1b-4fe0-ae54-d7321c508b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:03.591141 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a66cd-bb1b-4fe0-ae54-d7321c508b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:03.591888 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a66cd-bb1b-4fe0-ae54-d7321c508b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:03.593488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a66cd-bb1b-4fe0-ae54-d7321c508b68 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:03.605105 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1084/2168] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:36:03.609193 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1fe6c-5626-40ea-a6f7-6456d441cbb8 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:03.619489 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1fe6c-5626-40ea-a6f7-6456d441cbb8 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:03.624531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0652ba-4b10-44cb-8bab-48a718d1e218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:03.625498 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0652ba-4b10-44cb-8bab-48a718d1e218 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:03.625779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0652ba-4b10-44cb-8bab-48a718d1e218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:03.626084 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0652ba-4b10-44cb-8bab-48a718d1e218 admin admin] PATH_INFO: `/v3/projects/85757f07d4c1403aae6cd60a5b95843d/users/c2695c6e862040a2887540788a736533/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:03.648206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0652ba-4b10-44cb-8bab-48a718d1e218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85757f07d4c1403aae6cd60a5b95843d, user_id=c2695c6e862040a2887540788a736533, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:03.651568 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0652ba-4b10-44cb-8bab-48a718d1e218 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:03.672217 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1085/2169] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:36:03 2022] PUT /identity/v3/projects/85757f07d4c1403aae6cd60a5b95843d/users/c2695c6e862040a2887540788a736533/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:36:03.685163 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2e037-53b9-417b-92df-ea533b7ed887 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:03.685452 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2e037-53b9-417b-92df-ea533b7ed887 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:03.685729 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2e037-53b9-417b-92df-ea533b7ed887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:03.715866 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-ccf2e037-53b9-417b-92df-ea533b7ed887 None None] MFA Rules not processed for user `c2695c6e862040a2887540788a736533`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:36:03.717189 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-ccf2e037-53b9-417b-92df-ea533b7ed887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:03.796436 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1085/2170] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:36:03 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:36:03.801357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0652ba-4b10-44cb-8bab-48a718d1e218 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:03.882648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0652ba-4b10-44cb-8bab-48a718d1e218 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:03.888420 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c064e8-2c3e-47b7-8934-0254b5da9055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:03.889450 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c064e8-2c3e-47b7-8934-0254b5da9055 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:03.889689 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c064e8-2c3e-47b7-8934-0254b5da9055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:03.890088 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c064e8-2c3e-47b7-8934-0254b5da9055 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:03.890946 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c064e8-2c3e-47b7-8934-0254b5da9055 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:03.893361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c064e8-2c3e-47b7-8934-0254b5da9055 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:03.934905 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1086/2171] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:36:03 2022] POST /identity/v3/projects => generated 367 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:36:03.947486 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2e037-53b9-417b-92df-ea533b7ed887 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:03.963219 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2e037-53b9-417b-92df-ea533b7ed887 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:04.025444 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26ec28-593f-42c1-b415-a2b5c22d74d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:04.026062 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26ec28-593f-42c1-b415-a2b5c22d74d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:04.026343 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26ec28-593f-42c1-b415-a2b5c22d74d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:04.026613 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26ec28-593f-42c1-b415-a2b5c22d74d6 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:04.027296 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26ec28-593f-42c1-b415-a2b5c22d74d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:04.029203 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26ec28-593f-42c1-b415-a2b5c22d74d6 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:04.056495 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1086/2172] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:36:03 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:36:04.057745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c064e8-2c3e-47b7-8934-0254b5da9055 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:04.068255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c064e8-2c3e-47b7-8934-0254b5da9055 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:04.073181 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4cfe7c-985a-4741-a15b-5d936b1c568f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:04.073872 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cfe7c-985a-4741-a15b-5d936b1c568f admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:04.074188 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cfe7c-985a-4741-a15b-5d936b1c568f admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:04.074462 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cfe7c-985a-4741-a15b-5d936b1c568f admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:04.075235 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4cfe7c-985a-4741-a15b-5d936b1c568f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:04.076868 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4cfe7c-985a-4741-a15b-5d936b1c568f admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:04.088171 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1087/2173] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:36:04.092415 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26ec28-593f-42c1-b415-a2b5c22d74d6 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:04.104430 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26ec28-593f-42c1-b415-a2b5c22d74d6 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:04.109305 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05216401-0aeb-4f09-8969-2a05472c557c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:04.110113 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05216401-0aeb-4f09-8969-2a05472c557c admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:04.110566 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05216401-0aeb-4f09-8969-2a05472c557c admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:04.110983 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05216401-0aeb-4f09-8969-2a05472c557c admin admin] PATH_INFO: `/v3/projects/092fe9b8accf432db4ce9eb9ebb8a43d/users/91f71d03766e4b36b0db24674a063e6a/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:04.125984 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05216401-0aeb-4f09-8969-2a05472c557c admin admin] RBAC: Authorizing `identity:create_grant(project_id=092fe9b8accf432db4ce9eb9ebb8a43d, user_id=91f71d03766e4b36b0db24674a063e6a, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:04.128692 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05216401-0aeb-4f09-8969-2a05472c557c admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:04.142608 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1087/2174] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:36:04 2022] PUT /identity/v3/projects/092fe9b8accf432db4ce9eb9ebb8a43d/users/91f71d03766e4b36b0db24674a063e6a/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:36:04.147012 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4cfe7c-985a-4741-a15b-5d936b1c568f admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:04.156641 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4cfe7c-985a-4741-a15b-5d936b1c568f admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:04.213350 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a56f2-99f0-470f-9121-87ae7a8b0fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:04.214048 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a56f2-99f0-470f-9121-87ae7a8b0fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:04.214324 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a56f2-99f0-470f-9121-87ae7a8b0fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:04.214602 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a56f2-99f0-470f-9121-87ae7a8b0fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:04.215328 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a56f2-99f0-470f-9121-87ae7a8b0fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:04.216926 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a56f2-99f0-470f-9121-87ae7a8b0fd8 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:04.226664 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1088/2175] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 09:36:04.230663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05216401-0aeb-4f09-8969-2a05472c557c admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:04.241463 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05216401-0aeb-4f09-8969-2a05472c557c admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:04.246957 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d357a-421f-4165-81b6-35dc6a248ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:04.247957 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d357a-421f-4165-81b6-35dc6a248ea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:04.248408 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d357a-421f-4165-81b6-35dc6a248ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:04.248693 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d357a-421f-4165-81b6-35dc6a248ea4 admin admin] PATH_INFO: `/v3/projects/092fe9b8accf432db4ce9eb9ebb8a43d/users/91f71d03766e4b36b0db24674a063e6a/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:04.250730 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d357a-421f-4165-81b6-35dc6a248ea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=092fe9b8accf432db4ce9eb9ebb8a43d, user_id=91f71d03766e4b36b0db24674a063e6a, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:04.253360 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d357a-421f-4165-81b6-35dc6a248ea4 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:04.265325 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1088/2176] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:36:04 2022] PUT /identity/v3/projects/092fe9b8accf432db4ce9eb9ebb8a43d/users/91f71d03766e4b36b0db24674a063e6a/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:36:04.275808 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338790f-f2f8-4bfc-b1a4-c43ee181e6fb None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:04.276283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338790f-f2f8-4bfc-b1a4-c43ee181e6fb None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:04.276480 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338790f-f2f8-4bfc-b1a4-c43ee181e6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:04.329638 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-0338790f-f2f8-4bfc-b1a4-c43ee181e6fb None None] MFA Rules not processed for user `91f71d03766e4b36b0db24674a063e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:36:04.330889 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-0338790f-f2f8-4bfc-b1a4-c43ee181e6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:04.419015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1089/2177] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:36:04 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:36:04.430958 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d357a-421f-4165-81b6-35dc6a248ea4 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:04.432652 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-d27d357a-421f-4165-81b6-35dc6a248ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:04.487492 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d357a-421f-4165-81b6-35dc6a248ea4 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:04.491727 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118efe8-3a67-4afd-9960-3b72a34cbbbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:04.492380 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118efe8-3a67-4afd-9960-3b72a34cbbbb service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:04.492659 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118efe8-3a67-4afd-9960-3b72a34cbbbb service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:04.492927 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118efe8-3a67-4afd-9960-3b72a34cbbbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:04.501975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118efe8-3a67-4afd-9960-3b72a34cbbbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:04.503402 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118efe8-3a67-4afd-9960-3b72a34cbbbb service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:04.513731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1089/2178] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:36:04 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:36:04.597399 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338790f-f2f8-4bfc-b1a4-c43ee181e6fb None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:04.608562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338790f-f2f8-4bfc-b1a4-c43ee181e6fb None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:04.614209 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c77e68-d48f-451b-bc0c-9d8fd813affc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:04.614872 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c77e68-d48f-451b-bc0c-9d8fd813affc service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:04.615156 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c77e68-d48f-451b-bc0c-9d8fd813affc service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:04.615429 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c77e68-d48f-451b-bc0c-9d8fd813affc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:04.671464 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c77e68-d48f-451b-bc0c-9d8fd813affc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:04.672892 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c77e68-d48f-451b-bc0c-9d8fd813affc service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:04.682657 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1090/2179] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:36:04 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:36:04.725996 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118efe8-3a67-4afd-9960-3b72a34cbbbb service cinder] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:04.727541 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-2118efe8-3a67-4afd-9960-3b72a34cbbbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:04.820749 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118efe8-3a67-4afd-9960-3b72a34cbbbb service cinder] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:04.825638 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8a73e-fe74-4cdb-bd1b-dcf024009628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:04.826666 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8a73e-fe74-4cdb-bd1b-dcf024009628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:04.827049 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8a73e-fe74-4cdb-bd1b-dcf024009628 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:04.827509 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8a73e-fe74-4cdb-bd1b-dcf024009628 admin admin] PATH_INFO: `/v3/users/ded41aae383242789d1e468372767efb` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:04.829076 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8a73e-fe74-4cdb-bd1b-dcf024009628 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ded41aae383242789d1e468372767efb)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:04.831144 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8a73e-fe74-4cdb-bd1b-dcf024009628 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:04.884516 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-89e8a73e-fe74-4cdb-bd1b-dcf024009628 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ded41aae383242789d1e468372767efb'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:04.898988 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-89e8a73e-fe74-4cdb-bd1b-dcf024009628 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ded41aae383242789d1e468372767efb'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:04.899766 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-89e8a73e-fe74-4cdb-bd1b-dcf024009628 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ded41aae383242789d1e468372767efb'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:04.907587 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-89e8a73e-fe74-4cdb-bd1b-dcf024009628 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ded41aae383242789d1e468372767efb'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:04.914945 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-89e8a73e-fe74-4cdb-bd1b-dcf024009628 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ded41aae383242789d1e468372767efb'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:04.923392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1090/2180] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:36:04 2022] DELETE /identity/v3/users/ded41aae383242789d1e468372767efb => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:36:05.174766 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c77e68-d48f-451b-bc0c-9d8fd813affc service cinder] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:05.186644 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c77e68-d48f-451b-bc0c-9d8fd813affc service cinder] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:05.245194 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003b1c2-f714-4ae3-bf41-dac8455600fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:05.246086 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003b1c2-f714-4ae3-bf41-dac8455600fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:05.246368 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003b1c2-f714-4ae3-bf41-dac8455600fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:05.246640 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003b1c2-f714-4ae3-bf41-dac8455600fb admin admin] PATH_INFO: `/v3/projects/2de1508e265140e5801827175c7da941` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:05.247966 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003b1c2-f714-4ae3-bf41-dac8455600fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2de1508e265140e5801827175c7da941)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:05.249922 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003b1c2-f714-4ae3-bf41-dac8455600fb admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:05.296681 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-a003b1c2-f714-4ae3-bf41-dac8455600fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2de1508e265140e5801827175c7da941', 'request_id': 'req-a003b1c2-f714-4ae3-bf41-dac8455600fb'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:05.302922 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-a003b1c2-f714-4ae3-bf41-dac8455600fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2de1508e265140e5801827175c7da941', 'request_id': 'req-a003b1c2-f714-4ae3-bf41-dac8455600fb'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:05.311614 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-a003b1c2-f714-4ae3-bf41-dac8455600fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2de1508e265140e5801827175c7da941', 'request_id': 'req-a003b1c2-f714-4ae3-bf41-dac8455600fb'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:05.323419 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-a003b1c2-f714-4ae3-bf41-dac8455600fb admin admin] The token cache is being invalidate because project 2de1508e265140e5801827175c7da941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:36:05.323708 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-a003b1c2-f714-4ae3-bf41-dac8455600fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:05.324335 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-a003b1c2-f714-4ae3-bf41-dac8455600fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:05.326104 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1091/2181] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:36:05 2022] DELETE /identity/v3/projects/2de1508e265140e5801827175c7da941 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:36:05.331048 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce2599-245c-45a1-a472-84c1429f29e0 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:05.331523 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce2599-245c-45a1-a472-84c1429f29e0 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:05.331634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce2599-245c-45a1-a472-84c1429f29e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:05.350578 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-d7ce2599-245c-45a1-a472-84c1429f29e0 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:36:05.351850 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-d7ce2599-245c-45a1-a472-84c1429f29e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:05.416980 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1091/2182] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:36:05.424156 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e771694-a56c-4d88-b9fe-adde4abb9276 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:05.424654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e771694-a56c-4d88-b9fe-adde4abb9276 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:05.425005 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e771694-a56c-4d88-b9fe-adde4abb9276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:05.450124 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-1e771694-a56c-4d88-b9fe-adde4abb9276 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:36:05.459338 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-1e771694-a56c-4d88-b9fe-adde4abb9276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:05.470091 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1092/2183] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:36:05.474850 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce2599-245c-45a1-a472-84c1429f29e0 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:05.492521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce2599-245c-45a1-a472-84c1429f29e0 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:05.492521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f67a4-bab1-4b16-968f-b18d4450b725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:05.492521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f67a4-bab1-4b16-968f-b18d4450b725 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:05.492521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f67a4-bab1-4b16-968f-b18d4450b725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:05.500778 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f67a4-bab1-4b16-968f-b18d4450b725 admin admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:05.501999 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f67a4-bab1-4b16-968f-b18d4450b725 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:36:05.502329 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f67a4-bab1-4b16-968f-b18d4450b725 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:05.504312 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f67a4-bab1-4b16-968f-b18d4450b725 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:05.518316 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1092/2184] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:36:05.522680 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e771694-a56c-4d88-b9fe-adde4abb9276 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:05.532468 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e771694-a56c-4d88-b9fe-adde4abb9276 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:05.538733 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e169cf-f39b-4eff-be0f-04101a7e1b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:05.539576 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e169cf-f39b-4eff-be0f-04101a7e1b0e admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:05.539923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e169cf-f39b-4eff-be0f-04101a7e1b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:05.540260 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e169cf-f39b-4eff-be0f-04101a7e1b0e admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:05.541032 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e169cf-f39b-4eff-be0f-04101a7e1b0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:05.543172 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e169cf-f39b-4eff-be0f-04101a7e1b0e admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:05.577364 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1093/2185] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:36:05 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:36:05.581885 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f67a4-bab1-4b16-968f-b18d4450b725 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:05.594680 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f67a4-bab1-4b16-968f-b18d4450b725 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:05.653290 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323348e5-3ec1-4d6d-a9fd-09ba3221f899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:05.654015 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323348e5-3ec1-4d6d-a9fd-09ba3221f899 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:05.654304 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323348e5-3ec1-4d6d-a9fd-09ba3221f899 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:05.654582 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323348e5-3ec1-4d6d-a9fd-09ba3221f899 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:05.655273 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323348e5-3ec1-4d6d-a9fd-09ba3221f899 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:05.657223 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323348e5-3ec1-4d6d-a9fd-09ba3221f899 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:05.676280 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1093/2186] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:36:05 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:36:05.680363 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e169cf-f39b-4eff-be0f-04101a7e1b0e admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:05.690565 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e169cf-f39b-4eff-be0f-04101a7e1b0e admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:05.695671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480703f-93b8-4e46-84ac-7031b3083c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:05.696325 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480703f-93b8-4e46-84ac-7031b3083c97 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:05.696648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480703f-93b8-4e46-84ac-7031b3083c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:05.696906 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480703f-93b8-4e46-84ac-7031b3083c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:05.697664 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480703f-93b8-4e46-84ac-7031b3083c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:05.699463 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480703f-93b8-4e46-84ac-7031b3083c97 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:05.710687 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1094/2187] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:36:05.715058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323348e5-3ec1-4d6d-a9fd-09ba3221f899 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:05.724827 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323348e5-3ec1-4d6d-a9fd-09ba3221f899 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:05.729319 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19588d-8586-4554-814d-fa3c522b5e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:05.729995 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19588d-8586-4554-814d-fa3c522b5e93 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:05.730275 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19588d-8586-4554-814d-fa3c522b5e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:05.730547 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19588d-8586-4554-814d-fa3c522b5e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:05.731262 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19588d-8586-4554-814d-fa3c522b5e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:05.732823 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19588d-8586-4554-814d-fa3c522b5e93 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:05.743088 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1094/2188] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:36:05.746936 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480703f-93b8-4e46-84ac-7031b3083c97 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:05.757664 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480703f-93b8-4e46-84ac-7031b3083c97 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:05.762872 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14451558-cf28-4c24-adf5-05a53ae8b86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:05.763557 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14451558-cf28-4c24-adf5-05a53ae8b86e admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:05.763839 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14451558-cf28-4c24-adf5-05a53ae8b86e admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:05.764115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14451558-cf28-4c24-adf5-05a53ae8b86e admin admin] PATH_INFO: `/v3/projects/eb2e177fd53c45709ac9d0437faf2276/users/e935640f3fe849708e81605799d8ed02/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:05.778567 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14451558-cf28-4c24-adf5-05a53ae8b86e admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb2e177fd53c45709ac9d0437faf2276, user_id=e935640f3fe849708e81605799d8ed02, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:05.781202 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14451558-cf28-4c24-adf5-05a53ae8b86e admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:05.795163 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1095/2189] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:36:05 2022] PUT /identity/v3/projects/eb2e177fd53c45709ac9d0437faf2276/users/e935640f3fe849708e81605799d8ed02/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:36:05.806652 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772251f-23b1-49c1-8439-16fdde97abbc None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:05.807034 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772251f-23b1-49c1-8439-16fdde97abbc None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:05.807392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772251f-23b1-49c1-8439-16fdde97abbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:05.834838 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-3772251f-23b1-49c1-8439-16fdde97abbc None None] MFA Rules not processed for user `e935640f3fe849708e81605799d8ed02`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:36:05.836038 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-3772251f-23b1-49c1-8439-16fdde97abbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:05.899142 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1095/2190] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:36:05 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:36:05.903497 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14451558-cf28-4c24-adf5-05a53ae8b86e admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:05.963086 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14451558-cf28-4c24-adf5-05a53ae8b86e admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:05.967731 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f1ada-2646-4d0f-84bb-61d8136fe666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:05.968370 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f1ada-2646-4d0f-84bb-61d8136fe666 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:05.968650 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f1ada-2646-4d0f-84bb-61d8136fe666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:05.968925 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f1ada-2646-4d0f-84bb-61d8136fe666 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:05.969618 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f1ada-2646-4d0f-84bb-61d8136fe666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:05.971531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f1ada-2646-4d0f-84bb-61d8136fe666 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:05.996566 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1096/2191] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:36:05 2022] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:36:06.000532 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772251f-23b1-49c1-8439-16fdde97abbc None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:06.011402 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772251f-23b1-49c1-8439-16fdde97abbc None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:06.070297 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759505f5-2c1e-4683-9953-87e71f3c3fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:06.070973 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759505f5-2c1e-4683-9953-87e71f3c3fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:06.071258 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759505f5-2c1e-4683-9953-87e71f3c3fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:06.071547 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759505f5-2c1e-4683-9953-87e71f3c3fc1 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:06.072223 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759505f5-2c1e-4683-9953-87e71f3c3fc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:06.074186 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759505f5-2c1e-4683-9953-87e71f3c3fc1 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:06.092998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1096/2192] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:36:05 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:36:06.096949 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f1ada-2646-4d0f-84bb-61d8136fe666 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:06.108683 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f1ada-2646-4d0f-84bb-61d8136fe666 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:06.113309 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47532dec-eba5-4938-afaa-1c4699e35a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:06.113994 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47532dec-eba5-4938-afaa-1c4699e35a91 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:06.114274 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47532dec-eba5-4938-afaa-1c4699e35a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:06.114542 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47532dec-eba5-4938-afaa-1c4699e35a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:06.115258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47532dec-eba5-4938-afaa-1c4699e35a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:06.116829 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47532dec-eba5-4938-afaa-1c4699e35a91 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:06.127205 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1097/2193] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:36:06.131918 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759505f5-2c1e-4683-9953-87e71f3c3fc1 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:06.142029 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759505f5-2c1e-4683-9953-87e71f3c3fc1 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:06.147286 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace1943-5975-4cf0-9ffc-a956147879d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:06.148193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace1943-5975-4cf0-9ffc-a956147879d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:06.148477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace1943-5975-4cf0-9ffc-a956147879d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:06.148757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace1943-5975-4cf0-9ffc-a956147879d7 admin admin] PATH_INFO: `/v3/projects/e1407c27e49e482b95fe66d5942d3e75/users/d7da657582b6436ab7132fdeceb4c737/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:06.162969 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace1943-5975-4cf0-9ffc-a956147879d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1407c27e49e482b95fe66d5942d3e75, user_id=d7da657582b6436ab7132fdeceb4c737, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:06.165626 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace1943-5975-4cf0-9ffc-a956147879d7 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:06.178056 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1097/2194] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:36:06 2022] PUT /identity/v3/projects/e1407c27e49e482b95fe66d5942d3e75/users/d7da657582b6436ab7132fdeceb4c737/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:36:06.181583 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47532dec-eba5-4938-afaa-1c4699e35a91 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:06.191243 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47532dec-eba5-4938-afaa-1c4699e35a91 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:06.245350 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c987a-96d4-489b-ab3e-5239c04b9d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:06.246087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c987a-96d4-489b-ab3e-5239c04b9d26 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:06.246353 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c987a-96d4-489b-ab3e-5239c04b9d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:06.246626 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c987a-96d4-489b-ab3e-5239c04b9d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:06.247340 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c987a-96d4-489b-ab3e-5239c04b9d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:06.248935 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c987a-96d4-489b-ab3e-5239c04b9d26 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:06.260006 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1098/2195] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:36:06.264006 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace1943-5975-4cf0-9ffc-a956147879d7 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:06.273880 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace1943-5975-4cf0-9ffc-a956147879d7 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:06.278435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dcac75-c466-4a4f-8a82-05f8ebb96def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:06.279300 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcac75-c466-4a4f-8a82-05f8ebb96def admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:06.279579 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcac75-c466-4a4f-8a82-05f8ebb96def admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:06.279847 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcac75-c466-4a4f-8a82-05f8ebb96def admin admin] PATH_INFO: `/v3/projects/e1407c27e49e482b95fe66d5942d3e75/users/d7da657582b6436ab7132fdeceb4c737/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:06.282225 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dcac75-c466-4a4f-8a82-05f8ebb96def admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1407c27e49e482b95fe66d5942d3e75, user_id=d7da657582b6436ab7132fdeceb4c737, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:06.284909 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dcac75-c466-4a4f-8a82-05f8ebb96def admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:06.295292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1098/2196] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:36:06 2022] PUT /identity/v3/projects/e1407c27e49e482b95fe66d5942d3e75/users/d7da657582b6436ab7132fdeceb4c737/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:36:06.305874 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b7f30-9ba0-4165-b9d2-302a3a66c1a9 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:06.306286 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b7f30-9ba0-4165-b9d2-302a3a66c1a9 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:06.306564 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b7f30-9ba0-4165-b9d2-302a3a66c1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:06.333247 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-4e1b7f30-9ba0-4165-b9d2-302a3a66c1a9 None None] MFA Rules not processed for user `d7da657582b6436ab7132fdeceb4c737`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:36:06.334472 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-4e1b7f30-9ba0-4165-b9d2-302a3a66c1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:06.398506 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1099/2197] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:36:06 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:36:06.409305 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dcac75-c466-4a4f-8a82-05f8ebb96def admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:06.411526 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-f1dcac75-c466-4a4f-8a82-05f8ebb96def admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:06.466052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dcac75-c466-4a4f-8a82-05f8ebb96def admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:06.469789 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639c136-ab2e-418c-bcd4-e1e688400515 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:06.470649 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639c136-ab2e-418c-bcd4-e1e688400515 service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:06.470929 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639c136-ab2e-418c-bcd4-e1e688400515 service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:06.472545 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639c136-ab2e-418c-bcd4-e1e688400515 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:06.482058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639c136-ab2e-418c-bcd4-e1e688400515 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:06.483468 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639c136-ab2e-418c-bcd4-e1e688400515 service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:06.493233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1099/2198] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:36:06 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:36:06.569932 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b7f30-9ba0-4165-b9d2-302a3a66c1a9 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:06.571327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-4e1b7f30-9ba0-4165-b9d2-302a3a66c1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:06.583191 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b7f30-9ba0-4165-b9d2-302a3a66c1a9 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:06.587116 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787bef5e-76d1-40dd-ae68-eb0c24a81258 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:06.588071 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bef5e-76d1-40dd-ae68-eb0c24a81258 service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:06.588071 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bef5e-76d1-40dd-ae68-eb0c24a81258 service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:06.588378 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bef5e-76d1-40dd-ae68-eb0c24a81258 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:06.645042 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787bef5e-76d1-40dd-ae68-eb0c24a81258 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:06.646503 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787bef5e-76d1-40dd-ae68-eb0c24a81258 service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:06.655196 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1100/2199] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:36:06 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:36:13.490392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639c136-ab2e-418c-bcd4-e1e688400515 service cinder] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:13.552845 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639c136-ab2e-418c-bcd4-e1e688400515 service cinder] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:13.558260 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df2eb86-f260-4ad4-8397-aeaec4c59686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:13.559460 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2eb86-f260-4ad4-8397-aeaec4c59686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:13.559842 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2eb86-f260-4ad4-8397-aeaec4c59686 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:13.560221 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2eb86-f260-4ad4-8397-aeaec4c59686 admin admin] PATH_INFO: `/v3/users/e935640f3fe849708e81605799d8ed02` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:13.561646 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df2eb86-f260-4ad4-8397-aeaec4c59686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e935640f3fe849708e81605799d8ed02)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:13.563776 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df2eb86-f260-4ad4-8397-aeaec4c59686 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:13.614067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-6df2eb86-f260-4ad4-8397-aeaec4c59686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e935640f3fe849708e81605799d8ed02'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:13.625210 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-6df2eb86-f260-4ad4-8397-aeaec4c59686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e935640f3fe849708e81605799d8ed02'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:13.625922 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-6df2eb86-f260-4ad4-8397-aeaec4c59686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e935640f3fe849708e81605799d8ed02'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:13.633874 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-6df2eb86-f260-4ad4-8397-aeaec4c59686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e935640f3fe849708e81605799d8ed02'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:13.640930 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-6df2eb86-f260-4ad4-8397-aeaec4c59686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e935640f3fe849708e81605799d8ed02'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:13.646781 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1100/2200] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:36:13 2022] DELETE /identity/v3/users/e935640f3fe849708e81605799d8ed02 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:36:13.651888 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117f38d-8f5b-47ed-bb0c-68d22b61aa60 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:13.652387 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117f38d-8f5b-47ed-bb0c-68d22b61aa60 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:13.652572 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117f38d-8f5b-47ed-bb0c-68d22b61aa60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:13.670582 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-7117f38d-8f5b-47ed-bb0c-68d22b61aa60 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:36:13.672010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-7117f38d-8f5b-47ed-bb0c-68d22b61aa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:13.730172 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1101/2201] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:36:13.740230 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df2eb86-f260-4ad4-8397-aeaec4c59686 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:13.741624 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-6df2eb86-f260-4ad4-8397-aeaec4c59686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:13.797119 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df2eb86-f260-4ad4-8397-aeaec4c59686 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:13.801469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c77a13-d054-4f4a-8db9-9cfe661aa3f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:13.802179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c77a13-d054-4f4a-8db9-9cfe661aa3f7 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:13.802486 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c77a13-d054-4f4a-8db9-9cfe661aa3f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:13.802800 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c77a13-d054-4f4a-8db9-9cfe661aa3f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:13.811843 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c77a13-d054-4f4a-8db9-9cfe661aa3f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:13.813298 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c77a13-d054-4f4a-8db9-9cfe661aa3f7 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:13.822778 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1101/2202] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:36:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 09:36:14.139896 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117f38d-8f5b-47ed-bb0c-68d22b61aa60 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:14.141297 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-7117f38d-8f5b-47ed-bb0c-68d22b61aa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:14.153470 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117f38d-8f5b-47ed-bb0c-68d22b61aa60 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:14.158387 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b6658-1a23-450b-9558-1333d5196eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:14.159282 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b6658-1a23-450b-9558-1333d5196eea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:14.159561 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b6658-1a23-450b-9558-1333d5196eea admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:14.159827 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b6658-1a23-450b-9558-1333d5196eea admin admin] PATH_INFO: `/v3/projects/eb2e177fd53c45709ac9d0437faf2276` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:14.161565 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b6658-1a23-450b-9558-1333d5196eea admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb2e177fd53c45709ac9d0437faf2276)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:14.163513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b6658-1a23-450b-9558-1333d5196eea admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:14.207581 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-412b6658-1a23-450b-9558-1333d5196eea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb2e177fd53c45709ac9d0437faf2276', 'request_id': 'req-412b6658-1a23-450b-9558-1333d5196eea'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:14.212839 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-412b6658-1a23-450b-9558-1333d5196eea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb2e177fd53c45709ac9d0437faf2276', 'request_id': 'req-412b6658-1a23-450b-9558-1333d5196eea'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:14.219925 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-412b6658-1a23-450b-9558-1333d5196eea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb2e177fd53c45709ac9d0437faf2276', 'request_id': 'req-412b6658-1a23-450b-9558-1333d5196eea'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:14.230711 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-412b6658-1a23-450b-9558-1333d5196eea admin admin] The token cache is being invalidate because project eb2e177fd53c45709ac9d0437faf2276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:36:14.231019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-412b6658-1a23-450b-9558-1333d5196eea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:14.231649 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-412b6658-1a23-450b-9558-1333d5196eea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:14.233180 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1102/2203] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:36:14 2022] DELETE /identity/v3/projects/eb2e177fd53c45709ac9d0437faf2276 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:36:14.237251 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c77a13-d054-4f4a-8db9-9cfe661aa3f7 service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:14.247585 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c77a13-d054-4f4a-8db9-9cfe661aa3f7 service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:14.302960 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a76b39-fb83-4ae0-b2f7-f5444d751317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:14.303839 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a76b39-fb83-4ae0-b2f7-f5444d751317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:14.304119 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a76b39-fb83-4ae0-b2f7-f5444d751317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:14.304392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a76b39-fb83-4ae0-b2f7-f5444d751317 admin admin] PATH_INFO: `/v3/users/d7da657582b6436ab7132fdeceb4c737` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:14.305606 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a76b39-fb83-4ae0-b2f7-f5444d751317 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7da657582b6436ab7132fdeceb4c737)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:14.307554 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a76b39-fb83-4ae0-b2f7-f5444d751317 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:14.351849 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-04a76b39-fb83-4ae0-b2f7-f5444d751317 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7da657582b6436ab7132fdeceb4c737'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:14.363761 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-04a76b39-fb83-4ae0-b2f7-f5444d751317 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7da657582b6436ab7132fdeceb4c737'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:14.364405 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-04a76b39-fb83-4ae0-b2f7-f5444d751317 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7da657582b6436ab7132fdeceb4c737'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:14.372142 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-04a76b39-fb83-4ae0-b2f7-f5444d751317 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7da657582b6436ab7132fdeceb4c737'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:14.379901 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-04a76b39-fb83-4ae0-b2f7-f5444d751317 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7da657582b6436ab7132fdeceb4c737'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:14.385941 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1102/2204] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:36:14 2022] DELETE /identity/v3/users/d7da657582b6436ab7132fdeceb4c737 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:36:14.641630 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b6658-1a23-450b-9558-1333d5196eea admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:14.643248 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-412b6658-1a23-450b-9558-1333d5196eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:14.665049 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b6658-1a23-450b-9558-1333d5196eea admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:14.728067 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccaf0b5-9482-406d-b712-4ccf4370ba58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:14.728990 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccaf0b5-9482-406d-b712-4ccf4370ba58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:14.729259 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccaf0b5-9482-406d-b712-4ccf4370ba58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:14.729535 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccaf0b5-9482-406d-b712-4ccf4370ba58 admin admin] PATH_INFO: `/v3/projects/e1407c27e49e482b95fe66d5942d3e75` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:14.730999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccaf0b5-9482-406d-b712-4ccf4370ba58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1407c27e49e482b95fe66d5942d3e75)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:14.732913 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccaf0b5-9482-406d-b712-4ccf4370ba58 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:14.779276 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4ccaf0b5-9482-406d-b712-4ccf4370ba58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1407c27e49e482b95fe66d5942d3e75', 'request_id': 'req-4ccaf0b5-9482-406d-b712-4ccf4370ba58'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:14.784500 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4ccaf0b5-9482-406d-b712-4ccf4370ba58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1407c27e49e482b95fe66d5942d3e75', 'request_id': 'req-4ccaf0b5-9482-406d-b712-4ccf4370ba58'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:14.793946 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4ccaf0b5-9482-406d-b712-4ccf4370ba58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1407c27e49e482b95fe66d5942d3e75', 'request_id': 'req-4ccaf0b5-9482-406d-b712-4ccf4370ba58'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:14.809252 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4ccaf0b5-9482-406d-b712-4ccf4370ba58 admin admin] The token cache is being invalidate because project e1407c27e49e482b95fe66d5942d3e75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:36:14.809534 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4ccaf0b5-9482-406d-b712-4ccf4370ba58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:14.810294 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4ccaf0b5-9482-406d-b712-4ccf4370ba58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:14.811938 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1103/2205] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:36:14 2022] DELETE /identity/v3/projects/e1407c27e49e482b95fe66d5942d3e75 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:36:14.817706 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412600ad-0105-426e-bb57-70ae621bce4e None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:14.818330 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412600ad-0105-426e-bb57-70ae621bce4e None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:14.818659 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412600ad-0105-426e-bb57-70ae621bce4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:14.849517 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-412600ad-0105-426e-bb57-70ae621bce4e None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:36:14.849517 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-412600ad-0105-426e-bb57-70ae621bce4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:14.909779 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1103/2206] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:36:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:36:14.919391 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097663b-efa9-43e8-9d71-a371a6fc735e None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:14.919681 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097663b-efa9-43e8-9d71-a371a6fc735e None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:14.920049 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097663b-efa9-43e8-9d71-a371a6fc735e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:14.939159 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-f097663b-efa9-43e8-9d71-a371a6fc735e None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:36:14.939405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-f097663b-efa9-43e8-9d71-a371a6fc735e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:14.948628 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1104/2207] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:36:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:36:14.952668 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412600ad-0105-426e-bb57-70ae621bce4e None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:14.965002 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412600ad-0105-426e-bb57-70ae621bce4e None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:14.976517 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e027859-b425-4723-8e75-f5872ad93141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:14.977502 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e027859-b425-4723-8e75-f5872ad93141 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:14.977986 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e027859-b425-4723-8e75-f5872ad93141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:14.978276 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e027859-b425-4723-8e75-f5872ad93141 admin admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:14.978991 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e027859-b425-4723-8e75-f5872ad93141 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:36:14.979300 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e027859-b425-4723-8e75-f5872ad93141 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:14.980949 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e027859-b425-4723-8e75-f5872ad93141 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:14.993701 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1104/2208] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:36:14.997862 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097663b-efa9-43e8-9d71-a371a6fc735e None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:15.008352 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097663b-efa9-43e8-9d71-a371a6fc735e None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:15.013605 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de36b9-3dcd-441a-b659-483e53c44c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:15.014324 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de36b9-3dcd-441a-b659-483e53c44c33 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:15.014609 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de36b9-3dcd-441a-b659-483e53c44c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:15.014881 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de36b9-3dcd-441a-b659-483e53c44c33 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:15.015601 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de36b9-3dcd-441a-b659-483e53c44c33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:15.017641 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de36b9-3dcd-441a-b659-483e53c44c33 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:15.048287 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1105/2209] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:36:14 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:36:15.049766 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e027859-b425-4723-8e75-f5872ad93141 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:15.063188 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e027859-b425-4723-8e75-f5872ad93141 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:15.142162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ed01b-e6bb-40bb-9afb-3e6ae56adf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:15.143110 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ed01b-e6bb-40bb-9afb-3e6ae56adf44 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:15.143390 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ed01b-e6bb-40bb-9afb-3e6ae56adf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:15.143663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ed01b-e6bb-40bb-9afb-3e6ae56adf44 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:15.144404 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ed01b-e6bb-40bb-9afb-3e6ae56adf44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:15.146380 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ed01b-e6bb-40bb-9afb-3e6ae56adf44 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:15.175260 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1105/2210] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:36:15 2022] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:36:15.179619 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de36b9-3dcd-441a-b659-483e53c44c33 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:15.197359 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de36b9-3dcd-441a-b659-483e53c44c33 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:15.204540 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2237239-d151-423e-98fd-d17bd9835268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:15.205336 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2237239-d151-423e-98fd-d17bd9835268 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:15.205723 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2237239-d151-423e-98fd-d17bd9835268 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:15.206255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2237239-d151-423e-98fd-d17bd9835268 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:15.208652 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2237239-d151-423e-98fd-d17bd9835268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:15.210402 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2237239-d151-423e-98fd-d17bd9835268 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:15.238539 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1106/2211] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 09:36:15.241569 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ed01b-e6bb-40bb-9afb-3e6ae56adf44 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:15.253146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ed01b-e6bb-40bb-9afb-3e6ae56adf44 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:15.260100 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892c6e3-19b4-4ea8-b748-7e07d96d2f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:15.261403 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892c6e3-19b4-4ea8-b748-7e07d96d2f6b admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:15.261689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892c6e3-19b4-4ea8-b748-7e07d96d2f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:15.262023 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892c6e3-19b4-4ea8-b748-7e07d96d2f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:15.263302 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892c6e3-19b4-4ea8-b748-7e07d96d2f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:15.265736 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892c6e3-19b4-4ea8-b748-7e07d96d2f6b admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:15.288011 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1106/2212] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:36:15.290038 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2237239-d151-423e-98fd-d17bd9835268 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:15.304939 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2237239-d151-423e-98fd-d17bd9835268 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:15.310213 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfe8bd-a39d-490a-9a5e-103e9f5d2e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:15.311102 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfe8bd-a39d-490a-9a5e-103e9f5d2e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:15.311382 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfe8bd-a39d-490a-9a5e-103e9f5d2e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:15.311694 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfe8bd-a39d-490a-9a5e-103e9f5d2e32 admin admin] PATH_INFO: `/v3/projects/a71eb1c5e3af4eb98f84ec1c65f29cfe/users/f84b8cee00dd479f8064e3660674bb3a/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:15.330844 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decfe8bd-a39d-490a-9a5e-103e9f5d2e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a71eb1c5e3af4eb98f84ec1c65f29cfe, user_id=f84b8cee00dd479f8064e3660674bb3a, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:15.334033 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decfe8bd-a39d-490a-9a5e-103e9f5d2e32 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:15.359632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1107/2213] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:36:15 2022] PUT /identity/v3/projects/a71eb1c5e3af4eb98f84ec1c65f29cfe/users/f84b8cee00dd479f8064e3660674bb3a/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:36:15.371977 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cc418-afc1-4ffe-a98d-e83e9abc48ec None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:15.372342 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cc418-afc1-4ffe-a98d-e83e9abc48ec None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:15.372623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cc418-afc1-4ffe-a98d-e83e9abc48ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:15.405718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-088cc418-afc1-4ffe-a98d-e83e9abc48ec None None] MFA Rules not processed for user `f84b8cee00dd479f8064e3660674bb3a`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:36:15.407878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-088cc418-afc1-4ffe-a98d-e83e9abc48ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:15.486757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1107/2214] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:36:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:36:15.499501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfe8bd-a39d-490a-9a5e-103e9f5d2e32 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:15.501773 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-decfe8bd-a39d-490a-9a5e-103e9f5d2e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:15.579401 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfe8bd-a39d-490a-9a5e-103e9f5d2e32 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:15.583752 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91f511-2303-4056-9211-cd040110e2c5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0981a8c6d9ac413b99aae95a6cdd3be5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:15.584661 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91f511-2303-4056-9211-cd040110e2c5 service glance] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:15.584823 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91f511-2303-4056-9211-cd040110e2c5 service glance] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:15.585086 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91f511-2303-4056-9211-cd040110e2c5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:15.595034 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91f511-2303-4056-9211-cd040110e2c5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:15.599404 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91f511-2303-4056-9211-cd040110e2c5 service glance] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:15.607232 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1108/2215] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:36:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:36:16.830931 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088cc418-afc1-4ffe-a98d-e83e9abc48ec None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:16.832945 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-088cc418-afc1-4ffe-a98d-e83e9abc48ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:16.919101 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088cc418-afc1-4ffe-a98d-e83e9abc48ec None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:16.924051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea93482-b78f-46ef-91ef-b1e9078f551c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:16.924973 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea93482-b78f-46ef-91ef-b1e9078f551c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:16.925256 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea93482-b78f-46ef-91ef-b1e9078f551c admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:16.925558 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea93482-b78f-46ef-91ef-b1e9078f551c admin admin] PATH_INFO: `/v3/users/c2695c6e862040a2887540788a736533` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:16.926821 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea93482-b78f-46ef-91ef-b1e9078f551c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2695c6e862040a2887540788a736533)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:16.928693 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea93482-b78f-46ef-91ef-b1e9078f551c admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:16.973288 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-3ea93482-b78f-46ef-91ef-b1e9078f551c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2695c6e862040a2887540788a736533'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:16.984393 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-3ea93482-b78f-46ef-91ef-b1e9078f551c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2695c6e862040a2887540788a736533'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:16.985074 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-3ea93482-b78f-46ef-91ef-b1e9078f551c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2695c6e862040a2887540788a736533'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:16.992039 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-3ea93482-b78f-46ef-91ef-b1e9078f551c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2695c6e862040a2887540788a736533'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:16.998688 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-3ea93482-b78f-46ef-91ef-b1e9078f551c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2695c6e862040a2887540788a736533'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:17.004933 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1108/2216] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:36:16 2022] DELETE /identity/v3/users/c2695c6e862040a2887540788a736533 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:36:17.009759 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27992407-75ff-4c71-bb3d-53f217c10265 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:17.010293 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27992407-75ff-4c71-bb3d-53f217c10265 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:17.010394 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27992407-75ff-4c71-bb3d-53f217c10265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:17.026903 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-27992407-75ff-4c71-bb3d-53f217c10265 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:36:17.028056 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-27992407-75ff-4c71-bb3d-53f217c10265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:17.085348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1109/2217] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:36:17.094905 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea93482-b78f-46ef-91ef-b1e9078f551c admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:17.096597 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-3ea93482-b78f-46ef-91ef-b1e9078f551c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:17.159315 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea93482-b78f-46ef-91ef-b1e9078f551c admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:17.162988 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af455293-a02c-4c53-ba6b-9f72b6fb65e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:17.163692 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af455293-a02c-4c53-ba6b-9f72b6fb65e3 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:17.163979 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af455293-a02c-4c53-ba6b-9f72b6fb65e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:17.164253 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af455293-a02c-4c53-ba6b-9f72b6fb65e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:17.173400 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af455293-a02c-4c53-ba6b-9f72b6fb65e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:17.174882 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af455293-a02c-4c53-ba6b-9f72b6fb65e3 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:17.184916 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1109/2218] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:36:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 09:36:17.442557 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27992407-75ff-4c71-bb3d-53f217c10265 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:17.444218 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-27992407-75ff-4c71-bb3d-53f217c10265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:17.456844 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27992407-75ff-4c71-bb3d-53f217c10265 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:17.462496 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa35a43-9fdf-4bde-a9dc-74c2915b8636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:17.463373 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa35a43-9fdf-4bde-a9dc-74c2915b8636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:17.464212 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa35a43-9fdf-4bde-a9dc-74c2915b8636 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:17.464494 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa35a43-9fdf-4bde-a9dc-74c2915b8636 admin admin] PATH_INFO: `/v3/projects/85757f07d4c1403aae6cd60a5b95843d` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:17.465938 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa35a43-9fdf-4bde-a9dc-74c2915b8636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85757f07d4c1403aae6cd60a5b95843d)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:17.467896 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa35a43-9fdf-4bde-a9dc-74c2915b8636 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:17.515291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4fa35a43-9fdf-4bde-a9dc-74c2915b8636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85757f07d4c1403aae6cd60a5b95843d', 'request_id': 'req-4fa35a43-9fdf-4bde-a9dc-74c2915b8636'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:17.521366 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4fa35a43-9fdf-4bde-a9dc-74c2915b8636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85757f07d4c1403aae6cd60a5b95843d', 'request_id': 'req-4fa35a43-9fdf-4bde-a9dc-74c2915b8636'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:17.529279 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4fa35a43-9fdf-4bde-a9dc-74c2915b8636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85757f07d4c1403aae6cd60a5b95843d', 'request_id': 'req-4fa35a43-9fdf-4bde-a9dc-74c2915b8636'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:17.540771 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4fa35a43-9fdf-4bde-a9dc-74c2915b8636 admin admin] The token cache is being invalidate because project 85757f07d4c1403aae6cd60a5b95843d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:36:17.541083 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4fa35a43-9fdf-4bde-a9dc-74c2915b8636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:17.541736 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4fa35a43-9fdf-4bde-a9dc-74c2915b8636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:17.543384 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1110/2219] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:36:17 2022] DELETE /identity/v3/projects/85757f07d4c1403aae6cd60a5b95843d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:36:17.547522 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af455293-a02c-4c53-ba6b-9f72b6fb65e3 service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:17.557522 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af455293-a02c-4c53-ba6b-9f72b6fb65e3 service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:17.614403 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39cc466-ece3-4779-bc6d-47afb2fbefc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:17.615199 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cc466-ece3-4779-bc6d-47afb2fbefc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:17.615490 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cc466-ece3-4779-bc6d-47afb2fbefc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:17.615819 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cc466-ece3-4779-bc6d-47afb2fbefc2 admin admin] PATH_INFO: `/v3/users/91f71d03766e4b36b0db24674a063e6a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:17.617186 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39cc466-ece3-4779-bc6d-47afb2fbefc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91f71d03766e4b36b0db24674a063e6a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:17.619157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39cc466-ece3-4779-bc6d-47afb2fbefc2 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:17.665120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-f39cc466-ece3-4779-bc6d-47afb2fbefc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91f71d03766e4b36b0db24674a063e6a'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:17.678574 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-f39cc466-ece3-4779-bc6d-47afb2fbefc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91f71d03766e4b36b0db24674a063e6a'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:17.679625 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-f39cc466-ece3-4779-bc6d-47afb2fbefc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91f71d03766e4b36b0db24674a063e6a'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:17.688055 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-f39cc466-ece3-4779-bc6d-47afb2fbefc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91f71d03766e4b36b0db24674a063e6a'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:17.696879 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-f39cc466-ece3-4779-bc6d-47afb2fbefc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91f71d03766e4b36b0db24674a063e6a'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:17.704530 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1110/2220] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:36:17 2022] DELETE /identity/v3/users/91f71d03766e4b36b0db24674a063e6a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:36:17.975939 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa35a43-9fdf-4bde-a9dc-74c2915b8636 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:17.977570 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-4fa35a43-9fdf-4bde-a9dc-74c2915b8636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:18.002510 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa35a43-9fdf-4bde-a9dc-74c2915b8636 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:18.083319 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf08953-b548-457e-9559-1aaf554b8774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:18.084255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf08953-b548-457e-9559-1aaf554b8774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:18.084537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf08953-b548-457e-9559-1aaf554b8774 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:18.084850 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf08953-b548-457e-9559-1aaf554b8774 admin admin] PATH_INFO: `/v3/projects/092fe9b8accf432db4ce9eb9ebb8a43d` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:18.086068 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf08953-b548-457e-9559-1aaf554b8774 admin admin] RBAC: Authorizing `identity:delete_project(project_id=092fe9b8accf432db4ce9eb9ebb8a43d)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:18.087987 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf08953-b548-457e-9559-1aaf554b8774 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:18.134951 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-fbf08953-b548-457e-9559-1aaf554b8774 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '092fe9b8accf432db4ce9eb9ebb8a43d', 'request_id': 'req-fbf08953-b548-457e-9559-1aaf554b8774'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:18.140423 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-fbf08953-b548-457e-9559-1aaf554b8774 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '092fe9b8accf432db4ce9eb9ebb8a43d', 'request_id': 'req-fbf08953-b548-457e-9559-1aaf554b8774'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:18.148246 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-fbf08953-b548-457e-9559-1aaf554b8774 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '092fe9b8accf432db4ce9eb9ebb8a43d', 'request_id': 'req-fbf08953-b548-457e-9559-1aaf554b8774'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:18.161164 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-fbf08953-b548-457e-9559-1aaf554b8774 admin admin] The token cache is being invalidate because project 092fe9b8accf432db4ce9eb9ebb8a43d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:36:18.161453 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-fbf08953-b548-457e-9559-1aaf554b8774 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:18.162140 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-fbf08953-b548-457e-9559-1aaf554b8774 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:18.163908 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1111/2221] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:36:17 2022] DELETE /identity/v3/projects/092fe9b8accf432db4ce9eb9ebb8a43d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:36:18.169324 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71df9d-c26e-4eec-87e2-73c804f31aab None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:18.169769 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71df9d-c26e-4eec-87e2-73c804f31aab None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:18.169991 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71df9d-c26e-4eec-87e2-73c804f31aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:18.190848 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-bc71df9d-c26e-4eec-87e2-73c804f31aab None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:36:18.192157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-bc71df9d-c26e-4eec-87e2-73c804f31aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:18.257474 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1111/2222] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:36:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:36:18.265468 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70b655-1218-486c-b093-7b6eaa073124 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:18.265752 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70b655-1218-486c-b093-7b6eaa073124 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:18.266064 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70b655-1218-486c-b093-7b6eaa073124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:18.284356 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-6c70b655-1218-486c-b093-7b6eaa073124 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:36:18.285540 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-6c70b655-1218-486c-b093-7b6eaa073124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:18.293287 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1112/2223] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:36:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:36:18.297429 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71df9d-c26e-4eec-87e2-73c804f31aab None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:18.306845 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71df9d-c26e-4eec-87e2-73c804f31aab None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:18.311392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba38654-fd6d-451f-9337-13ccd51de408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:18.312038 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba38654-fd6d-451f-9337-13ccd51de408 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:18.312320 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba38654-fd6d-451f-9337-13ccd51de408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:18.312593 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba38654-fd6d-451f-9337-13ccd51de408 admin admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:18.313310 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba38654-fd6d-451f-9337-13ccd51de408 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:36:18.313616 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba38654-fd6d-451f-9337-13ccd51de408 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:18.315242 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba38654-fd6d-451f-9337-13ccd51de408 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:18.331003 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1112/2224] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:36:18.332721 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70b655-1218-486c-b093-7b6eaa073124 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:18.341718 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70b655-1218-486c-b093-7b6eaa073124 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:18.346367 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55164f78-1723-4a19-8ac7-5f1cd4fad6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:18.347006 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55164f78-1723-4a19-8ac7-5f1cd4fad6a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:18.347327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55164f78-1723-4a19-8ac7-5f1cd4fad6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:18.347605 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55164f78-1723-4a19-8ac7-5f1cd4fad6a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:18.348304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55164f78-1723-4a19-8ac7-5f1cd4fad6a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:18.351611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55164f78-1723-4a19-8ac7-5f1cd4fad6a8 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:18.375978 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1113/2225] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:36:18 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:36:18.380737 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba38654-fd6d-451f-9337-13ccd51de408 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:18.390768 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba38654-fd6d-451f-9337-13ccd51de408 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:18.448478 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701ff5f-f165-4e44-995e-2c3858b47868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:18.449085 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701ff5f-f165-4e44-995e-2c3858b47868 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:18.449373 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701ff5f-f165-4e44-995e-2c3858b47868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:18.449650 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701ff5f-f165-4e44-995e-2c3858b47868 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:18.450368 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701ff5f-f165-4e44-995e-2c3858b47868 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:18.452280 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701ff5f-f165-4e44-995e-2c3858b47868 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:18.473603 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1113/2226] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:36:18 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:36:18.478747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55164f78-1723-4a19-8ac7-5f1cd4fad6a8 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:18.491451 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55164f78-1723-4a19-8ac7-5f1cd4fad6a8 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:18.497461 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63480b0b-cc73-425c-8d20-4a8479dc6e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:18.498244 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63480b0b-cc73-425c-8d20-4a8479dc6e97 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:18.498528 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63480b0b-cc73-425c-8d20-4a8479dc6e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:18.498807 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63480b0b-cc73-425c-8d20-4a8479dc6e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:18.499655 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63480b0b-cc73-425c-8d20-4a8479dc6e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:18.501373 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63480b0b-cc73-425c-8d20-4a8479dc6e97 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:18.512714 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1114/2227] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:36:18.517426 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701ff5f-f165-4e44-995e-2c3858b47868 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:18.528097 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701ff5f-f165-4e44-995e-2c3858b47868 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:18.534322 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48b23e-4efd-4a8a-a97a-49bcce1335c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:18.535114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48b23e-4efd-4a8a-a97a-49bcce1335c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:18.535399 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48b23e-4efd-4a8a-a97a-49bcce1335c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:18.535667 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48b23e-4efd-4a8a-a97a-49bcce1335c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:18.536465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48b23e-4efd-4a8a-a97a-49bcce1335c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:18.538972 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48b23e-4efd-4a8a-a97a-49bcce1335c3 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:18.551652 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1114/2228] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:36:18.555751 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63480b0b-cc73-425c-8d20-4a8479dc6e97 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:18.565520 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63480b0b-cc73-425c-8d20-4a8479dc6e97 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:18.570755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8cb5a-f828-4d93-9d38-c0ffddf9b73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:18.571652 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8cb5a-f828-4d93-9d38-c0ffddf9b73f admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:18.571933 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8cb5a-f828-4d93-9d38-c0ffddf9b73f admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:18.572206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8cb5a-f828-4d93-9d38-c0ffddf9b73f admin admin] PATH_INFO: `/v3/projects/0bb92cff36154d90bb549f9cef1a7749/users/dc004fb0067f4153b245bd55116ba220/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:18.586766 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8cb5a-f828-4d93-9d38-c0ffddf9b73f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bb92cff36154d90bb549f9cef1a7749, user_id=dc004fb0067f4153b245bd55116ba220, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:18.589660 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8cb5a-f828-4d93-9d38-c0ffddf9b73f admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:18.602433 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1115/2229] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:36:18 2022] PUT /identity/v3/projects/0bb92cff36154d90bb549f9cef1a7749/users/dc004fb0067f4153b245bd55116ba220/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:36:18.608001 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9486d-6cae-4642-8e50-d8c081c13aac None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:18.608295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9486d-6cae-4642-8e50-d8c081c13aac None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:18.608573 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9486d-6cae-4642-8e50-d8c081c13aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:18.629954 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-efd9486d-6cae-4642-8e50-d8c081c13aac None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:36:18.631142 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-efd9486d-6cae-4642-8e50-d8c081c13aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:18.689636 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1115/2230] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:36:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:36:18.700400 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8cb5a-f828-4d93-9d38-c0ffddf9b73f admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:18.702346 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-15f8cb5a-f828-4d93-9d38-c0ffddf9b73f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:18.764266 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8cb5a-f828-4d93-9d38-c0ffddf9b73f admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:18.768652 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd549957-f290-430d-bc02-f2127a2e00e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:18.769486 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd549957-f290-430d-bc02-f2127a2e00e1 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:18.769866 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd549957-f290-430d-bc02-f2127a2e00e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:18.770295 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd549957-f290-430d-bc02-f2127a2e00e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:18.780110 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd549957-f290-430d-bc02-f2127a2e00e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:18.781635 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd549957-f290-430d-bc02-f2127a2e00e1 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:18.792347 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1116/2231] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:36:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:36:19.427708 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444f602-c87e-4e45-a152-415eb55afd36 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:19.428312 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444f602-c87e-4e45-a152-415eb55afd36 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:19.428312 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444f602-c87e-4e45-a152-415eb55afd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:19.466176 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-a444f602-c87e-4e45-a152-415eb55afd36 None None] MFA Rules not processed for user `dc004fb0067f4153b245bd55116ba220`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:36:19.468861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-a444f602-c87e-4e45-a152-415eb55afd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:19.581688 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1116/2232] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:36:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:36:19.585479 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd549957-f290-430d-bc02-f2127a2e00e1 service neutron] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:19.597459 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd549957-f290-430d-bc02-f2127a2e00e1 service neutron] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:19.613384 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f77c99-3289-4ab9-b566-660bb62bce95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:19.614759 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f77c99-3289-4ab9-b566-660bb62bce95 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:19.615473 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f77c99-3289-4ab9-b566-660bb62bce95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:19.615764 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f77c99-3289-4ab9-b566-660bb62bce95 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:19.616499 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f77c99-3289-4ab9-b566-660bb62bce95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:19.619259 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f77c99-3289-4ab9-b566-660bb62bce95 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:19.653256 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1117/2233] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:36:19 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:36:19.658209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444f602-c87e-4e45-a152-415eb55afd36 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:19.686999 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444f602-c87e-4e45-a152-415eb55afd36 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:19.749561 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37809388-2079-4694-9877-57448b5be2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:19.750213 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37809388-2079-4694-9877-57448b5be2a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:19.750489 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37809388-2079-4694-9877-57448b5be2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:19.750761 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37809388-2079-4694-9877-57448b5be2a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:19.751455 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37809388-2079-4694-9877-57448b5be2a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:19.753363 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37809388-2079-4694-9877-57448b5be2a5 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:19.778190 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1117/2234] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:36:19 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:36:19.779389 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f77c99-3289-4ab9-b566-660bb62bce95 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:19.790701 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f77c99-3289-4ab9-b566-660bb62bce95 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:19.795480 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918f2cd-e936-4ba7-b026-f411e022b91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:19.796142 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918f2cd-e936-4ba7-b026-f411e022b91c admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:19.796422 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918f2cd-e936-4ba7-b026-f411e022b91c admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:19.796697 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918f2cd-e936-4ba7-b026-f411e022b91c admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:19.797465 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5918f2cd-e936-4ba7-b026-f411e022b91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:19.799038 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5918f2cd-e936-4ba7-b026-f411e022b91c admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:19.810068 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1118/2235] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:36:19.814201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37809388-2079-4694-9877-57448b5be2a5 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:19.824635 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37809388-2079-4694-9877-57448b5be2a5 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:19.829940 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21117fb5-7945-4461-9c8e-89a61da68874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:19.830849 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21117fb5-7945-4461-9c8e-89a61da68874 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:19.831435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21117fb5-7945-4461-9c8e-89a61da68874 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:19.831435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21117fb5-7945-4461-9c8e-89a61da68874 admin admin] PATH_INFO: `/v3/projects/1d3842ca641440ad9f1a616a5a4d44bb/users/f9b54ba8719e40b19c38b3cfe59a567c/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:19.850318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21117fb5-7945-4461-9c8e-89a61da68874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3842ca641440ad9f1a616a5a4d44bb, user_id=f9b54ba8719e40b19c38b3cfe59a567c, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:19.853052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21117fb5-7945-4461-9c8e-89a61da68874 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:19.867783 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1118/2236] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:36:19 2022] PUT /identity/v3/projects/1d3842ca641440ad9f1a616a5a4d44bb/users/f9b54ba8719e40b19c38b3cfe59a567c/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:36:19.871732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918f2cd-e936-4ba7-b026-f411e022b91c admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:19.885836 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918f2cd-e936-4ba7-b026-f411e022b91c admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:19.949885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1bbaac-6d34-484e-9641-a992d2e443fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:19.950624 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bbaac-6d34-484e-9641-a992d2e443fd admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:19.950906 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bbaac-6d34-484e-9641-a992d2e443fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:19.951180 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bbaac-6d34-484e-9641-a992d2e443fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:19.951920 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1bbaac-6d34-484e-9641-a992d2e443fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:19.953531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1bbaac-6d34-484e-9641-a992d2e443fd admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:19.966947 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1119/2237] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:36:19.967999 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21117fb5-7945-4461-9c8e-89a61da68874 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:19.978295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21117fb5-7945-4461-9c8e-89a61da68874 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:19.983291 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a8d54-65d4-4077-ac81-7056ae762709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:19.984184 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a8d54-65d4-4077-ac81-7056ae762709 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:19.984497 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a8d54-65d4-4077-ac81-7056ae762709 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:19.984777 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a8d54-65d4-4077-ac81-7056ae762709 admin admin] PATH_INFO: `/v3/projects/1d3842ca641440ad9f1a616a5a4d44bb/users/f9b54ba8719e40b19c38b3cfe59a567c/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:19.986982 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a8d54-65d4-4077-ac81-7056ae762709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3842ca641440ad9f1a616a5a4d44bb, user_id=f9b54ba8719e40b19c38b3cfe59a567c, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:19.990223 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a8d54-65d4-4077-ac81-7056ae762709 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:20.002078 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1119/2238] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:36:19 2022] PUT /identity/v3/projects/1d3842ca641440ad9f1a616a5a4d44bb/users/f9b54ba8719e40b19c38b3cfe59a567c/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:36:20.266550 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1bbaac-6d34-484e-9641-a992d2e443fd admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:20.270625 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-8b1bbaac-6d34-484e-9641-a992d2e443fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:20.286308 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1bbaac-6d34-484e-9641-a992d2e443fd admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:20.362538 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9889b5-f94c-4411-b60c-6b75ea696869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:20.364124 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9889b5-f94c-4411-b60c-6b75ea696869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:20.364504 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9889b5-f94c-4411-b60c-6b75ea696869 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:20.364881 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9889b5-f94c-4411-b60c-6b75ea696869 admin admin] PATH_INFO: `/v3/users/1707a9f4304e4ae18e79b244a5578126` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:20.368424 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9889b5-f94c-4411-b60c-6b75ea696869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1707a9f4304e4ae18e79b244a5578126)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:20.371249 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9889b5-f94c-4411-b60c-6b75ea696869 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:20.433206 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-1b9889b5-f94c-4411-b60c-6b75ea696869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1707a9f4304e4ae18e79b244a5578126'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:20.445544 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-1b9889b5-f94c-4411-b60c-6b75ea696869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1707a9f4304e4ae18e79b244a5578126'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:20.446320 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-1b9889b5-f94c-4411-b60c-6b75ea696869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1707a9f4304e4ae18e79b244a5578126'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:20.453792 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-1b9889b5-f94c-4411-b60c-6b75ea696869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1707a9f4304e4ae18e79b244a5578126'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:20.460987 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-1b9889b5-f94c-4411-b60c-6b75ea696869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1707a9f4304e4ae18e79b244a5578126'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:20.467212 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1120/2239] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:36:20 2022] DELETE /identity/v3/users/1707a9f4304e4ae18e79b244a5578126 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:36:20.471841 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d9933-1299-4cd9-965a-4e191a3116d7 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:20.472870 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d9933-1299-4cd9-965a-4e191a3116d7 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:20.473120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d9933-1299-4cd9-965a-4e191a3116d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:20.492284 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-906d9933-1299-4cd9-965a-4e191a3116d7 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:36:20.493665 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-906d9933-1299-4cd9-965a-4e191a3116d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:20.554675 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1120/2240] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:36:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:36:20.565143 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9889b5-f94c-4411-b60c-6b75ea696869 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:20.568157 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-1b9889b5-f94c-4411-b60c-6b75ea696869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:20.632021 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628e633-34a4-43e5-bd86-7515fabafbf7 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:20.632420 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628e633-34a4-43e5-bd86-7515fabafbf7 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:20.632780 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628e633-34a4-43e5-bd86-7515fabafbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:20.633686 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9889b5-f94c-4411-b60c-6b75ea696869 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:20.638457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff26633-a6ae-41d2-8ac7-81ee5bc4a8f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:20.639159 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff26633-a6ae-41d2-8ac7-81ee5bc4a8f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:20.639445 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff26633-a6ae-41d2-8ac7-81ee5bc4a8f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:20.639717 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff26633-a6ae-41d2-8ac7-81ee5bc4a8f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:20.651433 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff26633-a6ae-41d2-8ac7-81ee5bc4a8f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:20.653019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff26633-a6ae-41d2-8ac7-81ee5bc4a8f0 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:20.664688 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-1628e633-34a4-43e5-bd86-7515fabafbf7 None None] MFA Rules not processed for user `f9b54ba8719e40b19c38b3cfe59a567c`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:36:20.666131 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-1628e633-34a4-43e5-bd86-7515fabafbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:20.666648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1121/2241] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:36:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:36:20.765686 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1121/2242] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:36:20 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:36:20.777720 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff26633-a6ae-41d2-8ac7-81ee5bc4a8f0 service neutron] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:20.779772 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-7ff26633-a6ae-41d2-8ac7-81ee5bc4a8f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:20.865964 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff26633-a6ae-41d2-8ac7-81ee5bc4a8f0 service neutron] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:20.873160 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d74c3-d7e1-411b-91a7-467d0e8460e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:20.873996 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d74c3-d7e1-411b-91a7-467d0e8460e9 service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:20.874433 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d74c3-d7e1-411b-91a7-467d0e8460e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:20.874866 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d74c3-d7e1-411b-91a7-467d0e8460e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:20.877007 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-ac8d74c3-d7e1-411b-91a7-467d0e8460e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:20.935733 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d74c3-d7e1-411b-91a7-467d0e8460e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:20.937232 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d74c3-d7e1-411b-91a7-467d0e8460e9 service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:20.947569 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1122/2243] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:36:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:36:20.975380 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628e633-34a4-43e5-bd86-7515fabafbf7 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:20.976861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-1628e633-34a4-43e5-bd86-7515fabafbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:20.990521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628e633-34a4-43e5-bd86-7515fabafbf7 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:20.999370 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01b671-87f2-4f37-a659-5037f2e32bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:21.000216 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01b671-87f2-4f37-a659-5037f2e32bad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:21.000504 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01b671-87f2-4f37-a659-5037f2e32bad admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:21.000810 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01b671-87f2-4f37-a659-5037f2e32bad admin admin] PATH_INFO: `/v3/projects/a450c3a8771d4f89a595aa3eca210a8f` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:21.002058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01b671-87f2-4f37-a659-5037f2e32bad admin admin] RBAC: Authorizing `identity:delete_project(project_id=a450c3a8771d4f89a595aa3eca210a8f)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:21.004678 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01b671-87f2-4f37-a659-5037f2e32bad admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:21.059237 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-1d01b671-87f2-4f37-a659-5037f2e32bad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a450c3a8771d4f89a595aa3eca210a8f', 'request_id': 'req-1d01b671-87f2-4f37-a659-5037f2e32bad'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:21.064648 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-1d01b671-87f2-4f37-a659-5037f2e32bad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a450c3a8771d4f89a595aa3eca210a8f', 'request_id': 'req-1d01b671-87f2-4f37-a659-5037f2e32bad'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:21.073654 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-1d01b671-87f2-4f37-a659-5037f2e32bad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a450c3a8771d4f89a595aa3eca210a8f', 'request_id': 'req-1d01b671-87f2-4f37-a659-5037f2e32bad'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:21.092654 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-1d01b671-87f2-4f37-a659-5037f2e32bad admin admin] The token cache is being invalidate because project a450c3a8771d4f89a595aa3eca210a8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:36:21.093083 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-1d01b671-87f2-4f37-a659-5037f2e32bad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:21.094068 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-1d01b671-87f2-4f37-a659-5037f2e32bad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:36:21.095900 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1122/2244] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:36:20 2022] DELETE /identity/v3/projects/a450c3a8771d4f89a595aa3eca210a8f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:36:23.420584 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d74c3-d7e1-411b-91a7-467d0e8460e9 service cinder] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:23.429440 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d74c3-d7e1-411b-91a7-467d0e8460e9 service cinder] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:23.490651 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13dfaa-424d-490a-9a44-6ab89a118f48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:23.491322 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13dfaa-424d-490a-9a44-6ab89a118f48 service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:23.491606 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13dfaa-424d-490a-9a44-6ab89a118f48 service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:23.491884 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13dfaa-424d-490a-9a44-6ab89a118f48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:23.494299 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-0b13dfaa-424d-490a-9a44-6ab89a118f48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:23.559727 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13dfaa-424d-490a-9a44-6ab89a118f48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:23.561223 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13dfaa-424d-490a-9a44-6ab89a118f48 service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:23.577704 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1123/2245] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:36:23 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:36:24.306423 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01b671-87f2-4f37-a659-5037f2e32bad admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:36:24.307845 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-1d01b671-87f2-4f37-a659-5037f2e32bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:24.361684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01b671-87f2-4f37-a659-5037f2e32bad admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:36:24.365828 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2f96b-8bba-43a0-8d2d-fcdffb9b386a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:36:24.366494 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2f96b-8bba-43a0-8d2d-fcdffb9b386a service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:36:24.366775 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2f96b-8bba-43a0-8d2d-fcdffb9b386a service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:36:24.367050 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2f96b-8bba-43a0-8d2d-fcdffb9b386a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:36:24.368825 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-bff2f96b-8bba-43a0-8d2d-fcdffb9b386a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:36:24.431490 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2f96b-8bba-43a0-8d2d-fcdffb9b386a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:36:24.432954 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2f96b-8bba-43a0-8d2d-fcdffb9b386a service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:36:24.443291 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1123/2246] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:36:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:37:03.947003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13dfaa-424d-490a-9a44-6ab89a118f48 service cinder] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:37:03.948541 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-0b13dfaa-424d-490a-9a44-6ab89a118f48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:37:04.012549 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13dfaa-424d-490a-9a44-6ab89a118f48 service cinder] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:37:04.017103 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d51acd-71ae-4ea3-a608-af94ebcc4e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:37:04.018605 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d51acd-71ae-4ea3-a608-af94ebcc4e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:04.018885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d51acd-71ae-4ea3-a608-af94ebcc4e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:04.019157 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d51acd-71ae-4ea3-a608-af94ebcc4e8d admin admin] PATH_INFO: `/v3/users/dc004fb0067f4153b245bd55116ba220` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:04.020349 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d51acd-71ae-4ea3-a608-af94ebcc4e8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc004fb0067f4153b245bd55116ba220)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:37:04.022293 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d51acd-71ae-4ea3-a608-af94ebcc4e8d admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:37:04.067716 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d2d51acd-71ae-4ea3-a608-af94ebcc4e8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc004fb0067f4153b245bd55116ba220'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:04.079506 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d2d51acd-71ae-4ea3-a608-af94ebcc4e8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc004fb0067f4153b245bd55116ba220'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:04.080189 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d2d51acd-71ae-4ea3-a608-af94ebcc4e8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc004fb0067f4153b245bd55116ba220'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:04.092551 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d2d51acd-71ae-4ea3-a608-af94ebcc4e8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc004fb0067f4153b245bd55116ba220'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:04.100976 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d2d51acd-71ae-4ea3-a608-af94ebcc4e8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc004fb0067f4153b245bd55116ba220'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:04.108054 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1124/2247] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:37:03 2022] DELETE /identity/v3/users/dc004fb0067f4153b245bd55116ba220 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:37:04.274170 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2f96b-8bba-43a0-8d2d-fcdffb9b386a service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:37:04.285023 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2f96b-8bba-43a0-8d2d-fcdffb9b386a service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:37:04.347497 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5aa275-eb65-4d93-812d-53930b90857e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:37:04.348368 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5aa275-eb65-4d93-812d-53930b90857e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:04.348649 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5aa275-eb65-4d93-812d-53930b90857e admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:04.348924 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5aa275-eb65-4d93-812d-53930b90857e admin admin] PATH_INFO: `/v3/projects/0bb92cff36154d90bb549f9cef1a7749` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:04.350254 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5aa275-eb65-4d93-812d-53930b90857e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bb92cff36154d90bb549f9cef1a7749)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:37:04.352225 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5aa275-eb65-4d93-812d-53930b90857e admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:37:04.405308 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-8d5aa275-eb65-4d93-812d-53930b90857e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bb92cff36154d90bb549f9cef1a7749', 'request_id': 'req-8d5aa275-eb65-4d93-812d-53930b90857e'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:04.411551 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-8d5aa275-eb65-4d93-812d-53930b90857e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bb92cff36154d90bb549f9cef1a7749', 'request_id': 'req-8d5aa275-eb65-4d93-812d-53930b90857e'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:04.422185 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-8d5aa275-eb65-4d93-812d-53930b90857e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bb92cff36154d90bb549f9cef1a7749', 'request_id': 'req-8d5aa275-eb65-4d93-812d-53930b90857e'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:04.433879 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-8d5aa275-eb65-4d93-812d-53930b90857e admin admin] The token cache is being invalidate because project 0bb92cff36154d90bb549f9cef1a7749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:37:04.434250 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-8d5aa275-eb65-4d93-812d-53930b90857e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:04.434900 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-8d5aa275-eb65-4d93-812d-53930b90857e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:04.436429 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1124/2248] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:37:04 2022] DELETE /identity/v3/projects/0bb92cff36154d90bb549f9cef1a7749 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:37:04.440543 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d51acd-71ae-4ea3-a608-af94ebcc4e8d admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:37:04.441992 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-d2d51acd-71ae-4ea3-a608-af94ebcc4e8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:37:04.454677 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d51acd-71ae-4ea3-a608-af94ebcc4e8d admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:37:04.509594 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1947e0-a280-4c7f-968d-cb540262fae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:37:04.510485 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1947e0-a280-4c7f-968d-cb540262fae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:04.510760 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1947e0-a280-4c7f-968d-cb540262fae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:04.511030 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1947e0-a280-4c7f-968d-cb540262fae4 admin admin] PATH_INFO: `/v3/users/f9b54ba8719e40b19c38b3cfe59a567c` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:04.512204 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1947e0-a280-4c7f-968d-cb540262fae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9b54ba8719e40b19c38b3cfe59a567c)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:37:04.514147 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1947e0-a280-4c7f-968d-cb540262fae4 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:37:04.560503 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-3e1947e0-a280-4c7f-968d-cb540262fae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9b54ba8719e40b19c38b3cfe59a567c'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:04.572450 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-3e1947e0-a280-4c7f-968d-cb540262fae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9b54ba8719e40b19c38b3cfe59a567c'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:04.573240 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-3e1947e0-a280-4c7f-968d-cb540262fae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9b54ba8719e40b19c38b3cfe59a567c'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:04.581616 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-3e1947e0-a280-4c7f-968d-cb540262fae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9b54ba8719e40b19c38b3cfe59a567c'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:04.588315 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-3e1947e0-a280-4c7f-968d-cb540262fae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9b54ba8719e40b19c38b3cfe59a567c'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:04.594312 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1125/2249] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:37:04 2022] DELETE /identity/v3/users/f9b54ba8719e40b19c38b3cfe59a567c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:37:04.762063 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5aa275-eb65-4d93-812d-53930b90857e admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:37:04.763526 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-8d5aa275-eb65-4d93-812d-53930b90857e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:37:04.776846 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5aa275-eb65-4d93-812d-53930b90857e admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:37:04.831345 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cbfc45-3cda-4a22-aa52-2ed0aae83022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:37:04.832197 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbfc45-3cda-4a22-aa52-2ed0aae83022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:04.832476 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbfc45-3cda-4a22-aa52-2ed0aae83022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:04.832747 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbfc45-3cda-4a22-aa52-2ed0aae83022 admin admin] PATH_INFO: `/v3/projects/1d3842ca641440ad9f1a616a5a4d44bb` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:04.833925 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cbfc45-3cda-4a22-aa52-2ed0aae83022 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d3842ca641440ad9f1a616a5a4d44bb)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:37:04.835842 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cbfc45-3cda-4a22-aa52-2ed0aae83022 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:37:04.879146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-d9cbfc45-3cda-4a22-aa52-2ed0aae83022 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d3842ca641440ad9f1a616a5a4d44bb', 'request_id': 'req-d9cbfc45-3cda-4a22-aa52-2ed0aae83022'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:04.885299 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-d9cbfc45-3cda-4a22-aa52-2ed0aae83022 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d3842ca641440ad9f1a616a5a4d44bb', 'request_id': 'req-d9cbfc45-3cda-4a22-aa52-2ed0aae83022'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:04.892619 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-d9cbfc45-3cda-4a22-aa52-2ed0aae83022 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d3842ca641440ad9f1a616a5a4d44bb', 'request_id': 'req-d9cbfc45-3cda-4a22-aa52-2ed0aae83022'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:04.905539 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-d9cbfc45-3cda-4a22-aa52-2ed0aae83022 admin admin] The token cache is being invalidate because project 1d3842ca641440ad9f1a616a5a4d44bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:37:04.905821 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-d9cbfc45-3cda-4a22-aa52-2ed0aae83022 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:04.906512 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-d9cbfc45-3cda-4a22-aa52-2ed0aae83022 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:04.908073 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1125/2250] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:37:04 2022] DELETE /identity/v3/projects/1d3842ca641440ad9f1a616a5a4d44bb => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:37:04.912925 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c741ac5-a04c-4da3-80e3-dcb3031ef0ab None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:04.913213 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c741ac5-a04c-4da3-80e3-dcb3031ef0ab None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:04.913488 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c741ac5-a04c-4da3-80e3-dcb3031ef0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:04.930542 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-5c741ac5-a04c-4da3-80e3-dcb3031ef0ab None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:37:04.931725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-5c741ac5-a04c-4da3-80e3-dcb3031ef0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:37:04.988997 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1126/2251] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:37:05.052054 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be437f-6c59-48ad-bb4f-efb051278b53 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:05.052264 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be437f-6c59-48ad-bb4f-efb051278b53 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:05.052511 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be437f-6c59-48ad-bb4f-efb051278b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:05.070829 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-18be437f-6c59-48ad-bb4f-efb051278b53 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:37:05.071993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-18be437f-6c59-48ad-bb4f-efb051278b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:37:05.079688 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1126/2252] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:37:05.083767 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c741ac5-a04c-4da3-80e3-dcb3031ef0ab None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:37:05.093159 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c741ac5-a04c-4da3-80e3-dcb3031ef0ab None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:37:05.097796 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c967b-23ae-4b75-b488-fccd9397f1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:37:05.098487 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c967b-23ae-4b75-b488-fccd9397f1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:05.098768 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c967b-23ae-4b75-b488-fccd9397f1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:05.099038 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c967b-23ae-4b75-b488-fccd9397f1c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:05.099758 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c967b-23ae-4b75-b488-fccd9397f1c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:37:05.100152 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c967b-23ae-4b75-b488-fccd9397f1c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:37:05.101732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c967b-23ae-4b75-b488-fccd9397f1c2 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:37:05.113963 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1127/2253] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:37:05.118115 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be437f-6c59-48ad-bb4f-efb051278b53 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:37:05.127029 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be437f-6c59-48ad-bb4f-efb051278b53 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:37:05.132237 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdabd1a-c3e1-49b3-b862-71b4ca733e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:37:05.132877 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdabd1a-c3e1-49b3-b862-71b4ca733e53 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:05.133154 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdabd1a-c3e1-49b3-b862-71b4ca733e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:05.133422 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdabd1a-c3e1-49b3-b862-71b4ca733e53 admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:05.134400 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdabd1a-c3e1-49b3-b862-71b4ca733e53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:37:05.136260 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdabd1a-c3e1-49b3-b862-71b4ca733e53 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:37:05.160215 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1127/2254] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:37:05 2022] POST /identity/v3/projects => generated 365 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:37:05.164104 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c967b-23ae-4b75-b488-fccd9397f1c2 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:37:05.174519 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c967b-23ae-4b75-b488-fccd9397f1c2 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:37:05.227338 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e69dcc-35aa-4727-a9f5-f5dc24bd0dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:37:05.227991 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e69dcc-35aa-4727-a9f5-f5dc24bd0dd2 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:05.228270 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e69dcc-35aa-4727-a9f5-f5dc24bd0dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:05.228541 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e69dcc-35aa-4727-a9f5-f5dc24bd0dd2 admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:05.229229 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e69dcc-35aa-4727-a9f5-f5dc24bd0dd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:37:05.231162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e69dcc-35aa-4727-a9f5-f5dc24bd0dd2 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:37:05.251166 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1128/2255] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:37:05 2022] POST /identity/v3/users => generated 283 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:37:05.255731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdabd1a-c3e1-49b3-b862-71b4ca733e53 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:37:05.265735 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdabd1a-c3e1-49b3-b862-71b4ca733e53 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:37:05.270361 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b5ee8-d436-46b3-8343-b82c885f0de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:37:05.271010 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b5ee8-d436-46b3-8343-b82c885f0de9 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:05.271286 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b5ee8-d436-46b3-8343-b82c885f0de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:05.271550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b5ee8-d436-46b3-8343-b82c885f0de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:05.272264 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b5ee8-d436-46b3-8343-b82c885f0de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:37:05.273833 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b5ee8-d436-46b3-8343-b82c885f0de9 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:37:05.284313 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1128/2256] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:37:05.288113 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e69dcc-35aa-4727-a9f5-f5dc24bd0dd2 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:37:05.297842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e69dcc-35aa-4727-a9f5-f5dc24bd0dd2 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:37:05.303123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28cc465-306e-4171-a912-8760482023c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:37:05.303709 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cc465-306e-4171-a912-8760482023c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:05.303994 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cc465-306e-4171-a912-8760482023c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:05.304272 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cc465-306e-4171-a912-8760482023c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:05.304996 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28cc465-306e-4171-a912-8760482023c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:37:05.306647 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28cc465-306e-4171-a912-8760482023c2 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:37:05.316860 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1129/2257] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:37:05.325938 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b5ee8-d436-46b3-8343-b82c885f0de9 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:37:05.336353 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b5ee8-d436-46b3-8343-b82c885f0de9 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:37:05.340922 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6d4fa-cb5b-42e8-aa73-36b501f61e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:37:05.341794 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6d4fa-cb5b-42e8-aa73-36b501f61e4e admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:05.342105 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6d4fa-cb5b-42e8-aa73-36b501f61e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:05.342383 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6d4fa-cb5b-42e8-aa73-36b501f61e4e admin admin] PATH_INFO: `/v3/projects/4be145132c0945e7a97bd81ef598ff63/users/16aa37b42ac74e37a6e743152aaf20cd/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:05.356862 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6d4fa-cb5b-42e8-aa73-36b501f61e4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4be145132c0945e7a97bd81ef598ff63, user_id=16aa37b42ac74e37a6e743152aaf20cd, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:37:05.359523 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6d4fa-cb5b-42e8-aa73-36b501f61e4e admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:37:05.372178 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1129/2258] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:37:05 2022] PUT /identity/v3/projects/4be145132c0945e7a97bd81ef598ff63/users/16aa37b42ac74e37a6e743152aaf20cd/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:37:05.383267 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fa7aa-a968-41b0-8d31-23d79e88da54 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:05.383559 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fa7aa-a968-41b0-8d31-23d79e88da54 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:05.383840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fa7aa-a968-41b0-8d31-23d79e88da54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:05.410737 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-ea0fa7aa-a968-41b0-8d31-23d79e88da54 None None] MFA Rules not processed for user `16aa37b42ac74e37a6e743152aaf20cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:37:05.411931 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-ea0fa7aa-a968-41b0-8d31-23d79e88da54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:37:05.481820 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1130/2259] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:37:05 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:37:05.492792 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6d4fa-cb5b-42e8-aa73-36b501f61e4e admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:37:05.494496 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-88e6d4fa-cb5b-42e8-aa73-36b501f61e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:37:05.569918 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6d4fa-cb5b-42e8-aa73-36b501f61e4e admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:37:05.573458 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d360cdc-ebe8-4de5-a447-6dddd69c6eec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:37:05.574132 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d360cdc-ebe8-4de5-a447-6dddd69c6eec service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:05.574411 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d360cdc-ebe8-4de5-a447-6dddd69c6eec service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:05.574678 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d360cdc-ebe8-4de5-a447-6dddd69c6eec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:05.583372 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d360cdc-ebe8-4de5-a447-6dddd69c6eec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:37:05.584780 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d360cdc-ebe8-4de5-a447-6dddd69c6eec service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:37:05.593227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1130/2260] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:37:05 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:37:13.921171 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fa7aa-a968-41b0-8d31-23d79e88da54 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:37:13.922640 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-ea0fa7aa-a968-41b0-8d31-23d79e88da54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:37:14.020167 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fa7aa-a968-41b0-8d31-23d79e88da54 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:37:14.026465 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a93136-6cff-4944-8951-ee967ab7e9fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525f4699878f461e82f7f06ef60c176a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:37:14.027122 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a93136-6cff-4944-8951-ee967ab7e9fe service placement] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:14.027407 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a93136-6cff-4944-8951-ee967ab7e9fe service placement] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:14.027684 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a93136-6cff-4944-8951-ee967ab7e9fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:14.029496 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-d1a93136-6cff-4944-8951-ee967ab7e9fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:37:14.042223 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a93136-6cff-4944-8951-ee967ab7e9fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:37:14.043832 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a93136-6cff-4944-8951-ee967ab7e9fe service placement] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:37:14.058092 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1131/2261] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:37:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:37:14.227684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d360cdc-ebe8-4de5-a447-6dddd69c6eec service cinder] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:37:14.229313 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-2d360cdc-ebe8-4de5-a447-6dddd69c6eec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:37:14.301345 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d360cdc-ebe8-4de5-a447-6dddd69c6eec service cinder] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:37:14.314623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d711c0-37ab-4ce8-9bbe-7842e430de53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:37:14.316098 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d711c0-37ab-4ce8-9bbe-7842e430de53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:14.316390 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d711c0-37ab-4ce8-9bbe-7842e430de53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:14.316669 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d711c0-37ab-4ce8-9bbe-7842e430de53 admin admin] PATH_INFO: `/v3/users/f84b8cee00dd479f8064e3660674bb3a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:14.317927 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d711c0-37ab-4ce8-9bbe-7842e430de53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f84b8cee00dd479f8064e3660674bb3a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:37:14.319988 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d711c0-37ab-4ce8-9bbe-7842e430de53 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:37:14.368745 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-07d711c0-37ab-4ce8-9bbe-7842e430de53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f84b8cee00dd479f8064e3660674bb3a'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:14.381643 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-07d711c0-37ab-4ce8-9bbe-7842e430de53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f84b8cee00dd479f8064e3660674bb3a'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:14.382405 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-07d711c0-37ab-4ce8-9bbe-7842e430de53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f84b8cee00dd479f8064e3660674bb3a'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:14.390975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-07d711c0-37ab-4ce8-9bbe-7842e430de53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f84b8cee00dd479f8064e3660674bb3a'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:14.398841 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-07d711c0-37ab-4ce8-9bbe-7842e430de53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f84b8cee00dd479f8064e3660674bb3a'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:14.405885 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1131/2262] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:37:14 2022] DELETE /identity/v3/users/f84b8cee00dd479f8064e3660674bb3a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:37:14.411676 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403b3e0-0b68-46ab-aea7-fd7067cadcaa None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:14.412232 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403b3e0-0b68-46ab-aea7-fd7067cadcaa None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:14.412745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403b3e0-0b68-46ab-aea7-fd7067cadcaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:14.432087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-2403b3e0-0b68-46ab-aea7-fd7067cadcaa None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:37:14.433375 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-2403b3e0-0b68-46ab-aea7-fd7067cadcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:37:14.496690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1132/2263] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:37:14.506672 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d711c0-37ab-4ce8-9bbe-7842e430de53 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:37:14.508786 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-07d711c0-37ab-4ce8-9bbe-7842e430de53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:37:14.577150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d711c0-37ab-4ce8-9bbe-7842e430de53 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:37:14.581423 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d651aa3-9337-4782-9eba-3678cbf4511c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:37:14.582386 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d651aa3-9337-4782-9eba-3678cbf4511c service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:14.582778 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d651aa3-9337-4782-9eba-3678cbf4511c service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:14.583007 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d651aa3-9337-4782-9eba-3678cbf4511c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:14.595710 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d651aa3-9337-4782-9eba-3678cbf4511c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:37:14.597585 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d651aa3-9337-4782-9eba-3678cbf4511c service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:37:14.615466 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1132/2264] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:37:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:37:15.010284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2403b3e0-0b68-46ab-aea7-fd7067cadcaa None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:37:15.011758 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-2403b3e0-0b68-46ab-aea7-fd7067cadcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:37:15.023231 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2403b3e0-0b68-46ab-aea7-fd7067cadcaa None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:37:15.030612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba68f79-7994-4228-851c-1810b120e4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:37:15.032020 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba68f79-7994-4228-851c-1810b120e4f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:15.032538 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba68f79-7994-4228-851c-1810b120e4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:15.033145 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba68f79-7994-4228-851c-1810b120e4f2 admin admin] PATH_INFO: `/v3/projects/a71eb1c5e3af4eb98f84ec1c65f29cfe` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:15.035532 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba68f79-7994-4228-851c-1810b120e4f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a71eb1c5e3af4eb98f84ec1c65f29cfe)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:37:15.037928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba68f79-7994-4228-851c-1810b120e4f2 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:37:15.086087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-0ba68f79-7994-4228-851c-1810b120e4f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a71eb1c5e3af4eb98f84ec1c65f29cfe', 'request_id': 'req-0ba68f79-7994-4228-851c-1810b120e4f2'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:15.091607 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-0ba68f79-7994-4228-851c-1810b120e4f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a71eb1c5e3af4eb98f84ec1c65f29cfe', 'request_id': 'req-0ba68f79-7994-4228-851c-1810b120e4f2'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:15.099988 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-0ba68f79-7994-4228-851c-1810b120e4f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a71eb1c5e3af4eb98f84ec1c65f29cfe', 'request_id': 'req-0ba68f79-7994-4228-851c-1810b120e4f2'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:15.112237 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-0ba68f79-7994-4228-851c-1810b120e4f2 admin admin] The token cache is being invalidate because project a71eb1c5e3af4eb98f84ec1c65f29cfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:37:15.112524 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-0ba68f79-7994-4228-851c-1810b120e4f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:15.113171 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-0ba68f79-7994-4228-851c-1810b120e4f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:15.114784 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1133/2265] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:37:15 2022] DELETE /identity/v3/projects/a71eb1c5e3af4eb98f84ec1c65f29cfe => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:37:15.119717 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eacdca-c6a8-412e-ac91-fe6f8cedc614 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:15.120487 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eacdca-c6a8-412e-ac91-fe6f8cedc614 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:15.120771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eacdca-c6a8-412e-ac91-fe6f8cedc614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:15.139327 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-39eacdca-c6a8-412e-ac91-fe6f8cedc614 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:37:15.140541 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-39eacdca-c6a8-412e-ac91-fe6f8cedc614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:37:15.202105 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1133/2266] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:37:15.211045 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9cdcf-755e-4c0d-a907-33021ada5ce3 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:15.211367 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9cdcf-755e-4c0d-a907-33021ada5ce3 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:15.211629 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9cdcf-755e-4c0d-a907-33021ada5ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:15.230653 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-37e9cdcf-755e-4c0d-a907-33021ada5ce3 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:37:15.231847 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-37e9cdcf-755e-4c0d-a907-33021ada5ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:37:15.239712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1134/2267] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:37:15.243941 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eacdca-c6a8-412e-ac91-fe6f8cedc614 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:37:15.253627 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eacdca-c6a8-412e-ac91-fe6f8cedc614 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:37:15.258428 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04342761-f347-4ed3-b343-d4d76535ea31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:37:15.259348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04342761-f347-4ed3-b343-d4d76535ea31 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:15.259631 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04342761-f347-4ed3-b343-d4d76535ea31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:15.259907 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04342761-f347-4ed3-b343-d4d76535ea31 admin admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:15.260667 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04342761-f347-4ed3-b343-d4d76535ea31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:37:15.260975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04342761-f347-4ed3-b343-d4d76535ea31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:37:15.262616 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04342761-f347-4ed3-b343-d4d76535ea31 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:37:15.275804 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1134/2268] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:37:15.280192 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9cdcf-755e-4c0d-a907-33021ada5ce3 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:37:15.289838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9cdcf-755e-4c0d-a907-33021ada5ce3 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:37:15.294863 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcd86f-7507-4b88-a328-2e86b3e46869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:37:15.296117 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcd86f-7507-4b88-a328-2e86b3e46869 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:15.296401 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcd86f-7507-4b88-a328-2e86b3e46869 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:15.296675 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcd86f-7507-4b88-a328-2e86b3e46869 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:15.297401 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dcd86f-7507-4b88-a328-2e86b3e46869 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:37:15.299563 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dcd86f-7507-4b88-a328-2e86b3e46869 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:37:15.333281 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1135/2269] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:37:15 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:37:15.334460 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04342761-f347-4ed3-b343-d4d76535ea31 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:37:15.345214 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04342761-f347-4ed3-b343-d4d76535ea31 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:37:15.400304 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605dacf-8f1e-46fa-b8ef-1e2201dd5eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:37:15.401280 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605dacf-8f1e-46fa-b8ef-1e2201dd5eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:15.401564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605dacf-8f1e-46fa-b8ef-1e2201dd5eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:15.401840 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605dacf-8f1e-46fa-b8ef-1e2201dd5eb9 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:15.402572 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605dacf-8f1e-46fa-b8ef-1e2201dd5eb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:37:15.404481 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605dacf-8f1e-46fa-b8ef-1e2201dd5eb9 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:37:15.425171 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1135/2270] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:37:15 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:37:15.429241 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcd86f-7507-4b88-a328-2e86b3e46869 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:37:15.439651 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcd86f-7507-4b88-a328-2e86b3e46869 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:37:15.444283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b0d3b-3f05-495e-bf60-06738ce5e0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:37:15.444943 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b0d3b-3f05-495e-bf60-06738ce5e0fa admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:15.445222 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b0d3b-3f05-495e-bf60-06738ce5e0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:15.445500 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b0d3b-3f05-495e-bf60-06738ce5e0fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:15.446298 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b0d3b-3f05-495e-bf60-06738ce5e0fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:37:15.447906 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b0d3b-3f05-495e-bf60-06738ce5e0fa admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:37:15.459323 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1136/2271] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 09:37:15.462911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605dacf-8f1e-46fa-b8ef-1e2201dd5eb9 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:37:15.473601 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605dacf-8f1e-46fa-b8ef-1e2201dd5eb9 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:37:15.478720 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b4eda-5ddc-4335-ba71-ff95b5946f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:37:15.479384 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b4eda-5ddc-4335-ba71-ff95b5946f43 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:15.479670 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b4eda-5ddc-4335-ba71-ff95b5946f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:15.479945 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b4eda-5ddc-4335-ba71-ff95b5946f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:15.480679 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b4eda-5ddc-4335-ba71-ff95b5946f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:37:15.482298 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b4eda-5ddc-4335-ba71-ff95b5946f43 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:37:15.495808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1136/2272] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:37:15.497009 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b0d3b-3f05-495e-bf60-06738ce5e0fa admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:37:15.514379 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b0d3b-3f05-495e-bf60-06738ce5e0fa admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:37:15.520351 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c254540-eff8-4e86-a641-787313d0943c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:37:15.521515 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c254540-eff8-4e86-a641-787313d0943c admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:15.521950 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c254540-eff8-4e86-a641-787313d0943c admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:15.522236 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c254540-eff8-4e86-a641-787313d0943c admin admin] PATH_INFO: `/v3/projects/82537535f26a4f2094d83c7decfc414c/users/b779f718c909419b9e61fdd15c0536ed/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:15.533022 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f398a-3a37-4d86-a2e2-701ba0d63729 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:15.533310 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f398a-3a37-4d86-a2e2-701ba0d63729 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:15.533892 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f398a-3a37-4d86-a2e2-701ba0d63729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:15.546653 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c254540-eff8-4e86-a641-787313d0943c admin admin] RBAC: Authorizing `identity:create_grant(project_id=82537535f26a4f2094d83c7decfc414c, user_id=b779f718c909419b9e61fdd15c0536ed, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:37:15.549547 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c254540-eff8-4e86-a641-787313d0943c admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:37:15.552035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-4b5f398a-3a37-4d86-a2e2-701ba0d63729 None None] MFA Rules not processed for user `0b01be56426e4ff1a09577f30fb79f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:37:15.553356 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-4b5f398a-3a37-4d86-a2e2-701ba0d63729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:37:15.567022 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1137/2273] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:37:15 2022] PUT /identity/v3/projects/82537535f26a4f2094d83c7decfc414c/users/b779f718c909419b9e61fdd15c0536ed/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:37:15.577107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8411f50-5cd6-4123-bf66-857290864ed3 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:15.577476 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8411f50-5cd6-4123-bf66-857290864ed3 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:15.577719 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8411f50-5cd6-4123-bf66-857290864ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:15.607409 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-a8411f50-5cd6-4123-bf66-857290864ed3 None None] MFA Rules not processed for user `b779f718c909419b9e61fdd15c0536ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:37:15.608620 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-a8411f50-5cd6-4123-bf66-857290864ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:37:15.620143 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1137/2274] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:37:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:37:15.683054 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1138/2275] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:37:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:37:15.695546 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f398a-3a37-4d86-a2e2-701ba0d63729 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:37:15.696984 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-4b5f398a-3a37-4d86-a2e2-701ba0d63729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:37:15.769778 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f398a-3a37-4d86-a2e2-701ba0d63729 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:37:15.817495 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92a88d-46bd-432e-878c-a469c07184b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:37:15.818447 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92a88d-46bd-432e-878c-a469c07184b4 service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:15.818724 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92a88d-46bd-432e-878c-a469c07184b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:15.819003 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92a88d-46bd-432e-878c-a469c07184b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:15.827473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92a88d-46bd-432e-878c-a469c07184b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:37:15.828885 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92a88d-46bd-432e-878c-a469c07184b4 service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:37:15.838169 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1138/2276] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:37:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:37:42.801318 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e65d3a-0027-45b7-a344-0ed0ca5da0f4 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:42.801838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e65d3a-0027-45b7-a344-0ed0ca5da0f4 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:42.801965 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e65d3a-0027-45b7-a344-0ed0ca5da0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:42.819485 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-a9e65d3a-0027-45b7-a344-0ed0ca5da0f4 None None] MFA Rules not processed for user `7dd6d3e1b6ea49d4a75e5f7e105ea0f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:37:42.820668 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-a9e65d3a-0027-45b7-a344-0ed0ca5da0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:37:42.872797 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1139/2277] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:37:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:37:44.835992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92a88d-46bd-432e-878c-a469c07184b4 service cinder] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:37:44.895303 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92a88d-46bd-432e-878c-a469c07184b4 service cinder] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:37:44.899807 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b78606-a5da-4d51-b491-cf8131acf037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:37:44.900672 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b78606-a5da-4d51-b491-cf8131acf037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:44.900949 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b78606-a5da-4d51-b491-cf8131acf037 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:44.901219 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b78606-a5da-4d51-b491-cf8131acf037 admin admin] PATH_INFO: `/v3/users/b779f718c909419b9e61fdd15c0536ed` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:44.902421 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b78606-a5da-4d51-b491-cf8131acf037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b779f718c909419b9e61fdd15c0536ed)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:37:44.904311 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b78606-a5da-4d51-b491-cf8131acf037 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:37:44.950544 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-39b78606-a5da-4d51-b491-cf8131acf037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b779f718c909419b9e61fdd15c0536ed'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:44.961858 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-39b78606-a5da-4d51-b491-cf8131acf037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b779f718c909419b9e61fdd15c0536ed'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:44.962606 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-39b78606-a5da-4d51-b491-cf8131acf037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b779f718c909419b9e61fdd15c0536ed'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:44.970873 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-39b78606-a5da-4d51-b491-cf8131acf037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b779f718c909419b9e61fdd15c0536ed'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:44.986727 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-39b78606-a5da-4d51-b491-cf8131acf037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b779f718c909419b9e61fdd15c0536ed'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:44.992789 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1139/2278] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:37:44 2022] DELETE /identity/v3/users/b779f718c909419b9e61fdd15c0536ed => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:37:44.997397 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e28eab-57ed-4350-b527-111c61cb0694 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:44.997936 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e28eab-57ed-4350-b527-111c61cb0694 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:44.998052 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e28eab-57ed-4350-b527-111c61cb0694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:45.015346 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-96e28eab-57ed-4350-b527-111c61cb0694 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:37:45.016449 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-96e28eab-57ed-4350-b527-111c61cb0694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:37:45.079266 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1140/2279] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:37:45.088942 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b78606-a5da-4d51-b491-cf8131acf037 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:37:45.090377 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-39b78606-a5da-4d51-b491-cf8131acf037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:37:45.150143 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b78606-a5da-4d51-b491-cf8131acf037 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:37:45.153810 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84928154-7e54-46e2-8cb5-fb8026892adf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:37:45.154500 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84928154-7e54-46e2-8cb5-fb8026892adf service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:45.154781 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84928154-7e54-46e2-8cb5-fb8026892adf service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:45.155056 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84928154-7e54-46e2-8cb5-fb8026892adf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:45.164745 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84928154-7e54-46e2-8cb5-fb8026892adf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:37:45.166183 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84928154-7e54-46e2-8cb5-fb8026892adf service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:37:45.175427 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1140/2280] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:37:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:37:45.441333 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e28eab-57ed-4350-b527-111c61cb0694 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:37:45.442930 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-96e28eab-57ed-4350-b527-111c61cb0694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:37:45.456760 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e28eab-57ed-4350-b527-111c61cb0694 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:37:45.461599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb44d41-8835-4258-91b9-f0b2a78ba58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:37:45.462622 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb44d41-8835-4258-91b9-f0b2a78ba58b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:45.462971 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb44d41-8835-4258-91b9-f0b2a78ba58b admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:45.463160 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb44d41-8835-4258-91b9-f0b2a78ba58b admin admin] PATH_INFO: `/v3/projects/82537535f26a4f2094d83c7decfc414c` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:45.464357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb44d41-8835-4258-91b9-f0b2a78ba58b admin admin] RBAC: Authorizing `identity:delete_project(project_id=82537535f26a4f2094d83c7decfc414c)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:37:45.466334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb44d41-8835-4258-91b9-f0b2a78ba58b admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:37:45.512129 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4fb44d41-8835-4258-91b9-f0b2a78ba58b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82537535f26a4f2094d83c7decfc414c', 'request_id': 'req-4fb44d41-8835-4258-91b9-f0b2a78ba58b'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:45.518058 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4fb44d41-8835-4258-91b9-f0b2a78ba58b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82537535f26a4f2094d83c7decfc414c', 'request_id': 'req-4fb44d41-8835-4258-91b9-f0b2a78ba58b'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:45.525165 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4fb44d41-8835-4258-91b9-f0b2a78ba58b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82537535f26a4f2094d83c7decfc414c', 'request_id': 'req-4fb44d41-8835-4258-91b9-f0b2a78ba58b'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:45.536028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4fb44d41-8835-4258-91b9-f0b2a78ba58b admin admin] The token cache is being invalidate because project 82537535f26a4f2094d83c7decfc414c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:37:45.536314 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4fb44d41-8835-4258-91b9-f0b2a78ba58b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:45.536947 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4fb44d41-8835-4258-91b9-f0b2a78ba58b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:37:45.539156 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1141/2281] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:37:45 2022] DELETE /identity/v3/projects/82537535f26a4f2094d83c7decfc414c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:37:45.543675 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152fb56-f4ae-4280-a4e6-1105e423644d None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:45.543968 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152fb56-f4ae-4280-a4e6-1105e423644d None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:45.544247 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152fb56-f4ae-4280-a4e6-1105e423644d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:45.562402 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-8152fb56-f4ae-4280-a4e6-1105e423644d None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:37:45.563663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-8152fb56-f4ae-4280-a4e6-1105e423644d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:37:45.624255 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1141/2282] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:37:45.632802 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a5918-7dcb-4c53-9956-fba28f68cb9c None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:45.633091 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a5918-7dcb-4c53-9956-fba28f68cb9c None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:45.633370 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a5918-7dcb-4c53-9956-fba28f68cb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:45.652987 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-243a5918-7dcb-4c53-9956-fba28f68cb9c None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:37:45.654238 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-243a5918-7dcb-4c53-9956-fba28f68cb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:37:45.662115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1142/2283] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:37:45.666444 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152fb56-f4ae-4280-a4e6-1105e423644d None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:37:45.675883 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152fb56-f4ae-4280-a4e6-1105e423644d None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:37:45.680418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5aa15a-7a5b-410f-a730-ab364ca34bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:37:45.681064 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5aa15a-7a5b-410f-a730-ab364ca34bcd admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:45.681367 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5aa15a-7a5b-410f-a730-ab364ca34bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:45.681619 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5aa15a-7a5b-410f-a730-ab364ca34bcd admin admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:45.682370 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5aa15a-7a5b-410f-a730-ab364ca34bcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:37:45.682675 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5aa15a-7a5b-410f-a730-ab364ca34bcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:37:45.684266 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5aa15a-7a5b-410f-a730-ab364ca34bcd admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:37:45.695698 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1142/2284] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:37:45.699758 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a5918-7dcb-4c53-9956-fba28f68cb9c None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:37:45.709411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a5918-7dcb-4c53-9956-fba28f68cb9c None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:37:45.714215 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a2105-f70a-4d6c-acb4-6f290363d14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:37:45.714882 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a2105-f70a-4d6c-acb4-6f290363d14a admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:45.715165 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a2105-f70a-4d6c-acb4-6f290363d14a admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:45.715435 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a2105-f70a-4d6c-acb4-6f290363d14a admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:45.716122 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a2105-f70a-4d6c-acb4-6f290363d14a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:37:45.718058 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a2105-f70a-4d6c-acb4-6f290363d14a admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:37:45.741826 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1143/2285] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:37:45 2022] POST /identity/v3/projects => generated 369 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:37:45.745863 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5aa15a-7a5b-410f-a730-ab364ca34bcd admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:37:45.756106 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5aa15a-7a5b-410f-a730-ab364ca34bcd admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:37:45.809670 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651f1b2-cced-48dd-9c87-2cdce3d1759c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:37:45.810289 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651f1b2-cced-48dd-9c87-2cdce3d1759c admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:45.810576 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651f1b2-cced-48dd-9c87-2cdce3d1759c admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:45.810850 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651f1b2-cced-48dd-9c87-2cdce3d1759c admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:45.811541 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651f1b2-cced-48dd-9c87-2cdce3d1759c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:37:45.813439 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651f1b2-cced-48dd-9c87-2cdce3d1759c admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:37:45.833725 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1143/2286] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:37:45 2022] POST /identity/v3/users => generated 285 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:37:45.837826 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a2105-f70a-4d6c-acb4-6f290363d14a admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:37:45.848168 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a2105-f70a-4d6c-acb4-6f290363d14a admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:37:45.852764 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f8bd4-3278-4591-a50e-edcb47392b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:37:45.853444 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f8bd4-3278-4591-a50e-edcb47392b02 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:45.853726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f8bd4-3278-4591-a50e-edcb47392b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:45.854040 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f8bd4-3278-4591-a50e-edcb47392b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:45.854768 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f8bd4-3278-4591-a50e-edcb47392b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:37:45.856352 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f8bd4-3278-4591-a50e-edcb47392b02 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:37:45.866798 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1144/2287] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:37:45.871090 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651f1b2-cced-48dd-9c87-2cdce3d1759c admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:37:45.882053 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651f1b2-cced-48dd-9c87-2cdce3d1759c admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:37:45.886847 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ca796-0560-42c4-9dd6-d7d90162a681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:37:45.887493 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ca796-0560-42c4-9dd6-d7d90162a681 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:45.887773 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ca796-0560-42c4-9dd6-d7d90162a681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:45.888042 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ca796-0560-42c4-9dd6-d7d90162a681 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:45.888755 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ca796-0560-42c4-9dd6-d7d90162a681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:37:45.890350 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ca796-0560-42c4-9dd6-d7d90162a681 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:37:45.899824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1144/2288] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:37:45.903751 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f8bd4-3278-4591-a50e-edcb47392b02 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:37:45.913436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f8bd4-3278-4591-a50e-edcb47392b02 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:37:45.918701 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1eb633-7c14-423e-a357-ca4ea12f6fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:37:45.919577 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1eb633-7c14-423e-a357-ca4ea12f6fb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:45.919970 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1eb633-7c14-423e-a357-ca4ea12f6fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:45.920242 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1eb633-7c14-423e-a357-ca4ea12f6fb6 admin admin] PATH_INFO: `/v3/projects/babd90c62f834cbc946a064f95ecc508/users/d36cc95b543d4f8aa92bfb95f8b2050d/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:45.935455 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1eb633-7c14-423e-a357-ca4ea12f6fb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=babd90c62f834cbc946a064f95ecc508, user_id=d36cc95b543d4f8aa92bfb95f8b2050d, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:37:45.938800 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1eb633-7c14-423e-a357-ca4ea12f6fb6 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:37:45.952744 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1145/2289] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:37:45 2022] PUT /identity/v3/projects/babd90c62f834cbc946a064f95ecc508/users/d36cc95b543d4f8aa92bfb95f8b2050d/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:37:45.964618 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d1361-5f29-4935-8fbd-71205ce305bf None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:45.964823 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d1361-5f29-4935-8fbd-71205ce305bf None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:45.965011 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d1361-5f29-4935-8fbd-71205ce305bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:45.994243 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-581d1361-5f29-4935-8fbd-71205ce305bf None None] MFA Rules not processed for user `d36cc95b543d4f8aa92bfb95f8b2050d`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:37:45.995608 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-581d1361-5f29-4935-8fbd-71205ce305bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:37:46.059194 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1145/2290] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:37:45 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:37:46.070819 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1eb633-7c14-423e-a357-ca4ea12f6fb6 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:37:46.074107 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-3b1eb633-7c14-423e-a357-ca4ea12f6fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:37:46.198388 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1eb633-7c14-423e-a357-ca4ea12f6fb6 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:37:46.203728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25782ca-aee3-4614-b384-33bf75e81c1c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0981a8c6d9ac413b99aae95a6cdd3be5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:37:46.205640 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25782ca-aee3-4614-b384-33bf75e81c1c service glance] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:37:46.205978 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25782ca-aee3-4614-b384-33bf75e81c1c service glance] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:37:46.206264 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25782ca-aee3-4614-b384-33bf75e81c1c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:37:46.219744 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25782ca-aee3-4614-b384-33bf75e81c1c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:37:46.221220 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25782ca-aee3-4614-b384-33bf75e81c1c service glance] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:37:46.234059 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1146/2291] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:37:46 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:39:00.366640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d1361-5f29-4935-8fbd-71205ce305bf None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:00.368012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-581d1361-5f29-4935-8fbd-71205ce305bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:00.422709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d1361-5f29-4935-8fbd-71205ce305bf None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:00.426229 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9b4a6-0bc9-4d94-a89f-b363a4642461 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:00.426866 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9b4a6-0bc9-4d94-a89f-b363a4642461 service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:00.427163 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9b4a6-0bc9-4d94-a89f-b363a4642461 service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:00.427416 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9b4a6-0bc9-4d94-a89f-b363a4642461 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:00.429121 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-c8d9b4a6-0bc9-4d94-a89f-b363a4642461 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:00.485677 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d9b4a6-0bc9-4d94-a89f-b363a4642461 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:00.487137 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d9b4a6-0bc9-4d94-a89f-b363a4642461 service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:00.496129 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1146/2292] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:39:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:39:00.592728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25782ca-aee3-4614-b384-33bf75e81c1c service glance] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:00.603021 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25782ca-aee3-4614-b384-33bf75e81c1c service glance] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:00.606955 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a8668-7660-44e7-b086-383b885e7b21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:00.607795 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a8668-7660-44e7-b086-383b885e7b21 service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:00.608216 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a8668-7660-44e7-b086-383b885e7b21 service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:00.608707 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a8668-7660-44e7-b086-383b885e7b21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:00.611087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-e53a8668-7660-44e7-b086-383b885e7b21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:00.700996 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a8668-7660-44e7-b086-383b885e7b21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:00.702492 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a8668-7660-44e7-b086-383b885e7b21 service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:00.725466 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1147/2293] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:39:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:39:02.293677 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9b4a6-0bc9-4d94-a89f-b363a4642461 service cinder] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:02.295084 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-c8d9b4a6-0bc9-4d94-a89f-b363a4642461 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:02.355782 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9b4a6-0bc9-4d94-a89f-b363a4642461 service cinder] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:02.360203 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffa049-a4f5-40d5-982f-a4a74ce805fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:02.361575 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffa049-a4f5-40d5-982f-a4a74ce805fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:02.361851 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffa049-a4f5-40d5-982f-a4a74ce805fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:02.362151 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffa049-a4f5-40d5-982f-a4a74ce805fd admin admin] PATH_INFO: `/v3/users/16aa37b42ac74e37a6e743152aaf20cd` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:02.363308 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ffa049-a4f5-40d5-982f-a4a74ce805fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=16aa37b42ac74e37a6e743152aaf20cd)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:02.365196 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ffa049-a4f5-40d5-982f-a4a74ce805fd admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:02.408284 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-64ffa049-a4f5-40d5-982f-a4a74ce805fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16aa37b42ac74e37a6e743152aaf20cd'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:02.419395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-64ffa049-a4f5-40d5-982f-a4a74ce805fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16aa37b42ac74e37a6e743152aaf20cd'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:02.420014 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-64ffa049-a4f5-40d5-982f-a4a74ce805fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16aa37b42ac74e37a6e743152aaf20cd'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:02.427496 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-64ffa049-a4f5-40d5-982f-a4a74ce805fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16aa37b42ac74e37a6e743152aaf20cd'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:02.434339 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-64ffa049-a4f5-40d5-982f-a4a74ce805fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16aa37b42ac74e37a6e743152aaf20cd'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:02.440624 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1147/2294] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:39:02 2022] DELETE /identity/v3/users/16aa37b42ac74e37a6e743152aaf20cd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:39:02.445084 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1913ec1-3a53-41fe-9de3-be586d02aa57 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:02.445592 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1913ec1-3a53-41fe-9de3-be586d02aa57 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:02.445703 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1913ec1-3a53-41fe-9de3-be586d02aa57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:02.462254 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-d1913ec1-3a53-41fe-9de3-be586d02aa57 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:39:02.463476 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-d1913ec1-3a53-41fe-9de3-be586d02aa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:02.520087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1148/2295] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:39:02.530378 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffa049-a4f5-40d5-982f-a4a74ce805fd admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:02.531766 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-64ffa049-a4f5-40d5-982f-a4a74ce805fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:02.586159 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffa049-a4f5-40d5-982f-a4a74ce805fd admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:02.589646 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a96ef-6fe8-4639-837f-d6c4e76e601b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:02.590308 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a96ef-6fe8-4639-837f-d6c4e76e601b service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:02.590589 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a96ef-6fe8-4639-837f-d6c4e76e601b service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:02.590861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a96ef-6fe8-4639-837f-d6c4e76e601b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:02.600711 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a96ef-6fe8-4639-837f-d6c4e76e601b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:02.602161 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a96ef-6fe8-4639-837f-d6c4e76e601b service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:02.611840 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1148/2296] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:39:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:39:02.865040 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1913ec1-3a53-41fe-9de3-be586d02aa57 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:02.867098 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-d1913ec1-3a53-41fe-9de3-be586d02aa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:02.884371 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1913ec1-3a53-41fe-9de3-be586d02aa57 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:02.889053 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef13ea2-dc3d-4ef6-b784-ad835d94e337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:02.889921 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef13ea2-dc3d-4ef6-b784-ad835d94e337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:02.890218 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef13ea2-dc3d-4ef6-b784-ad835d94e337 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:02.890492 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef13ea2-dc3d-4ef6-b784-ad835d94e337 admin admin] PATH_INFO: `/v3/projects/4be145132c0945e7a97bd81ef598ff63` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:02.891670 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef13ea2-dc3d-4ef6-b784-ad835d94e337 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4be145132c0945e7a97bd81ef598ff63)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:02.894458 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef13ea2-dc3d-4ef6-b784-ad835d94e337 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:02.940829 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-bef13ea2-dc3d-4ef6-b784-ad835d94e337 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4be145132c0945e7a97bd81ef598ff63', 'request_id': 'req-bef13ea2-dc3d-4ef6-b784-ad835d94e337'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:02.945965 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-bef13ea2-dc3d-4ef6-b784-ad835d94e337 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4be145132c0945e7a97bd81ef598ff63', 'request_id': 'req-bef13ea2-dc3d-4ef6-b784-ad835d94e337'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:02.952952 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-bef13ea2-dc3d-4ef6-b784-ad835d94e337 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4be145132c0945e7a97bd81ef598ff63', 'request_id': 'req-bef13ea2-dc3d-4ef6-b784-ad835d94e337'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:02.964239 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-bef13ea2-dc3d-4ef6-b784-ad835d94e337 admin admin] The token cache is being invalidate because project 4be145132c0945e7a97bd81ef598ff63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:39:02.964575 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-bef13ea2-dc3d-4ef6-b784-ad835d94e337 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:02.965194 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-bef13ea2-dc3d-4ef6-b784-ad835d94e337 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:02.966766 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1149/2297] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:39:02 2022] DELETE /identity/v3/projects/4be145132c0945e7a97bd81ef598ff63 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:39:04.308674 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a96ef-6fe8-4639-837f-d6c4e76e601b service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:04.310239 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-526a96ef-6fe8-4639-837f-d6c4e76e601b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:04.322912 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a96ef-6fe8-4639-837f-d6c4e76e601b service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:04.377779 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b069f5-65eb-4d6e-ad3c-e8a7e8ec2948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:04.378669 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b069f5-65eb-4d6e-ad3c-e8a7e8ec2948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:04.378959 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b069f5-65eb-4d6e-ad3c-e8a7e8ec2948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:04.379236 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b069f5-65eb-4d6e-ad3c-e8a7e8ec2948 admin admin] PATH_INFO: `/v3/users/d36cc95b543d4f8aa92bfb95f8b2050d` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:04.380473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b069f5-65eb-4d6e-ad3c-e8a7e8ec2948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d36cc95b543d4f8aa92bfb95f8b2050d)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:04.382437 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b069f5-65eb-4d6e-ad3c-e8a7e8ec2948 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:04.427271 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e9b069f5-65eb-4d6e-ad3c-e8a7e8ec2948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd36cc95b543d4f8aa92bfb95f8b2050d'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:04.438317 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e9b069f5-65eb-4d6e-ad3c-e8a7e8ec2948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd36cc95b543d4f8aa92bfb95f8b2050d'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:04.438966 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e9b069f5-65eb-4d6e-ad3c-e8a7e8ec2948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd36cc95b543d4f8aa92bfb95f8b2050d'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:04.445794 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e9b069f5-65eb-4d6e-ad3c-e8a7e8ec2948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd36cc95b543d4f8aa92bfb95f8b2050d'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:04.452260 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e9b069f5-65eb-4d6e-ad3c-e8a7e8ec2948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd36cc95b543d4f8aa92bfb95f8b2050d'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:04.457945 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1149/2298] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:39:04 2022] DELETE /identity/v3/users/d36cc95b543d4f8aa92bfb95f8b2050d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:39:04.462415 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc9909-0620-4a03-b26b-b56e3c74c281 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:04.462882 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc9909-0620-4a03-b26b-b56e3c74c281 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:04.462994 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc9909-0620-4a03-b26b-b56e3c74c281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:04.480577 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-e4bc9909-0620-4a03-b26b-b56e3c74c281 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:39:04.481770 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-e4bc9909-0620-4a03-b26b-b56e3c74c281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:04.537485 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1150/2299] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:39:04.546930 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b069f5-65eb-4d6e-ad3c-e8a7e8ec2948 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:04.548873 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-e9b069f5-65eb-4d6e-ad3c-e8a7e8ec2948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:04.602401 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b069f5-65eb-4d6e-ad3c-e8a7e8ec2948 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:04.606040 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d338dc-f236-4478-85e4-77ca69efa426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:04.606694 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d338dc-f236-4478-85e4-77ca69efa426 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:04.606976 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d338dc-f236-4478-85e4-77ca69efa426 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:04.607251 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d338dc-f236-4478-85e4-77ca69efa426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:04.616498 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d338dc-f236-4478-85e4-77ca69efa426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:04.617927 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d338dc-f236-4478-85e4-77ca69efa426 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:04.627036 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1150/2300] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:39:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:39:04.889272 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc9909-0620-4a03-b26b-b56e3c74c281 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:04.890742 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-e4bc9909-0620-4a03-b26b-b56e3c74c281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:04.903701 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc9909-0620-4a03-b26b-b56e3c74c281 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:04.909468 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73626a79-e512-4e09-bd7b-589f6c6d53b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:04.910384 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73626a79-e512-4e09-bd7b-589f6c6d53b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:04.910705 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73626a79-e512-4e09-bd7b-589f6c6d53b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:04.910949 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73626a79-e512-4e09-bd7b-589f6c6d53b5 admin admin] PATH_INFO: `/v3/projects/babd90c62f834cbc946a064f95ecc508` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:04.912487 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73626a79-e512-4e09-bd7b-589f6c6d53b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=babd90c62f834cbc946a064f95ecc508)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:04.915349 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73626a79-e512-4e09-bd7b-589f6c6d53b5 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:04.964388 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-73626a79-e512-4e09-bd7b-589f6c6d53b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'babd90c62f834cbc946a064f95ecc508', 'request_id': 'req-73626a79-e512-4e09-bd7b-589f6c6d53b5'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:04.969659 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-73626a79-e512-4e09-bd7b-589f6c6d53b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'babd90c62f834cbc946a064f95ecc508', 'request_id': 'req-73626a79-e512-4e09-bd7b-589f6c6d53b5'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:04.977413 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-73626a79-e512-4e09-bd7b-589f6c6d53b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'babd90c62f834cbc946a064f95ecc508', 'request_id': 'req-73626a79-e512-4e09-bd7b-589f6c6d53b5'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:04.988125 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-73626a79-e512-4e09-bd7b-589f6c6d53b5 admin admin] The token cache is being invalidate because project babd90c62f834cbc946a064f95ecc508 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:39:04.988403 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-73626a79-e512-4e09-bd7b-589f6c6d53b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:04.989013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-73626a79-e512-4e09-bd7b-589f6c6d53b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:04.990560 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1151/2301] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:39:04 2022] DELETE /identity/v3/projects/babd90c62f834cbc946a064f95ecc508 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:39:04.995456 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0b91e-5f0c-47cc-8464-5bccb66b0cf6 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:04.995733 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0b91e-5f0c-47cc-8464-5bccb66b0cf6 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:04.996002 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0b91e-5f0c-47cc-8464-5bccb66b0cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:05.015719 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-3fc0b91e-5f0c-47cc-8464-5bccb66b0cf6 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:39:05.016972 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-3fc0b91e-5f0c-47cc-8464-5bccb66b0cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:05.073284 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1151/2302] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:39:05.081333 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8dc9e-8383-490e-8650-9a2335fabe4e None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:05.081618 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8dc9e-8383-490e-8650-9a2335fabe4e None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:05.081888 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8dc9e-8383-490e-8650-9a2335fabe4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:05.099586 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-78a8dc9e-8383-490e-8650-9a2335fabe4e None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:39:05.100725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-78a8dc9e-8383-490e-8650-9a2335fabe4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:05.108595 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1152/2303] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:39:05.112656 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0b91e-5f0c-47cc-8464-5bccb66b0cf6 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:05.122140 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0b91e-5f0c-47cc-8464-5bccb66b0cf6 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:05.127137 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173c8f9-0ed1-4de3-94c6-7650e8d313bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:05.127788 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173c8f9-0ed1-4de3-94c6-7650e8d313bf admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:05.128069 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173c8f9-0ed1-4de3-94c6-7650e8d313bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:05.128342 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173c8f9-0ed1-4de3-94c6-7650e8d313bf admin admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:05.129058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173c8f9-0ed1-4de3-94c6-7650e8d313bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:39:05.129363 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173c8f9-0ed1-4de3-94c6-7650e8d313bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:05.130996 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173c8f9-0ed1-4de3-94c6-7650e8d313bf admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:05.142827 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1152/2304] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:39:05.146809 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8dc9e-8383-490e-8650-9a2335fabe4e None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:05.155776 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8dc9e-8383-490e-8650-9a2335fabe4e None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:05.160284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac83ce0-a144-44c2-8016-b1f74101ba44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:05.160920 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac83ce0-a144-44c2-8016-b1f74101ba44 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:05.161201 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac83ce0-a144-44c2-8016-b1f74101ba44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:05.161475 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac83ce0-a144-44c2-8016-b1f74101ba44 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:05.162199 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac83ce0-a144-44c2-8016-b1f74101ba44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:05.164119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac83ce0-a144-44c2-8016-b1f74101ba44 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:05.188080 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1153/2305] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:39:05 2022] POST /identity/v3/projects => generated 373 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:39:05.192488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173c8f9-0ed1-4de3-94c6-7650e8d313bf admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:05.202212 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173c8f9-0ed1-4de3-94c6-7650e8d313bf admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:05.256948 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75edd3-5df4-4cea-8c96-bb44789837ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:05.257619 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75edd3-5df4-4cea-8c96-bb44789837ca admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:05.257920 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75edd3-5df4-4cea-8c96-bb44789837ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:05.258194 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75edd3-5df4-4cea-8c96-bb44789837ca admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:05.259181 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75edd3-5df4-4cea-8c96-bb44789837ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:05.261057 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75edd3-5df4-4cea-8c96-bb44789837ca admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:05.280540 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1153/2306] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:39:05 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:39:05.284888 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac83ce0-a144-44c2-8016-b1f74101ba44 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:05.295954 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac83ce0-a144-44c2-8016-b1f74101ba44 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:05.300542 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b9ff6-0088-40e9-904a-b9ac8517290a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:05.301190 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b9ff6-0088-40e9-904a-b9ac8517290a admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:05.301472 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b9ff6-0088-40e9-904a-b9ac8517290a admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:05.301747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b9ff6-0088-40e9-904a-b9ac8517290a admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:05.302528 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b9ff6-0088-40e9-904a-b9ac8517290a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:05.304088 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b9ff6-0088-40e9-904a-b9ac8517290a admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:05.318202 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1154/2307] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:39:05.319815 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75edd3-5df4-4cea-8c96-bb44789837ca admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:05.330391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75edd3-5df4-4cea-8c96-bb44789837ca admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:05.334999 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824a68c-92fd-46c2-80b5-5f16aaddf917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:05.335664 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824a68c-92fd-46c2-80b5-5f16aaddf917 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:05.335945 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824a68c-92fd-46c2-80b5-5f16aaddf917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:05.336217 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824a68c-92fd-46c2-80b5-5f16aaddf917 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:05.337061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2824a68c-92fd-46c2-80b5-5f16aaddf917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:05.338662 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2824a68c-92fd-46c2-80b5-5f16aaddf917 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:05.348532 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1154/2308] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:39:05.352511 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b9ff6-0088-40e9-904a-b9ac8517290a admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:05.362757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b9ff6-0088-40e9-904a-b9ac8517290a admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:05.367274 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b3ec7-7464-40a2-aabd-3efcffeec6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:05.368134 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b3ec7-7464-40a2-aabd-3efcffeec6ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:05.368411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b3ec7-7464-40a2-aabd-3efcffeec6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:05.368680 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b3ec7-7464-40a2-aabd-3efcffeec6ed admin admin] PATH_INFO: `/v3/projects/2890a03f9cb34b87bf2debc1fa58a242/users/ba40cd3cab6144a8aabe860d446bcd8c/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:05.383470 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b3ec7-7464-40a2-aabd-3efcffeec6ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=2890a03f9cb34b87bf2debc1fa58a242, user_id=ba40cd3cab6144a8aabe860d446bcd8c, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:05.386397 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b3ec7-7464-40a2-aabd-3efcffeec6ed admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:05.399576 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1155/2309] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:39:05 2022] PUT /identity/v3/projects/2890a03f9cb34b87bf2debc1fa58a242/users/ba40cd3cab6144a8aabe860d446bcd8c/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:39:05.410312 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317f232-7309-4ea5-a853-f4b9c3d8844e None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:05.410543 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317f232-7309-4ea5-a853-f4b9c3d8844e None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:05.410821 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317f232-7309-4ea5-a853-f4b9c3d8844e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:05.436474 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-a317f232-7309-4ea5-a853-f4b9c3d8844e None None] MFA Rules not processed for user `ba40cd3cab6144a8aabe860d446bcd8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:39:05.437659 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-a317f232-7309-4ea5-a853-f4b9c3d8844e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:05.497625 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1155/2310] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:39:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:39:05.508982 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b3ec7-7464-40a2-aabd-3efcffeec6ed admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:05.510701 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-5e9b3ec7-7464-40a2-aabd-3efcffeec6ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:05.564963 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b3ec7-7464-40a2-aabd-3efcffeec6ed admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:05.568629 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8c803-5927-46a5-af9e-23372c3784fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:05.569259 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8c803-5927-46a5-af9e-23372c3784fb service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:05.569541 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8c803-5927-46a5-af9e-23372c3784fb service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:05.569817 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8c803-5927-46a5-af9e-23372c3784fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:05.578103 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8c803-5927-46a5-af9e-23372c3784fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:05.579536 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8c803-5927-46a5-af9e-23372c3784fb service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:05.588302 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1156/2311] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:39:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:39:11.101337 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df39894-097d-4f07-87b2-673e38807b54 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:11.101856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df39894-097d-4f07-87b2-673e38807b54 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:11.102036 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df39894-097d-4f07-87b2-673e38807b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:11.119421 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-6df39894-097d-4f07-87b2-673e38807b54 None None] MFA Rules not processed for user `ba40cd3cab6144a8aabe860d446bcd8c`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:39:11.120613 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-6df39894-097d-4f07-87b2-673e38807b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:11.128006 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1156/2312] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:39:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:39:11.160910 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8c803-5927-46a5-af9e-23372c3784fb service cinder] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:11.162354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-87a8c803-5927-46a5-af9e-23372c3784fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:11.216948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8c803-5927-46a5-af9e-23372c3784fb service cinder] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:11.220564 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7caf36-bba9-4ab0-989b-53b54a5f5239 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0981a8c6d9ac413b99aae95a6cdd3be5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:11.221197 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7caf36-bba9-4ab0-989b-53b54a5f5239 service glance] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:11.221479 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7caf36-bba9-4ab0-989b-53b54a5f5239 service glance] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:11.221752 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7caf36-bba9-4ab0-989b-53b54a5f5239 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:11.223640 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-1e7caf36-bba9-4ab0-989b-53b54a5f5239 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:11.290415 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7caf36-bba9-4ab0-989b-53b54a5f5239 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:11.291844 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7caf36-bba9-4ab0-989b-53b54a5f5239 service glance] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:11.302603 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1157/2313] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:39:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:39:11.725174 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df39894-097d-4f07-87b2-673e38807b54 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:11.726590 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-6df39894-097d-4f07-87b2-673e38807b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:11.796265 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df39894-097d-4f07-87b2-673e38807b54 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:11.802143 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bec7ea-9540-457f-a6e7-d9f5b1d743dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525f4699878f461e82f7f06ef60c176a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:11.802805 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bec7ea-9540-457f-a6e7-d9f5b1d743dc service placement] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:11.803093 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bec7ea-9540-457f-a6e7-d9f5b1d743dc service placement] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:11.803373 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bec7ea-9540-457f-a6e7-d9f5b1d743dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:11.805163 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-63bec7ea-9540-457f-a6e7-d9f5b1d743dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:11.816496 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bec7ea-9540-457f-a6e7-d9f5b1d743dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:11.818098 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bec7ea-9540-457f-a6e7-d9f5b1d743dc service placement] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:11.827827 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1157/2314] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:39:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 09:39:15.480118 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7caf36-bba9-4ab0-989b-53b54a5f5239 service glance] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:15.481554 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-1e7caf36-bba9-4ab0-989b-53b54a5f5239 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:15.535003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7caf36-bba9-4ab0-989b-53b54a5f5239 service glance] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:15.538511 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73624f40-53a3-4dcd-b9e6-d5a4ffbb6c5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:15.539157 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73624f40-53a3-4dcd-b9e6-d5a4ffbb6c5c service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:15.539424 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73624f40-53a3-4dcd-b9e6-d5a4ffbb6c5c service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:15.539700 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73624f40-53a3-4dcd-b9e6-d5a4ffbb6c5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:15.541437 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-73624f40-53a3-4dcd-b9e6-d5a4ffbb6c5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:15.550428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73624f40-53a3-4dcd-b9e6-d5a4ffbb6c5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:15.551830 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73624f40-53a3-4dcd-b9e6-d5a4ffbb6c5c service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:15.559445 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1158/2315] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:39:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:39:20.372565 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bec7ea-9540-457f-a6e7-d9f5b1d743dc service placement] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:20.374138 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-63bec7ea-9540-457f-a6e7-d9f5b1d743dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:20.448306 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bec7ea-9540-457f-a6e7-d9f5b1d743dc service placement] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:20.453093 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e1e6c-78bc-4df8-8fba-10853869d55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:20.454086 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e1e6c-78bc-4df8-8fba-10853869d55d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:20.454373 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e1e6c-78bc-4df8-8fba-10853869d55d admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:20.454675 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e1e6c-78bc-4df8-8fba-10853869d55d admin admin] PATH_INFO: `/v3/users/7dd6d3e1b6ea49d4a75e5f7e105ea0f0` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:20.455919 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e1e6c-78bc-4df8-8fba-10853869d55d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dd6d3e1b6ea49d4a75e5f7e105ea0f0)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:20.457855 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e1e6c-78bc-4df8-8fba-10853869d55d admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:20.505089 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-130e1e6c-78bc-4df8-8fba-10853869d55d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:20.516737 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-130e1e6c-78bc-4df8-8fba-10853869d55d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:20.517403 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-130e1e6c-78bc-4df8-8fba-10853869d55d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:20.524752 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-130e1e6c-78bc-4df8-8fba-10853869d55d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:20.531820 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-130e1e6c-78bc-4df8-8fba-10853869d55d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:20.537576 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1158/2316] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:39:20 2022] DELETE /identity/v3/users/7dd6d3e1b6ea49d4a75e5f7e105ea0f0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:39:20.748060 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73624f40-53a3-4dcd-b9e6-d5a4ffbb6c5c service neutron] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:20.761198 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73624f40-53a3-4dcd-b9e6-d5a4ffbb6c5c service neutron] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:20.821023 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a6880-2b8c-4c5a-b4ee-7abd0bcb3669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:20.822010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a6880-2b8c-4c5a-b4ee-7abd0bcb3669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:20.822294 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a6880-2b8c-4c5a-b4ee-7abd0bcb3669 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:20.822571 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a6880-2b8c-4c5a-b4ee-7abd0bcb3669 admin admin] PATH_INFO: `/v3/projects/59546c2ca0074bb5b77b7c5e64d9c068` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:20.823761 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a6880-2b8c-4c5a-b4ee-7abd0bcb3669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59546c2ca0074bb5b77b7c5e64d9c068)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:20.825669 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a6880-2b8c-4c5a-b4ee-7abd0bcb3669 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:20.872874 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-5e5a6880-2b8c-4c5a-b4ee-7abd0bcb3669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59546c2ca0074bb5b77b7c5e64d9c068', 'request_id': 'req-5e5a6880-2b8c-4c5a-b4ee-7abd0bcb3669'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:20.878271 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-5e5a6880-2b8c-4c5a-b4ee-7abd0bcb3669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59546c2ca0074bb5b77b7c5e64d9c068', 'request_id': 'req-5e5a6880-2b8c-4c5a-b4ee-7abd0bcb3669'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:20.885802 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-5e5a6880-2b8c-4c5a-b4ee-7abd0bcb3669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59546c2ca0074bb5b77b7c5e64d9c068', 'request_id': 'req-5e5a6880-2b8c-4c5a-b4ee-7abd0bcb3669'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:20.897189 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-5e5a6880-2b8c-4c5a-b4ee-7abd0bcb3669 admin admin] The token cache is being invalidate because project 59546c2ca0074bb5b77b7c5e64d9c068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:39:20.897457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-5e5a6880-2b8c-4c5a-b4ee-7abd0bcb3669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:20.898128 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-5e5a6880-2b8c-4c5a-b4ee-7abd0bcb3669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:20.899693 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1159/2317] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:39:20 2022] DELETE /identity/v3/projects/59546c2ca0074bb5b77b7c5e64d9c068 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:39:20.904534 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49461967-7527-4c87-a3da-10d8668f637f None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:20.904873 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49461967-7527-4c87-a3da-10d8668f637f None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:20.905137 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49461967-7527-4c87-a3da-10d8668f637f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:20.923993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-49461967-7527-4c87-a3da-10d8668f637f None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:39:20.925116 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-49461967-7527-4c87-a3da-10d8668f637f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:20.982441 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1159/2318] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:39:20.991059 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e421f2c-f22a-47d6-896d-ac88ed583999 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:20.991347 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e421f2c-f22a-47d6-896d-ac88ed583999 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:20.991624 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e421f2c-f22a-47d6-896d-ac88ed583999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:21.010064 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-0e421f2c-f22a-47d6-896d-ac88ed583999 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:39:21.011262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-0e421f2c-f22a-47d6-896d-ac88ed583999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:21.019212 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1160/2319] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:39:21.023307 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49461967-7527-4c87-a3da-10d8668f637f None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:21.033306 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49461967-7527-4c87-a3da-10d8668f637f None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:21.037956 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00881945-92a3-493e-bc6b-4bac5b25e6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:21.038611 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00881945-92a3-493e-bc6b-4bac5b25e6ff admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:21.038915 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00881945-92a3-493e-bc6b-4bac5b25e6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:21.039173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00881945-92a3-493e-bc6b-4bac5b25e6ff admin admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:21.039891 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00881945-92a3-493e-bc6b-4bac5b25e6ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:39:21.040206 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00881945-92a3-493e-bc6b-4bac5b25e6ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:21.041790 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00881945-92a3-493e-bc6b-4bac5b25e6ff admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:21.053609 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1160/2320] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:39:21.057722 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e421f2c-f22a-47d6-896d-ac88ed583999 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:21.070395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e421f2c-f22a-47d6-896d-ac88ed583999 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:21.075223 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea4e36-5bba-415a-aa4a-5808044618e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:21.075875 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea4e36-5bba-415a-aa4a-5808044618e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:21.076158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea4e36-5bba-415a-aa4a-5808044618e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:21.076435 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea4e36-5bba-415a-aa4a-5808044618e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:21.077140 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea4e36-5bba-415a-aa4a-5808044618e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:21.079322 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea4e36-5bba-415a-aa4a-5808044618e4 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:21.106015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1161/2321] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:39:21 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:39:21.110734 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00881945-92a3-493e-bc6b-4bac5b25e6ff admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:21.120567 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00881945-92a3-493e-bc6b-4bac5b25e6ff admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:21.174804 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06181d-a7bb-436e-bdd3-4ee870505f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:21.175397 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06181d-a7bb-436e-bdd3-4ee870505f3b admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:21.175682 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06181d-a7bb-436e-bdd3-4ee870505f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:21.175959 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06181d-a7bb-436e-bdd3-4ee870505f3b admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:21.176649 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06181d-a7bb-436e-bdd3-4ee870505f3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:21.178622 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06181d-a7bb-436e-bdd3-4ee870505f3b admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:21.202225 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1161/2322] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:39:21 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:39:21.203515 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea4e36-5bba-415a-aa4a-5808044618e4 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:21.214123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea4e36-5bba-415a-aa4a-5808044618e4 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:21.218788 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c95ef-e76e-4577-9674-37760825c82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:21.220003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c95ef-e76e-4577-9674-37760825c82f admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:21.220292 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c95ef-e76e-4577-9674-37760825c82f admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:21.220566 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c95ef-e76e-4577-9674-37760825c82f admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:21.221285 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c95ef-e76e-4577-9674-37760825c82f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:21.222901 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c95ef-e76e-4577-9674-37760825c82f admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:21.233289 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1162/2323] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:39:21.237180 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06181d-a7bb-436e-bdd3-4ee870505f3b admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:21.246911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06181d-a7bb-436e-bdd3-4ee870505f3b admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:21.251608 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8959a31-07de-4edf-a2bd-5f0bf01cfb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:21.252256 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8959a31-07de-4edf-a2bd-5f0bf01cfb15 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:21.252542 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8959a31-07de-4edf-a2bd-5f0bf01cfb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:21.252820 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8959a31-07de-4edf-a2bd-5f0bf01cfb15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:21.253542 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8959a31-07de-4edf-a2bd-5f0bf01cfb15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:21.255177 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8959a31-07de-4edf-a2bd-5f0bf01cfb15 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:21.264983 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1162/2324] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 09:39:21.269429 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c95ef-e76e-4577-9674-37760825c82f admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:21.279153 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c95ef-e76e-4577-9674-37760825c82f admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:21.284302 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c92eab-0b78-4abc-ba4e-e26da81eed49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:21.285163 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c92eab-0b78-4abc-ba4e-e26da81eed49 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:21.285442 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c92eab-0b78-4abc-ba4e-e26da81eed49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:21.285715 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c92eab-0b78-4abc-ba4e-e26da81eed49 admin admin] PATH_INFO: `/v3/projects/344297b40fcd49ee82e0039684d30c3d/users/4d5bace1e3d04b69865f7995f801558c/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:21.299754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c92eab-0b78-4abc-ba4e-e26da81eed49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=344297b40fcd49ee82e0039684d30c3d, user_id=4d5bace1e3d04b69865f7995f801558c, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:21.302421 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c92eab-0b78-4abc-ba4e-e26da81eed49 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:21.314760 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1163/2325] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:39:21 2022] PUT /identity/v3/projects/344297b40fcd49ee82e0039684d30c3d/users/4d5bace1e3d04b69865f7995f801558c/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:39:21.324880 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1def5-6097-4932-bbfb-431579566978 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:21.325179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1def5-6097-4932-bbfb-431579566978 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:21.325468 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1def5-6097-4932-bbfb-431579566978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:21.354062 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-46e1def5-6097-4932-bbfb-431579566978 None None] MFA Rules not processed for user `4d5bace1e3d04b69865f7995f801558c`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:39:21.355257 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-46e1def5-6097-4932-bbfb-431579566978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:21.417860 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1163/2326] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:39:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:39:21.428395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c92eab-0b78-4abc-ba4e-e26da81eed49 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:21.430023 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-d3c92eab-0b78-4abc-ba4e-e26da81eed49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:21.489417 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c92eab-0b78-4abc-ba4e-e26da81eed49 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:21.493129 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8945748-473c-4d98-8c87-e1e3d67ac8fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:21.493772 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8945748-473c-4d98-8c87-e1e3d67ac8fa service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:21.494087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8945748-473c-4d98-8c87-e1e3d67ac8fa service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:21.494369 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8945748-473c-4d98-8c87-e1e3d67ac8fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:21.503519 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8945748-473c-4d98-8c87-e1e3d67ac8fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:21.505154 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8945748-473c-4d98-8c87-e1e3d67ac8fa service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:21.514753 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1164/2327] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:39:21 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:39:30.884628 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1def5-6097-4932-bbfb-431579566978 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:30.886055 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-46e1def5-6097-4932-bbfb-431579566978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:30.954991 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1def5-6097-4932-bbfb-431579566978 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:30.960527 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651e103-41f5-4556-b0a7-795c09a14dab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:30.961176 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651e103-41f5-4556-b0a7-795c09a14dab service nova] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:30.961571 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651e103-41f5-4556-b0a7-795c09a14dab service nova] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:30.961852 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651e103-41f5-4556-b0a7-795c09a14dab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:30.963641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-0651e103-41f5-4556-b0a7-795c09a14dab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:31.018319 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0651e103-41f5-4556-b0a7-795c09a14dab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:31.019889 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0651e103-41f5-4556-b0a7-795c09a14dab service nova] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:31.029096 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1164/2328] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:39:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:39:43.868755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8945748-473c-4d98-8c87-e1e3d67ac8fa service cinder] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:43.883908 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8945748-473c-4d98-8c87-e1e3d67ac8fa service cinder] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:43.893940 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681d97e-c8e4-4381-abab-02a5024ae254 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:43.894752 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681d97e-c8e4-4381-abab-02a5024ae254 service nova] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:43.896642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681d97e-c8e4-4381-abab-02a5024ae254 service nova] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:43.897003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681d97e-c8e4-4381-abab-02a5024ae254 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:43.899123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-b681d97e-c8e4-4381-abab-02a5024ae254 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:43.913498 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b681d97e-c8e4-4381-abab-02a5024ae254 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:43.915278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b681d97e-c8e4-4381-abab-02a5024ae254 service nova] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:43.930108 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1165/2329] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:39:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:39:45.006054 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df7fe8-a028-440b-9a4a-f133f8f807af None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:45.006557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df7fe8-a028-440b-9a4a-f133f8f807af None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:45.006667 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df7fe8-a028-440b-9a4a-f133f8f807af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:45.061675 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-b6df7fe8-a028-440b-9a4a-f133f8f807af None None] MFA Rules not processed for user `bd41f419750140268f4d4b77456065c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:39:45.062956 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-b6df7fe8-a028-440b-9a4a-f133f8f807af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:45.128727 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1165/2330] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 12 09:39:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:39:45.176042 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681d97e-c8e4-4381-abab-02a5024ae254 service nova] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:45.177481 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-b681d97e-c8e4-4381-abab-02a5024ae254 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:45.267823 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681d97e-c8e4-4381-abab-02a5024ae254 service nova] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:45.273156 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f2f95-d2b5-40b9-aa00-d7ecf69eb334 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7693a31911346f9bb2c01efcd8e16e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:45.273803 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f2f95-d2b5-40b9-aa00-d7ecf69eb334 service swift] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:45.274108 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f2f95-d2b5-40b9-aa00-d7ecf69eb334 service swift] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:45.274383 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f2f95-d2b5-40b9-aa00-d7ecf69eb334 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:45.283065 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f2f95-d2b5-40b9-aa00-d7ecf69eb334 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:45.284641 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f2f95-d2b5-40b9-aa00-d7ecf69eb334 service swift] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:45.292629 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1166/2331] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 12 09:39:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 09:39:45.804337 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd1fc4-8f94-4d6c-9f58-7de234293ceb None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:45.804635 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd1fc4-8f94-4d6c-9f58-7de234293ceb None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:45.804914 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd1fc4-8f94-4d6c-9f58-7de234293ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:45.823042 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-d8fd1fc4-8f94-4d6c-9f58-7de234293ceb None None] MFA Rules not processed for user `bd41f419750140268f4d4b77456065c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:39:45.824215 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-d8fd1fc4-8f94-4d6c-9f58-7de234293ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:45.831878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1166/2332] 10.222.0.60 () {58 vars in 967 bytes} [Thu May 12 09:39:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:39:45.844395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f2f95-d2b5-40b9-aa00-d7ecf69eb334 service swift] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:45.854810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f2f95-d2b5-40b9-aa00-d7ecf69eb334 service swift] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:45.859937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4108fd1-eea3-40b9-8887-dca7a51b9c16 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7693a31911346f9bb2c01efcd8e16e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:45.861085 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4108fd1-eea3-40b9-8887-dca7a51b9c16 service swift] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:45.861368 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4108fd1-eea3-40b9-8887-dca7a51b9c16 service swift] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:45.861644 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4108fd1-eea3-40b9-8887-dca7a51b9c16 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:45.869591 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4108fd1-eea3-40b9-8887-dca7a51b9c16 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:45.871198 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4108fd1-eea3-40b9-8887-dca7a51b9c16 service swift] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:45.879901 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1167/2333] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 12 09:39:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 09:39:46.073730 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871714fe-bfd6-4c4f-9736-f571769882d4 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:46.074246 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871714fe-bfd6-4c4f-9736-f571769882d4 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:46.074340 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871714fe-bfd6-4c4f-9736-f571769882d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:46.091687 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-871714fe-bfd6-4c4f-9736-f571769882d4 None None] MFA Rules not processed for user `bd41f419750140268f4d4b77456065c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:39:46.092858 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-871714fe-bfd6-4c4f-9736-f571769882d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:46.101821 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1167/2334] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 12 09:39:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:39:46.114331 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4108fd1-eea3-40b9-8887-dca7a51b9c16 service swift] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:46.124810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4108fd1-eea3-40b9-8887-dca7a51b9c16 service swift] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:46.130826 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75cd7c-0aa4-444e-af85-26d09d8347e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7693a31911346f9bb2c01efcd8e16e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:46.131820 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75cd7c-0aa4-444e-af85-26d09d8347e9 service swift] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:46.132249 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75cd7c-0aa4-444e-af85-26d09d8347e9 service swift] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:46.132711 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75cd7c-0aa4-444e-af85-26d09d8347e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:46.144227 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75cd7c-0aa4-444e-af85-26d09d8347e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:46.145735 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75cd7c-0aa4-444e-af85-26d09d8347e9 service swift] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:46.170434 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1168/2335] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 12 09:39:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 09:39:46.498420 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b1909-0320-46a2-aa73-868c9beb7775 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:46.498712 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b1909-0320-46a2-aa73-868c9beb7775 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:46.498982 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b1909-0320-46a2-aa73-868c9beb7775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:46.516755 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-b74b1909-0320-46a2-aa73-868c9beb7775 None None] MFA Rules not processed for user `bd41f419750140268f4d4b77456065c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:39:46.518467 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-b74b1909-0320-46a2-aa73-868c9beb7775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:46.525408 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1168/2336] 10.222.0.60 () {58 vars in 967 bytes} [Thu May 12 09:39:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:39:46.537538 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75cd7c-0aa4-444e-af85-26d09d8347e9 service swift] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:46.547749 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75cd7c-0aa4-444e-af85-26d09d8347e9 service swift] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:46.553098 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69105174-a2b5-4a4b-8a1d-fc719c3ff813 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7693a31911346f9bb2c01efcd8e16e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:46.553729 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69105174-a2b5-4a4b-8a1d-fc719c3ff813 service swift] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:46.554038 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69105174-a2b5-4a4b-8a1d-fc719c3ff813 service swift] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:46.554421 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69105174-a2b5-4a4b-8a1d-fc719c3ff813 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:46.562401 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69105174-a2b5-4a4b-8a1d-fc719c3ff813 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:46.564515 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69105174-a2b5-4a4b-8a1d-fc719c3ff813 service swift] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:46.572507 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1169/2337] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 12 09:39:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 09:39:47.968827 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b1909-0320-46a2-aa73-868c9beb7775 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:48.028523 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b1909-0320-46a2-aa73-868c9beb7775 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:48.033057 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7a571-9add-4760-8b18-ea44069e47e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:48.033963 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7a571-9add-4760-8b18-ea44069e47e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:48.034250 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7a571-9add-4760-8b18-ea44069e47e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:48.034526 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7a571-9add-4760-8b18-ea44069e47e3 admin admin] PATH_INFO: `/v3/users/4d5bace1e3d04b69865f7995f801558c` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:48.035716 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7a571-9add-4760-8b18-ea44069e47e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d5bace1e3d04b69865f7995f801558c)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:48.037629 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7a571-9add-4760-8b18-ea44069e47e3 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:48.083513 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-9ef7a571-9add-4760-8b18-ea44069e47e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d5bace1e3d04b69865f7995f801558c'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:48.094622 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-9ef7a571-9add-4760-8b18-ea44069e47e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d5bace1e3d04b69865f7995f801558c'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:48.095280 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-9ef7a571-9add-4760-8b18-ea44069e47e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d5bace1e3d04b69865f7995f801558c'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:48.103369 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-9ef7a571-9add-4760-8b18-ea44069e47e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d5bace1e3d04b69865f7995f801558c'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:48.110048 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-9ef7a571-9add-4760-8b18-ea44069e47e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d5bace1e3d04b69865f7995f801558c'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:48.116292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1169/2338] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:39:47 2022] DELETE /identity/v3/users/4d5bace1e3d04b69865f7995f801558c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:39:48.120698 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adced66-2587-4f86-afa0-3be1e3999c9f None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:48.121180 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adced66-2587-4f86-afa0-3be1e3999c9f None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:48.121290 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adced66-2587-4f86-afa0-3be1e3999c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:48.139058 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-1adced66-2587-4f86-afa0-3be1e3999c9f None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:39:48.140224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-1adced66-2587-4f86-afa0-3be1e3999c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:48.196297 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1170/2339] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:39:48.205827 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7a571-9add-4760-8b18-ea44069e47e3 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:48.207280 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-9ef7a571-9add-4760-8b18-ea44069e47e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:48.263055 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7a571-9add-4760-8b18-ea44069e47e3 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:48.266760 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61fa0d-4e94-4d59-a214-39dc95eef7d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:48.267400 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61fa0d-4e94-4d59-a214-39dc95eef7d7 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:48.267681 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61fa0d-4e94-4d59-a214-39dc95eef7d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:48.267951 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61fa0d-4e94-4d59-a214-39dc95eef7d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:48.276681 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61fa0d-4e94-4d59-a214-39dc95eef7d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:48.278111 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61fa0d-4e94-4d59-a214-39dc95eef7d7 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:48.287275 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1170/2340] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:39:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:39:48.549848 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adced66-2587-4f86-afa0-3be1e3999c9f None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:48.551372 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-1adced66-2587-4f86-afa0-3be1e3999c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:48.567071 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adced66-2587-4f86-afa0-3be1e3999c9f None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:48.572831 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b6081-27f2-4319-8f6b-a083f8bc2ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:48.573619 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b6081-27f2-4319-8f6b-a083f8bc2ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:48.573955 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b6081-27f2-4319-8f6b-a083f8bc2ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:48.574195 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b6081-27f2-4319-8f6b-a083f8bc2ca4 admin admin] PATH_INFO: `/v3/projects/344297b40fcd49ee82e0039684d30c3d` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:48.575508 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b6081-27f2-4319-8f6b-a083f8bc2ca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=344297b40fcd49ee82e0039684d30c3d)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:48.577333 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b6081-27f2-4319-8f6b-a083f8bc2ca4 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:48.628128 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4d4b6081-27f2-4319-8f6b-a083f8bc2ca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '344297b40fcd49ee82e0039684d30c3d', 'request_id': 'req-4d4b6081-27f2-4319-8f6b-a083f8bc2ca4'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:48.633267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61fa0d-4e94-4d59-a214-39dc95eef7d7 service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:48.635025 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-cb61fa0d-4e94-4d59-a214-39dc95eef7d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:48.635153 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4d4b6081-27f2-4319-8f6b-a083f8bc2ca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '344297b40fcd49ee82e0039684d30c3d', 'request_id': 'req-4d4b6081-27f2-4319-8f6b-a083f8bc2ca4'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:48.642229 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4d4b6081-27f2-4319-8f6b-a083f8bc2ca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '344297b40fcd49ee82e0039684d30c3d', 'request_id': 'req-4d4b6081-27f2-4319-8f6b-a083f8bc2ca4'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:48.647709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61fa0d-4e94-4d59-a214-39dc95eef7d7 service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:48.653204 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4d4b6081-27f2-4319-8f6b-a083f8bc2ca4 admin admin] The token cache is being invalidate because project 344297b40fcd49ee82e0039684d30c3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:39:48.653494 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4d4b6081-27f2-4319-8f6b-a083f8bc2ca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:48.654133 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4d4b6081-27f2-4319-8f6b-a083f8bc2ca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:48.655796 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1171/2341] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:39:48 2022] DELETE /identity/v3/projects/344297b40fcd49ee82e0039684d30c3d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:39:48.661584 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff8b39-d70f-45b8-abf6-4644f9151a53 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:48.661872 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff8b39-d70f-45b8-abf6-4644f9151a53 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:48.662174 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff8b39-d70f-45b8-abf6-4644f9151a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:48.682513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-5fff8b39-d70f-45b8-abf6-4644f9151a53 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:39:48.683933 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-5fff8b39-d70f-45b8-abf6-4644f9151a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:48.711574 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12283c4d-ebd2-4912-bc28-d1e10222d282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:48.712465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12283c4d-ebd2-4912-bc28-d1e10222d282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:48.712747 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12283c4d-ebd2-4912-bc28-d1e10222d282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:48.713024 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12283c4d-ebd2-4912-bc28-d1e10222d282 admin admin] PATH_INFO: `/v3/users/ba40cd3cab6144a8aabe860d446bcd8c` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:48.714305 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12283c4d-ebd2-4912-bc28-d1e10222d282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba40cd3cab6144a8aabe860d446bcd8c)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:48.716250 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12283c4d-ebd2-4912-bc28-d1e10222d282 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:48.744074 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1172/2342] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:39:48.751534 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea075fc3-a655-4df8-8eb6-53b4fd41f8ff None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:48.751841 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea075fc3-a655-4df8-8eb6-53b4fd41f8ff None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:48.752092 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea075fc3-a655-4df8-8eb6-53b4fd41f8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:48.766489 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-12283c4d-ebd2-4912-bc28-d1e10222d282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba40cd3cab6144a8aabe860d446bcd8c'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:48.769609 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-ea075fc3-a655-4df8-8eb6-53b4fd41f8ff None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:39:48.770821 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-ea075fc3-a655-4df8-8eb6-53b4fd41f8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:48.777843 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-12283c4d-ebd2-4912-bc28-d1e10222d282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba40cd3cab6144a8aabe860d446bcd8c'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:48.778557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-12283c4d-ebd2-4912-bc28-d1e10222d282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba40cd3cab6144a8aabe860d446bcd8c'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:48.778670 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1173/2343] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:39:48.783213 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea075fc3-a655-4df8-8eb6-53b4fd41f8ff None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:48.787447 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-12283c4d-ebd2-4912-bc28-d1e10222d282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba40cd3cab6144a8aabe860d446bcd8c'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:48.791839 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea075fc3-a655-4df8-8eb6-53b4fd41f8ff None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:48.794623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-12283c4d-ebd2-4912-bc28-d1e10222d282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba40cd3cab6144a8aabe860d446bcd8c'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:48.796444 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0e6de-b131-4536-94a8-e9df07d4c261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:48.797074 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0e6de-b131-4536-94a8-e9df07d4c261 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:48.797353 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0e6de-b131-4536-94a8-e9df07d4c261 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:48.797628 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0e6de-b131-4536-94a8-e9df07d4c261 admin admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:48.798977 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa0e6de-b131-4536-94a8-e9df07d4c261 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:39:48.799285 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa0e6de-b131-4536-94a8-e9df07d4c261 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:48.800873 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa0e6de-b131-4536-94a8-e9df07d4c261 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:48.801166 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1171/2344] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:39:48 2022] DELETE /identity/v3/users/ba40cd3cab6144a8aabe860d446bcd8c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:39:48.805562 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8df24e-62a5-466e-b86a-0489ba3da1fa None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:48.805849 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8df24e-62a5-466e-b86a-0489ba3da1fa None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:48.806155 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8df24e-62a5-466e-b86a-0489ba3da1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:48.812198 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1174/2345] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:39:48.816357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0e6de-b131-4536-94a8-e9df07d4c261 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:48.818002 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-7fa0e6de-b131-4536-94a8-e9df07d4c261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:48.823186 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-5e8df24e-62a5-466e-b86a-0489ba3da1fa None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:39:48.824356 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-5e8df24e-62a5-466e-b86a-0489ba3da1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:48.830927 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0e6de-b131-4536-94a8-e9df07d4c261 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:48.880824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1172/2346] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:39:48.884074 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad6a10-3faf-46ca-b06f-36c2c75cc81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:48.884734 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad6a10-3faf-46ca-b06f-36c2c75cc81a admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:48.885016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad6a10-3faf-46ca-b06f-36c2c75cc81a admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:48.885289 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad6a10-3faf-46ca-b06f-36c2c75cc81a admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:48.886007 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad6a10-3faf-46ca-b06f-36c2c75cc81a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:48.887898 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad6a10-3faf-46ca-b06f-36c2c75cc81a admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:48.890693 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8df24e-62a5-466e-b86a-0489ba3da1fa None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:48.892698 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-5e8df24e-62a5-466e-b86a-0489ba3da1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:48.918035 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1175/2347] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:39:48 2022] POST /identity/v3/projects => generated 399 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:39:48.919011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad6a10-3faf-46ca-b06f-36c2c75cc81a admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:48.946681 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8df24e-62a5-466e-b86a-0489ba3da1fa None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:48.978954 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad6a10-3faf-46ca-b06f-36c2c75cc81a admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:48.983680 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4dafc-9f00-4c9e-95f4-31850f22d770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:48.984353 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4dafc-9f00-4c9e-95f4-31850f22d770 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:48.984627 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4dafc-9f00-4c9e-95f4-31850f22d770 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:48.984926 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4dafc-9f00-4c9e-95f4-31850f22d770 admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:48.985605 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa4dafc-9f00-4c9e-95f4-31850f22d770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:48.987569 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa4dafc-9f00-4c9e-95f4-31850f22d770 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:48.994499 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5359d71-e4c2-473d-b3b0-24c90815cbe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:48.995079 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5359d71-e4c2-473d-b3b0-24c90815cbe0 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:48.995360 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5359d71-e4c2-473d-b3b0-24c90815cbe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:48.995708 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5359d71-e4c2-473d-b3b0-24c90815cbe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:49.005326 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5359d71-e4c2-473d-b3b0-24c90815cbe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:49.006764 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5359d71-e4c2-473d-b3b0-24c90815cbe0 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:49.007182 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1176/2348] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:39:48 2022] POST /identity/v3/users => generated 300 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:39:49.011279 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4dafc-9f00-4c9e-95f4-31850f22d770 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:49.017165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1173/2349] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:39:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 09:39:49.021089 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4dafc-9f00-4c9e-95f4-31850f22d770 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:49.025945 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a172850-b985-4a8d-9e76-53920bb3b0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:49.026584 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a172850-b985-4a8d-9e76-53920bb3b0ac admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:49.026864 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a172850-b985-4a8d-9e76-53920bb3b0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:49.027130 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a172850-b985-4a8d-9e76-53920bb3b0ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:49.027844 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a172850-b985-4a8d-9e76-53920bb3b0ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:49.029419 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a172850-b985-4a8d-9e76-53920bb3b0ac admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:49.039920 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1177/2350] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 09:39:49.044256 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5359d71-e4c2-473d-b3b0-24c90815cbe0 service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:49.053635 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5359d71-e4c2-473d-b3b0-24c90815cbe0 service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:49.058411 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87284a-21e5-49c2-9f66-acc946a2374f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:49.059075 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87284a-21e5-49c2-9f66-acc946a2374f admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:49.059360 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87284a-21e5-49c2-9f66-acc946a2374f admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:49.059640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87284a-21e5-49c2-9f66-acc946a2374f admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:49.060365 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87284a-21e5-49c2-9f66-acc946a2374f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:49.062560 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87284a-21e5-49c2-9f66-acc946a2374f admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:49.072710 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1174/2351] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:39:49.076604 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a172850-b985-4a8d-9e76-53920bb3b0ac admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:49.087113 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a172850-b985-4a8d-9e76-53920bb3b0ac admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:49.091766 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519eadf9-0c51-46f3-8738-f0725bea3e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:49.092639 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519eadf9-0c51-46f3-8738-f0725bea3e2a admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:49.092921 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519eadf9-0c51-46f3-8738-f0725bea3e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:49.093197 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519eadf9-0c51-46f3-8738-f0725bea3e2a admin admin] PATH_INFO: `/v3/projects/6a94f4aeb025417fa07a5111c98c8e59/users/7181766e5b7c4537a402b327adeabcd8/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:49.112078 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519eadf9-0c51-46f3-8738-f0725bea3e2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a94f4aeb025417fa07a5111c98c8e59, user_id=7181766e5b7c4537a402b327adeabcd8, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:49.114803 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519eadf9-0c51-46f3-8738-f0725bea3e2a admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:49.128927 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1178/2352] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:39:49 2022] PUT /identity/v3/projects/6a94f4aeb025417fa07a5111c98c8e59/users/7181766e5b7c4537a402b327adeabcd8/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:39:49.140471 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cf9fb-2795-4c4a-ae35-286fe2f2c376 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:49.140855 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cf9fb-2795-4c4a-ae35-286fe2f2c376 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:49.141227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cf9fb-2795-4c4a-ae35-286fe2f2c376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:49.170158 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-d67cf9fb-2795-4c4a-ae35-286fe2f2c376 None None] MFA Rules not processed for user `7181766e5b7c4537a402b327adeabcd8`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:39:49.171496 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-d67cf9fb-2795-4c4a-ae35-286fe2f2c376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:49.186746 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519eadf9-0c51-46f3-8738-f0725bea3e2a admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:49.189022 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-519eadf9-0c51-46f3-8738-f0725bea3e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:49.238457 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1175/2353] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:39:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:39:49.249923 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67cf9fb-2795-4c4a-ae35-286fe2f2c376 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:49.251920 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-d67cf9fb-2795-4c4a-ae35-286fe2f2c376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:49.263588 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519eadf9-0c51-46f3-8738-f0725bea3e2a admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:49.268797 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4d747-d8d3-4724-a03d-9c89a9789a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:49.269641 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4d747-d8d3-4724-a03d-9c89a9789a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:49.269941 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4d747-d8d3-4724-a03d-9c89a9789a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:49.270221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4d747-d8d3-4724-a03d-9c89a9789a48 admin admin] PATH_INFO: `/v3/projects/2890a03f9cb34b87bf2debc1fa58a242` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:49.271394 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd4d747-d8d3-4724-a03d-9c89a9789a48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2890a03f9cb34b87bf2debc1fa58a242)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:49.273280 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd4d747-d8d3-4724-a03d-9c89a9789a48 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:49.307293 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67cf9fb-2795-4c4a-ae35-286fe2f2c376 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:49.318249 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-3dd4d747-d8d3-4724-a03d-9c89a9789a48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2890a03f9cb34b87bf2debc1fa58a242', 'request_id': 'req-3dd4d747-d8d3-4724-a03d-9c89a9789a48'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:49.324006 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-3dd4d747-d8d3-4724-a03d-9c89a9789a48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2890a03f9cb34b87bf2debc1fa58a242', 'request_id': 'req-3dd4d747-d8d3-4724-a03d-9c89a9789a48'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:49.332086 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-3dd4d747-d8d3-4724-a03d-9c89a9789a48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2890a03f9cb34b87bf2debc1fa58a242', 'request_id': 'req-3dd4d747-d8d3-4724-a03d-9c89a9789a48'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:49.342936 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-3dd4d747-d8d3-4724-a03d-9c89a9789a48 admin admin] The token cache is being invalidate because project 2890a03f9cb34b87bf2debc1fa58a242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:39:49.343225 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-3dd4d747-d8d3-4724-a03d-9c89a9789a48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:49.344145 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-3dd4d747-d8d3-4724-a03d-9c89a9789a48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:39:49.345738 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1179/2354] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:39:49 2022] DELETE /identity/v3/projects/2890a03f9cb34b87bf2debc1fa58a242 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:39:49.351678 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973883b4-61a4-4a67-8490-efa3d17527cf None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:49.351962 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973883b4-61a4-4a67-8490-efa3d17527cf None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:49.352379 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973883b4-61a4-4a67-8490-efa3d17527cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:49.358676 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a469fc2-ed7c-4551-8015-9f235817dcd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:49.359365 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a469fc2-ed7c-4551-8015-9f235817dcd0 service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:49.359769 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a469fc2-ed7c-4551-8015-9f235817dcd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:49.360190 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a469fc2-ed7c-4551-8015-9f235817dcd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:49.362201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-1a469fc2-ed7c-4551-8015-9f235817dcd0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:49.370890 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-973883b4-61a4-4a67-8490-efa3d17527cf None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:39:49.372207 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-973883b4-61a4-4a67-8490-efa3d17527cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:49.440485 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1180/2355] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:39:49.440713 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a469fc2-ed7c-4551-8015-9f235817dcd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:49.440713 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a469fc2-ed7c-4551-8015-9f235817dcd0 service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:49.442014 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf6258-daf7-478b-9820-4d53541a99cc None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:49.442303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf6258-daf7-478b-9820-4d53541a99cc None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:49.442580 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf6258-daf7-478b-9820-4d53541a99cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:49.446396 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1176/2356] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:39:49 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 09:39:49.463178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-a4bf6258-daf7-478b-9820-4d53541a99cc None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:39:49.464522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-a4bf6258-daf7-478b-9820-4d53541a99cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:49.477010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1181/2357] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:39:49.478155 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a469fc2-ed7c-4551-8015-9f235817dcd0 service cinder] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:49.490414 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a469fc2-ed7c-4551-8015-9f235817dcd0 service cinder] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:49.495029 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4a3be-54f6-4e14-89a0-e80fe47ec421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:49.495692 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4a3be-54f6-4e14-89a0-e80fe47ec421 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:49.495975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4a3be-54f6-4e14-89a0-e80fe47ec421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:49.496252 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4a3be-54f6-4e14-89a0-e80fe47ec421 admin admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:49.497083 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4a3be-54f6-4e14-89a0-e80fe47ec421 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:39:49.497396 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4a3be-54f6-4e14-89a0-e80fe47ec421 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:49.499033 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4a3be-54f6-4e14-89a0-e80fe47ec421 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:49.514538 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1177/2358] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:39:49.515568 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf6258-daf7-478b-9820-4d53541a99cc None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:49.525617 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf6258-daf7-478b-9820-4d53541a99cc None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:49.530863 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f025e-0f3c-40db-ac68-4559ba209e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:49.531558 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f025e-0f3c-40db-ac68-4559ba209e35 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:49.531834 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f025e-0f3c-40db-ac68-4559ba209e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:49.532103 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f025e-0f3c-40db-ac68-4559ba209e35 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:49.532834 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f025e-0f3c-40db-ac68-4559ba209e35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:49.534795 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f025e-0f3c-40db-ac68-4559ba209e35 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:49.567869 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1182/2359] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:39:49 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:39:49.571692 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4a3be-54f6-4e14-89a0-e80fe47ec421 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:49.582815 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4a3be-54f6-4e14-89a0-e80fe47ec421 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:49.640998 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb8614-2c4c-4b06-897d-03422e5b5068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:49.641792 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb8614-2c4c-4b06-897d-03422e5b5068 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:49.642111 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb8614-2c4c-4b06-897d-03422e5b5068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:49.642391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb8614-2c4c-4b06-897d-03422e5b5068 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:49.643093 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb8614-2c4c-4b06-897d-03422e5b5068 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:49.644999 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb8614-2c4c-4b06-897d-03422e5b5068 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:49.665548 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1178/2360] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:39:49 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:39:49.669464 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f025e-0f3c-40db-ac68-4559ba209e35 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:49.680489 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f025e-0f3c-40db-ac68-4559ba209e35 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:49.685036 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07a1ca-5a09-4d1d-adeb-6faf5e253af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:49.685688 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07a1ca-5a09-4d1d-adeb-6faf5e253af3 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:49.686000 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07a1ca-5a09-4d1d-adeb-6faf5e253af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:49.686281 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07a1ca-5a09-4d1d-adeb-6faf5e253af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:49.687000 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07a1ca-5a09-4d1d-adeb-6faf5e253af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:49.689154 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07a1ca-5a09-4d1d-adeb-6faf5e253af3 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:49.699702 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1183/2361] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 09:39:49.703702 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb8614-2c4c-4b06-897d-03422e5b5068 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:49.714023 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb8614-2c4c-4b06-897d-03422e5b5068 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:49.721257 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c68fa-5e01-49b7-9bb9-3b8c1b094c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:49.722740 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c68fa-5e01-49b7-9bb9-3b8c1b094c47 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:49.723095 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c68fa-5e01-49b7-9bb9-3b8c1b094c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:49.723440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c68fa-5e01-49b7-9bb9-3b8c1b094c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:49.724182 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c68fa-5e01-49b7-9bb9-3b8c1b094c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:49.726495 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c68fa-5e01-49b7-9bb9-3b8c1b094c47 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:49.746299 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1179/2362] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:39:49.750445 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07a1ca-5a09-4d1d-adeb-6faf5e253af3 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:49.765569 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07a1ca-5a09-4d1d-adeb-6faf5e253af3 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:49.781685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb1374-b54d-4a43-b5af-99288914ca6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:49.782675 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb1374-b54d-4a43-b5af-99288914ca6b admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:49.782953 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb1374-b54d-4a43-b5af-99288914ca6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:49.783226 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb1374-b54d-4a43-b5af-99288914ca6b admin admin] PATH_INFO: `/v3/projects/170aaa04d8fe4170bf344d5667ae2814/users/fde21f628031431583e085d26485451d/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:49.802569 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb1374-b54d-4a43-b5af-99288914ca6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=170aaa04d8fe4170bf344d5667ae2814, user_id=fde21f628031431583e085d26485451d, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:49.806082 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb1374-b54d-4a43-b5af-99288914ca6b admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:49.822338 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1184/2363] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:39:49 2022] PUT /identity/v3/projects/170aaa04d8fe4170bf344d5667ae2814/users/fde21f628031431583e085d26485451d/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:39:49.827790 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868de0c-aafe-4e69-aa42-23fad0a24a40 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:49.828401 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868de0c-aafe-4e69-aa42-23fad0a24a40 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:49.828804 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868de0c-aafe-4e69-aa42-23fad0a24a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:49.851319 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-0868de0c-aafe-4e69-aa42-23fad0a24a40 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:39:49.852764 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-0868de0c-aafe-4e69-aa42-23fad0a24a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:49.934929 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1180/2364] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:39:49.951363 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb1374-b54d-4a43-b5af-99288914ca6b admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:49.953427 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-d9bb1374-b54d-4a43-b5af-99288914ca6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:50.014580 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb1374-b54d-4a43-b5af-99288914ca6b admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:50.018336 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcdbc46-578e-4ef5-9a58-0572c7bc5303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:50.018909 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdbc46-578e-4ef5-9a58-0572c7bc5303 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:50.019186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdbc46-578e-4ef5-9a58-0572c7bc5303 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:50.019457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdbc46-578e-4ef5-9a58-0572c7bc5303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:50.028453 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcdbc46-578e-4ef5-9a58-0572c7bc5303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:50.029925 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcdbc46-578e-4ef5-9a58-0572c7bc5303 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:50.040700 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1185/2365] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:39:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:39:53.270008 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04f393-6e1f-4cf7-a454-0633f418712f None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:53.270476 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04f393-6e1f-4cf7-a454-0633f418712f None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:53.270769 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04f393-6e1f-4cf7-a454-0633f418712f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:53.291656 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-7d04f393-6e1f-4cf7-a454-0633f418712f None None] MFA Rules not processed for user `6c8297034cfa40438000e7d94419a429`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:39:53.292909 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-7d04f393-6e1f-4cf7-a454-0633f418712f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:53.350504 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1181/2366] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:39:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:39:53.682529 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcdbc46-578e-4ef5-9a58-0572c7bc5303 service neutron] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:53.684111 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-6bcdbc46-578e-4ef5-9a58-0572c7bc5303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:53.697615 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcdbc46-578e-4ef5-9a58-0572c7bc5303 service neutron] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:53.701953 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c5bd2-a834-4ea0-a998-2bb4ae8b881f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:53.702607 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c5bd2-a834-4ea0-a998-2bb4ae8b881f service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:53.702888 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c5bd2-a834-4ea0-a998-2bb4ae8b881f service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:53.703163 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c5bd2-a834-4ea0-a998-2bb4ae8b881f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:53.705125 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-cf8c5bd2-a834-4ea0-a998-2bb4ae8b881f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:53.715867 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c5bd2-a834-4ea0-a998-2bb4ae8b881f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:53.717331 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c5bd2-a834-4ea0-a998-2bb4ae8b881f service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:53.728273 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1186/2367] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:39:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:39:54.887251 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88be4d-d160-43c1-80fa-5f050791fa2c None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:54.887778 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88be4d-d160-43c1-80fa-5f050791fa2c None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:54.887778 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88be4d-d160-43c1-80fa-5f050791fa2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:54.917636 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-cf88be4d-d160-43c1-80fa-5f050791fa2c None None] MFA Rules not processed for user `fde21f628031431583e085d26485451d`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:39:54.919045 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-cf88be4d-d160-43c1-80fa-5f050791fa2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:54.987026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1182/2368] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:39:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:39:54.992048 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c5bd2-a834-4ea0-a998-2bb4ae8b881f service neutron] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:55.003960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c5bd2-a834-4ea0-a998-2bb4ae8b881f service neutron] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:55.009081 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac427d-0391-438f-b053-4d9838a89f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:55.009742 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac427d-0391-438f-b053-4d9838a89f7d admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:55.010063 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac427d-0391-438f-b053-4d9838a89f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:55.010359 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac427d-0391-438f-b053-4d9838a89f7d admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:55.011906 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac427d-0391-438f-b053-4d9838a89f7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:55.013826 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac427d-0391-438f-b053-4d9838a89f7d admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:55.043585 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1187/2369] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:39:54 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:39:55.051004 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88be4d-d160-43c1-80fa-5f050791fa2c None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:55.063604 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88be4d-d160-43c1-80fa-5f050791fa2c None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:55.139221 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22c911-0aaa-42d5-9e44-ffa2586994bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:55.140010 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22c911-0aaa-42d5-9e44-ffa2586994bd admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:55.140363 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22c911-0aaa-42d5-9e44-ffa2586994bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:55.140707 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22c911-0aaa-42d5-9e44-ffa2586994bd admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:55.142088 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22c911-0aaa-42d5-9e44-ffa2586994bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:55.144002 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22c911-0aaa-42d5-9e44-ffa2586994bd admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:55.166465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1183/2370] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:39:55 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:39:55.170521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac427d-0391-438f-b053-4d9838a89f7d admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:55.181256 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac427d-0391-438f-b053-4d9838a89f7d admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:55.191214 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b669ff-393b-42b0-9019-578dc972029f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:55.191921 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b669ff-393b-42b0-9019-578dc972029f admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:55.192204 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b669ff-393b-42b0-9019-578dc972029f admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:55.192479 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b669ff-393b-42b0-9019-578dc972029f admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:55.193221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b669ff-393b-42b0-9019-578dc972029f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:55.194860 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b669ff-393b-42b0-9019-578dc972029f admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:55.206886 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1188/2371] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 09:39:55.212143 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22c911-0aaa-42d5-9e44-ffa2586994bd admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:55.228627 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22c911-0aaa-42d5-9e44-ffa2586994bd admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:55.233574 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1bad4-0fb9-47a2-9491-e9e9c71f8212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:55.234506 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1bad4-0fb9-47a2-9491-e9e9c71f8212 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:55.234788 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1bad4-0fb9-47a2-9491-e9e9c71f8212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:55.235063 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1bad4-0fb9-47a2-9491-e9e9c71f8212 admin admin] PATH_INFO: `/v3/projects/06c18e1915ff41efaf481513fe6f496c/users/ad5e112210324141b014a49f338470b7/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:55.252185 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1bad4-0fb9-47a2-9491-e9e9c71f8212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06c18e1915ff41efaf481513fe6f496c, user_id=ad5e112210324141b014a49f338470b7, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:55.255047 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1bad4-0fb9-47a2-9491-e9e9c71f8212 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:55.277494 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1184/2372] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:39:55 2022] PUT /identity/v3/projects/06c18e1915ff41efaf481513fe6f496c/users/ad5e112210324141b014a49f338470b7/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:39:55.281377 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b669ff-393b-42b0-9019-578dc972029f admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:55.291502 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b669ff-393b-42b0-9019-578dc972029f admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:55.345444 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698e54d-f382-46dc-bbbb-acee44211824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:55.346133 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698e54d-f382-46dc-bbbb-acee44211824 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:55.346413 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698e54d-f382-46dc-bbbb-acee44211824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:55.346683 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698e54d-f382-46dc-bbbb-acee44211824 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:55.347399 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698e54d-f382-46dc-bbbb-acee44211824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:55.348987 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698e54d-f382-46dc-bbbb-acee44211824 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:55.361436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1189/2373] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:39:55.363266 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1bad4-0fb9-47a2-9491-e9e9c71f8212 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:55.373098 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1bad4-0fb9-47a2-9491-e9e9c71f8212 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:55.378196 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1f4ce-45ff-4f3b-a627-01e649096662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:55.379066 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1f4ce-45ff-4f3b-a627-01e649096662 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:55.379355 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1f4ce-45ff-4f3b-a627-01e649096662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:55.379620 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1f4ce-45ff-4f3b-a627-01e649096662 admin admin] PATH_INFO: `/v3/projects/06c18e1915ff41efaf481513fe6f496c/users/ad5e112210324141b014a49f338470b7/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:55.381876 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1f4ce-45ff-4f3b-a627-01e649096662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06c18e1915ff41efaf481513fe6f496c, user_id=ad5e112210324141b014a49f338470b7, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:55.384756 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1f4ce-45ff-4f3b-a627-01e649096662 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:55.395128 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1185/2374] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:39:55 2022] PUT /identity/v3/projects/06c18e1915ff41efaf481513fe6f496c/users/ad5e112210324141b014a49f338470b7/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:39:58.748421 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698e54d-f382-46dc-bbbb-acee44211824 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:39:58.750301 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-7698e54d-f382-46dc-bbbb-acee44211824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:58.914520 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698e54d-f382-46dc-bbbb-acee44211824 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:39:59.027254 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92cca3-8683-425b-80e2-8f73ac309433 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:39:59.027928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92cca3-8683-425b-80e2-8f73ac309433 service nova] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:39:59.028202 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92cca3-8683-425b-80e2-8f73ac309433 service nova] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:39:59.029754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92cca3-8683-425b-80e2-8f73ac309433 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:39:59.041170 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-fd92cca3-8683-425b-80e2-8f73ac309433 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:39:59.173480 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92cca3-8683-425b-80e2-8f73ac309433 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:39:59.177439 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92cca3-8683-425b-80e2-8f73ac309433 service nova] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:39:59.189720 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1190/2375] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:39:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 09:40:00.751065 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a3d95-e17f-44ee-8b17-6011b1e8ad6a None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:40:00.751672 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a3d95-e17f-44ee-8b17-6011b1e8ad6a None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:40:00.751672 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a3d95-e17f-44ee-8b17-6011b1e8ad6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:40:00.788029 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-711a3d95-e17f-44ee-8b17-6011b1e8ad6a None None] MFA Rules not processed for user `ad5e112210324141b014a49f338470b7`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:40:00.789266 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-711a3d95-e17f-44ee-8b17-6011b1e8ad6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:40:00.955977 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1186/2376] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:40:00 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:40:00.969300 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92cca3-8683-425b-80e2-8f73ac309433 service nova] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:40:00.971472 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-fd92cca3-8683-425b-80e2-8f73ac309433 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:40:00.989803 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a3d95-e17f-44ee-8b17-6011b1e8ad6a None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:40:00.991432 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-711a3d95-e17f-44ee-8b17-6011b1e8ad6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:40:01.012607 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92cca3-8683-425b-80e2-8f73ac309433 service nova] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:40:01.036640 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94529d42-2ea7-4b0e-8cc1-58645a4f71fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:40:01.037241 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94529d42-2ea7-4b0e-8cc1-58645a4f71fc service nova] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:40:01.037523 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94529d42-2ea7-4b0e-8cc1-58645a4f71fc service nova] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:40:01.037798 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94529d42-2ea7-4b0e-8cc1-58645a4f71fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:40:01.203134 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a3d95-e17f-44ee-8b17-6011b1e8ad6a None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:40:01.213541 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6362cb-da09-4938-823d-1bfc7e2b4ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:40:01.214953 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6362cb-da09-4938-823d-1bfc7e2b4ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:40:01.215350 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6362cb-da09-4938-823d-1bfc7e2b4ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:40:01.216054 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6362cb-da09-4938-823d-1bfc7e2b4ccd admin admin] PATH_INFO: `/v3/users/7181766e5b7c4537a402b327adeabcd8` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:40:01.221246 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6362cb-da09-4938-823d-1bfc7e2b4ccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7181766e5b7c4537a402b327adeabcd8)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:40:01.224010 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6362cb-da09-4938-823d-1bfc7e2b4ccd admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:40:01.256367 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94529d42-2ea7-4b0e-8cc1-58645a4f71fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:40:01.260129 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94529d42-2ea7-4b0e-8cc1-58645a4f71fc service nova] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:40:01.286989 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1191/2377] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:40:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:40:01.317982 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-8c6362cb-da09-4938-823d-1bfc7e2b4ccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7181766e5b7c4537a402b327adeabcd8'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:40:01.334787 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-8c6362cb-da09-4938-823d-1bfc7e2b4ccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7181766e5b7c4537a402b327adeabcd8'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:40:01.335689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-8c6362cb-da09-4938-823d-1bfc7e2b4ccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7181766e5b7c4537a402b327adeabcd8'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:40:01.346754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-8c6362cb-da09-4938-823d-1bfc7e2b4ccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7181766e5b7c4537a402b327adeabcd8'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:40:01.358510 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-8c6362cb-da09-4938-823d-1bfc7e2b4ccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7181766e5b7c4537a402b327adeabcd8'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:40:01.371991 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1187/2378] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:40:00 2022] DELETE /identity/v3/users/7181766e5b7c4537a402b327adeabcd8 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:40:01.374033 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bb2c8-484c-44c1-9f37-ff27e41edd23 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:40:01.374780 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bb2c8-484c-44c1-9f37-ff27e41edd23 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:40:01.375066 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bb2c8-484c-44c1-9f37-ff27e41edd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:40:01.414128 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-2f6bb2c8-484c-44c1-9f37-ff27e41edd23 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:40:01.416034 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-2f6bb2c8-484c-44c1-9f37-ff27e41edd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:40:01.502997 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1192/2379] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:40:01.517162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6362cb-da09-4938-823d-1bfc7e2b4ccd admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:40:01.518910 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-8c6362cb-da09-4938-823d-1bfc7e2b4ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:40:01.645797 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6362cb-da09-4938-823d-1bfc7e2b4ccd admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:40:01.652568 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13244bb3-cd20-4f17-824e-2997e1a3b1c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:40:01.664871 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13244bb3-cd20-4f17-824e-2997e1a3b1c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:40:01.665241 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13244bb3-cd20-4f17-824e-2997e1a3b1c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:40:01.665526 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13244bb3-cd20-4f17-824e-2997e1a3b1c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:40:01.687993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13244bb3-cd20-4f17-824e-2997e1a3b1c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:40:01.691629 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13244bb3-cd20-4f17-824e-2997e1a3b1c9 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:40:01.709977 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1188/2380] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:40:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:40:02.606886 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bb2c8-484c-44c1-9f37-ff27e41edd23 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:40:02.609236 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-2f6bb2c8-484c-44c1-9f37-ff27e41edd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:40:02.635184 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bb2c8-484c-44c1-9f37-ff27e41edd23 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:40:02.641999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5bd8b0-24ae-485d-a5a7-2e725f773e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:40:02.643525 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bd8b0-24ae-485d-a5a7-2e725f773e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:40:02.644261 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bd8b0-24ae-485d-a5a7-2e725f773e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:40:02.644738 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bd8b0-24ae-485d-a5a7-2e725f773e01 admin admin] PATH_INFO: `/v3/projects/6a94f4aeb025417fa07a5111c98c8e59` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:40:02.647112 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5bd8b0-24ae-485d-a5a7-2e725f773e01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a94f4aeb025417fa07a5111c98c8e59)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:40:02.650626 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5bd8b0-24ae-485d-a5a7-2e725f773e01 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:40:02.757650 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-eb5bd8b0-24ae-485d-a5a7-2e725f773e01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a94f4aeb025417fa07a5111c98c8e59', 'request_id': 'req-eb5bd8b0-24ae-485d-a5a7-2e725f773e01'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:40:02.762866 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-eb5bd8b0-24ae-485d-a5a7-2e725f773e01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a94f4aeb025417fa07a5111c98c8e59', 'request_id': 'req-eb5bd8b0-24ae-485d-a5a7-2e725f773e01'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:40:02.773519 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-eb5bd8b0-24ae-485d-a5a7-2e725f773e01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a94f4aeb025417fa07a5111c98c8e59', 'request_id': 'req-eb5bd8b0-24ae-485d-a5a7-2e725f773e01'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:40:02.790425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-eb5bd8b0-24ae-485d-a5a7-2e725f773e01 admin admin] The token cache is being invalidate because project 6a94f4aeb025417fa07a5111c98c8e59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:40:02.790964 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-eb5bd8b0-24ae-485d-a5a7-2e725f773e01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:40:02.791945 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-eb5bd8b0-24ae-485d-a5a7-2e725f773e01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:40:02.794232 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1193/2381] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:40:02 2022] DELETE /identity/v3/projects/6a94f4aeb025417fa07a5111c98c8e59 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:40:03.469816 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13244bb3-cd20-4f17-824e-2997e1a3b1c9 service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:40:03.472052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-13244bb3-cd20-4f17-824e-2997e1a3b1c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:40:03.674585 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13244bb3-cd20-4f17-824e-2997e1a3b1c9 service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:40:03.861635 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229db0c-cabe-4384-a25a-b0538460e6a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:40:03.870619 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229db0c-cabe-4384-a25a-b0538460e6a0 service nova] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:40:03.871035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229db0c-cabe-4384-a25a-b0538460e6a0 service nova] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:40:03.871550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229db0c-cabe-4384-a25a-b0538460e6a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:40:03.876838 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-b229db0c-cabe-4384-a25a-b0538460e6a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:40:03.910203 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229db0c-cabe-4384-a25a-b0538460e6a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:40:03.912441 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229db0c-cabe-4384-a25a-b0538460e6a0 service nova] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:40:03.951112 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e1b8f-8131-494d-bd4e-842d3abd7551 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:40:03.952985 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e1b8f-8131-494d-bd4e-842d3abd7551 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:40:03.953467 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e1b8f-8131-494d-bd4e-842d3abd7551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:40:03.976361 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1189/2382] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:40:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:40:03.998874 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-7e3e1b8f-8131-494d-bd4e-842d3abd7551 None None] MFA Rules not processed for user `fde21f628031431583e085d26485451d`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:40:04.001644 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-7e3e1b8f-8131-494d-bd4e-842d3abd7551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:40:04.102100 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1194/2383] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:40:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:40:10.302773 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229db0c-cabe-4384-a25a-b0538460e6a0 service nova] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:40:10.304298 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-b229db0c-cabe-4384-a25a-b0538460e6a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:40:10.319370 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229db0c-cabe-4384-a25a-b0538460e6a0 service nova] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:40:10.325507 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a6771-b3d6-4c31-ba7d-44756188b106 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:40:10.326327 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a6771-b3d6-4c31-ba7d-44756188b106 service nova] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:40:10.326552 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a6771-b3d6-4c31-ba7d-44756188b106 service nova] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:40:10.326853 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a6771-b3d6-4c31-ba7d-44756188b106 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:40:10.331500 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-6f5a6771-b3d6-4c31-ba7d-44756188b106 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:40:10.345037 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a6771-b3d6-4c31-ba7d-44756188b106 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:40:10.346778 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a6771-b3d6-4c31-ba7d-44756188b106 service nova] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:40:10.357819 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1190/2384] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:40:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:40:16.636472 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46601d24-140a-41c3-b63f-247d233f8edd None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:40:16.637049 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46601d24-140a-41c3-b63f-247d233f8edd None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:40:16.637049 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46601d24-140a-41c3-b63f-247d233f8edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:40:16.657513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-46601d24-140a-41c3-b63f-247d233f8edd None None] MFA Rules not processed for user `bd41f419750140268f4d4b77456065c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:40:16.659489 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-46601d24-140a-41c3-b63f-247d233f8edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:40:16.716178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1195/2385] 10.222.0.60 () {58 vars in 967 bytes} [Thu May 12 09:40:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:40:16.729303 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a6771-b3d6-4c31-ba7d-44756188b106 service nova] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:40:16.730760 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-6f5a6771-b3d6-4c31-ba7d-44756188b106 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:40:16.803587 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a6771-b3d6-4c31-ba7d-44756188b106 service nova] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:40:16.809710 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d34bbb-acdd-4ce7-b182-380af85d54a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7693a31911346f9bb2c01efcd8e16e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:40:16.810865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d34bbb-acdd-4ce7-b182-380af85d54a0 service swift] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:40:16.811089 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d34bbb-acdd-4ce7-b182-380af85d54a0 service swift] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:40:16.811517 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d34bbb-acdd-4ce7-b182-380af85d54a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:40:16.822650 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d34bbb-acdd-4ce7-b182-380af85d54a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:40:16.824268 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d34bbb-acdd-4ce7-b182-380af85d54a0 service swift] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:40:16.834428 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1191/2386] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 12 09:40:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 09:40:17.259003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46601d24-140a-41c3-b63f-247d233f8edd None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:40:17.260950 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-46601d24-140a-41c3-b63f-247d233f8edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:40:17.323602 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46601d24-140a-41c3-b63f-247d233f8edd None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:40:17.328040 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51956380-cedf-4d3c-b207-da9a07bea455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:40:17.329278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51956380-cedf-4d3c-b207-da9a07bea455 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:40:17.329622 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51956380-cedf-4d3c-b207-da9a07bea455 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:40:17.331767 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51956380-cedf-4d3c-b207-da9a07bea455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:40:17.331975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-51956380-cedf-4d3c-b207-da9a07bea455 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:40:17.398382 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51956380-cedf-4d3c-b207-da9a07bea455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:40:17.400674 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51956380-cedf-4d3c-b207-da9a07bea455 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:40:17.414331 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1196/2387] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:40:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:40:24.112034 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d34bbb-acdd-4ce7-b182-380af85d54a0 service swift] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:40:24.113626 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-b6d34bbb-acdd-4ce7-b182-380af85d54a0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:40:24.130400 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d34bbb-acdd-4ce7-b182-380af85d54a0 service swift] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:40:24.135814 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c58425-384a-4557-9971-8aebb798d854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:40:24.136696 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c58425-384a-4557-9971-8aebb798d854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:40:24.136979 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c58425-384a-4557-9971-8aebb798d854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:40:24.137249 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c58425-384a-4557-9971-8aebb798d854 admin admin] PATH_INFO: `/v3/users/1174087be0a7412d8dbba6f4f56c3424` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:40:24.138515 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c58425-384a-4557-9971-8aebb798d854 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1174087be0a7412d8dbba6f4f56c3424)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:40:24.140926 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c58425-384a-4557-9971-8aebb798d854 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:40:24.193700 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-30c58425-384a-4557-9971-8aebb798d854 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1174087be0a7412d8dbba6f4f56c3424'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:40:24.205699 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-30c58425-384a-4557-9971-8aebb798d854 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1174087be0a7412d8dbba6f4f56c3424'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:40:24.206422 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-30c58425-384a-4557-9971-8aebb798d854 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1174087be0a7412d8dbba6f4f56c3424'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:40:24.213452 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-30c58425-384a-4557-9971-8aebb798d854 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1174087be0a7412d8dbba6f4f56c3424'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:40:24.220594 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-30c58425-384a-4557-9971-8aebb798d854 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1174087be0a7412d8dbba6f4f56c3424'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:40:24.226469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1192/2388] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:40:24 2022] DELETE /identity/v3/users/1174087be0a7412d8dbba6f4f56c3424 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:40:24.399064 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51956380-cedf-4d3c-b207-da9a07bea455 service neutron] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:40:24.409773 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51956380-cedf-4d3c-b207-da9a07bea455 service neutron] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:40:24.465833 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762945c-8b0a-4ca4-b168-abaec6506a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:40:24.466372 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762945c-8b0a-4ca4-b168-abaec6506a64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:40:24.466680 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762945c-8b0a-4ca4-b168-abaec6506a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:40:24.466909 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762945c-8b0a-4ca4-b168-abaec6506a64 admin admin] PATH_INFO: `/v3/projects/bdc48145acde413e99299f029ad0cea9` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:40:24.468173 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762945c-8b0a-4ca4-b168-abaec6506a64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdc48145acde413e99299f029ad0cea9)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:40:24.470744 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762945c-8b0a-4ca4-b168-abaec6506a64 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:40:24.516024 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-a762945c-8b0a-4ca4-b168-abaec6506a64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdc48145acde413e99299f029ad0cea9', 'request_id': 'req-a762945c-8b0a-4ca4-b168-abaec6506a64'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:40:24.521263 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-a762945c-8b0a-4ca4-b168-abaec6506a64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdc48145acde413e99299f029ad0cea9', 'request_id': 'req-a762945c-8b0a-4ca4-b168-abaec6506a64'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:40:24.528968 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-a762945c-8b0a-4ca4-b168-abaec6506a64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdc48145acde413e99299f029ad0cea9', 'request_id': 'req-a762945c-8b0a-4ca4-b168-abaec6506a64'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:40:24.540032 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-a762945c-8b0a-4ca4-b168-abaec6506a64 admin admin] The token cache is being invalidate because project bdc48145acde413e99299f029ad0cea9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:40:24.540309 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-a762945c-8b0a-4ca4-b168-abaec6506a64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:40:24.540920 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-a762945c-8b0a-4ca4-b168-abaec6506a64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:40:24.542482 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1197/2389] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:40:24 2022] DELETE /identity/v3/projects/bdc48145acde413e99299f029ad0cea9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:40:24.546435 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c58425-384a-4557-9971-8aebb798d854 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:40:24.548440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-30c58425-384a-4557-9971-8aebb798d854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:40:24.561479 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c58425-384a-4557-9971-8aebb798d854 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:40:24.614518 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5f8dd-7c88-44a0-9b27-0e9293238e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:40:24.615391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5f8dd-7c88-44a0-9b27-0e9293238e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:40:24.615671 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5f8dd-7c88-44a0-9b27-0e9293238e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:40:24.615945 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5f8dd-7c88-44a0-9b27-0e9293238e40 admin admin] PATH_INFO: `/v3/users/923b1ab49fd74a94b664583a4d713b06` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:40:24.617114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5f8dd-7c88-44a0-9b27-0e9293238e40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=923b1ab49fd74a94b664583a4d713b06)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:40:24.619055 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5f8dd-7c88-44a0-9b27-0e9293238e40 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:40:24.662261 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-afc5f8dd-7c88-44a0-9b27-0e9293238e40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '923b1ab49fd74a94b664583a4d713b06'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:40:24.674023 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-afc5f8dd-7c88-44a0-9b27-0e9293238e40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '923b1ab49fd74a94b664583a4d713b06'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:40:24.674676 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-afc5f8dd-7c88-44a0-9b27-0e9293238e40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '923b1ab49fd74a94b664583a4d713b06'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:40:24.681389 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-afc5f8dd-7c88-44a0-9b27-0e9293238e40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '923b1ab49fd74a94b664583a4d713b06'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:40:24.688297 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-afc5f8dd-7c88-44a0-9b27-0e9293238e40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '923b1ab49fd74a94b664583a4d713b06'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:40:24.694071 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1193/2390] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:40:24 2022] DELETE /identity/v3/users/923b1ab49fd74a94b664583a4d713b06 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:40:24.863497 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762945c-8b0a-4ca4-b168-abaec6506a64 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:40:24.864829 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-a762945c-8b0a-4ca4-b168-abaec6506a64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:40:24.892784 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762945c-8b0a-4ca4-b168-abaec6506a64 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:40:24.949117 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026a32c-a343-48f6-9eeb-32012e4f8023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:40:24.950009 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026a32c-a343-48f6-9eeb-32012e4f8023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:40:24.950292 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026a32c-a343-48f6-9eeb-32012e4f8023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:40:24.950566 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026a32c-a343-48f6-9eeb-32012e4f8023 admin admin] PATH_INFO: `/v3/projects/328818592443490ba5be8d13f0adba97` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:40:24.951745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026a32c-a343-48f6-9eeb-32012e4f8023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=328818592443490ba5be8d13f0adba97)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:40:24.954219 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026a32c-a343-48f6-9eeb-32012e4f8023 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:40:25.001524 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-6026a32c-a343-48f6-9eeb-32012e4f8023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '328818592443490ba5be8d13f0adba97', 'request_id': 'req-6026a32c-a343-48f6-9eeb-32012e4f8023'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:40:25.006633 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-6026a32c-a343-48f6-9eeb-32012e4f8023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '328818592443490ba5be8d13f0adba97', 'request_id': 'req-6026a32c-a343-48f6-9eeb-32012e4f8023'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:40:25.013679 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-6026a32c-a343-48f6-9eeb-32012e4f8023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '328818592443490ba5be8d13f0adba97', 'request_id': 'req-6026a32c-a343-48f6-9eeb-32012e4f8023'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:40:25.025099 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-6026a32c-a343-48f6-9eeb-32012e4f8023 admin admin] The token cache is being invalidate because project 328818592443490ba5be8d13f0adba97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:40:25.025320 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-6026a32c-a343-48f6-9eeb-32012e4f8023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:40:25.025968 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-6026a32c-a343-48f6-9eeb-32012e4f8023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:40:25.027538 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1198/2391] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:40:24 2022] DELETE /identity/v3/projects/328818592443490ba5be8d13f0adba97 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:40:31.393032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5f8dd-7c88-44a0-9b27-0e9293238e40 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:40:31.394468 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-afc5f8dd-7c88-44a0-9b27-0e9293238e40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:40:31.451175 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5f8dd-7c88-44a0-9b27-0e9293238e40 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:40:31.497883 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ec3b1-1244-42e0-b7f8-1b829a5f7a25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:40:31.498567 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ec3b1-1244-42e0-b7f8-1b829a5f7a25 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:40:31.498851 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ec3b1-1244-42e0-b7f8-1b829a5f7a25 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:40:31.499128 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ec3b1-1244-42e0-b7f8-1b829a5f7a25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:40:31.501470 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-694ec3b1-1244-42e0-b7f8-1b829a5f7a25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:40:31.510703 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ec3b1-1244-42e0-b7f8-1b829a5f7a25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:40:31.512120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ec3b1-1244-42e0-b7f8-1b829a5f7a25 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:40:31.519883 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1194/2392] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:40:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:40:50.651677 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026a32c-a343-48f6-9eeb-32012e4f8023 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:40:50.653083 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-6026a32c-a343-48f6-9eeb-32012e4f8023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:40:50.665145 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026a32c-a343-48f6-9eeb-32012e4f8023 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:40:50.668676 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e61b64-489d-4f90-aaf1-4d589d230bb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:40:50.669306 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e61b64-489d-4f90-aaf1-4d589d230bb7 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:40:50.669587 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e61b64-489d-4f90-aaf1-4d589d230bb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:40:50.669862 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e61b64-489d-4f90-aaf1-4d589d230bb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:40:50.671582 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-28e61b64-489d-4f90-aaf1-4d589d230bb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:40:50.734293 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e61b64-489d-4f90-aaf1-4d589d230bb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:40:50.735731 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e61b64-489d-4f90-aaf1-4d589d230bb7 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:40:50.745622 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1199/2393] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:40:50 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:41:03.828303 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ec3b1-1244-42e0-b7f8-1b829a5f7a25 service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:41:03.830318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-694ec3b1-1244-42e0-b7f8-1b829a5f7a25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:41:03.901196 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ec3b1-1244-42e0-b7f8-1b829a5f7a25 service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:41:03.906471 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bafb7b-497b-44d2-ab7c-62b4091d6474 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:41:03.907119 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bafb7b-497b-44d2-ab7c-62b4091d6474 service nova] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:41:03.907398 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bafb7b-497b-44d2-ab7c-62b4091d6474 service nova] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:41:03.907672 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bafb7b-497b-44d2-ab7c-62b4091d6474 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:41:03.909383 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-c0bafb7b-497b-44d2-ab7c-62b4091d6474 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:41:03.965352 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bafb7b-497b-44d2-ab7c-62b4091d6474 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:41:03.966965 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bafb7b-497b-44d2-ab7c-62b4091d6474 service nova] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:41:03.975794 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1195/2394] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:41:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:41:27.224340 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb474d16-08e1-4bde-a779-b5093bdd3fcb None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:41:27.224881 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb474d16-08e1-4bde-a779-b5093bdd3fcb None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:41:27.225020 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb474d16-08e1-4bde-a779-b5093bdd3fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:41:27.241930 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-eb474d16-08e1-4bde-a779-b5093bdd3fcb None None] MFA Rules not processed for user `0b01be56426e4ff1a09577f30fb79f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:41:27.243105 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-eb474d16-08e1-4bde-a779-b5093bdd3fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:41:27.249846 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1200/2395] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:41:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:42:16.521472 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642651c-9d72-4863-84ee-354d258255b8 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:42:16.522030 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642651c-9d72-4863-84ee-354d258255b8 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:42:16.522142 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642651c-9d72-4863-84ee-354d258255b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:42:16.539729 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-6642651c-9d72-4863-84ee-354d258255b8 None None] MFA Rules not processed for user `6c8297034cfa40438000e7d94419a429`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:42:16.540911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-6642651c-9d72-4863-84ee-354d258255b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:42:16.595302 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1196/2396] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:42:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:42:17.611756 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb474d16-08e1-4bde-a779-b5093bdd3fcb None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:42:17.613162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-eb474d16-08e1-4bde-a779-b5093bdd3fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:42:17.680823 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb474d16-08e1-4bde-a779-b5093bdd3fcb None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:42:17.685793 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435ec2f-ed40-449d-83d3-f94b21344059 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525f4699878f461e82f7f06ef60c176a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:42:17.687096 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435ec2f-ed40-449d-83d3-f94b21344059 service placement] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:42:17.687377 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435ec2f-ed40-449d-83d3-f94b21344059 service placement] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:42:17.687649 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435ec2f-ed40-449d-83d3-f94b21344059 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:42:17.689390 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-1435ec2f-ed40-449d-83d3-f94b21344059 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:42:17.700491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435ec2f-ed40-449d-83d3-f94b21344059 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:42:17.702091 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435ec2f-ed40-449d-83d3-f94b21344059 service placement] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:42:17.712404 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1201/2397] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:42:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:43:00.165630 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf27ce-25be-4ccd-8b4a-e61e47f7ffe0 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:43:00.166297 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf27ce-25be-4ccd-8b4a-e61e47f7ffe0 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:43:00.166297 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf27ce-25be-4ccd-8b4a-e61e47f7ffe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:43:00.187173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-aebf27ce-25be-4ccd-8b4a-e61e47f7ffe0 None None] MFA Rules not processed for user `2efdff1c390f4271963e932af8abd473`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:43:00.188505 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-aebf27ce-25be-4ccd-8b4a-e61e47f7ffe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:43:00.242835 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1197/2398] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:43:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:43:09.599523 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435ec2f-ed40-449d-83d3-f94b21344059 service placement] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:43:09.608568 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435ec2f-ed40-449d-83d3-f94b21344059 service placement] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:43:09.612678 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810e79d-e864-431b-9c00-7a8d966577ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:43:09.613324 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810e79d-e864-431b-9c00-7a8d966577ed service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:43:09.613610 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810e79d-e864-431b-9c00-7a8d966577ed service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:43:09.613886 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810e79d-e864-431b-9c00-7a8d966577ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:43:09.616678 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-9810e79d-e864-431b-9c00-7a8d966577ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:43:09.682557 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9810e79d-e864-431b-9c00-7a8d966577ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:43:09.684014 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9810e79d-e864-431b-9c00-7a8d966577ed service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:43:09.695006 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1202/2399] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:43:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:43:13.524701 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf27ce-25be-4ccd-8b4a-e61e47f7ffe0 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:43:13.526891 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-aebf27ce-25be-4ccd-8b4a-e61e47f7ffe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:43:13.547554 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf27ce-25be-4ccd-8b4a-e61e47f7ffe0 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:43:13.558724 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b52b2-ed25-4754-a9a7-e591488afd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:43:13.559886 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b52b2-ed25-4754-a9a7-e591488afd54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:43:13.560167 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b52b2-ed25-4754-a9a7-e591488afd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:43:13.560441 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b52b2-ed25-4754-a9a7-e591488afd54 admin admin] PATH_INFO: `/v3/users/0b01be56426e4ff1a09577f30fb79f0b` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:43:13.561678 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b52b2-ed25-4754-a9a7-e591488afd54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b01be56426e4ff1a09577f30fb79f0b)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:43:13.563702 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b52b2-ed25-4754-a9a7-e591488afd54 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:43:13.623599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-f70b52b2-ed25-4754-a9a7-e591488afd54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b01be56426e4ff1a09577f30fb79f0b'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:43:13.636154 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-f70b52b2-ed25-4754-a9a7-e591488afd54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b01be56426e4ff1a09577f30fb79f0b'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:43:13.636877 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-f70b52b2-ed25-4754-a9a7-e591488afd54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b01be56426e4ff1a09577f30fb79f0b'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:43:13.645486 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-f70b52b2-ed25-4754-a9a7-e591488afd54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b01be56426e4ff1a09577f30fb79f0b'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:43:13.654378 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-f70b52b2-ed25-4754-a9a7-e591488afd54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b01be56426e4ff1a09577f30fb79f0b'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:43:13.662193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1198/2400] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:43:13 2022] DELETE /identity/v3/users/0b01be56426e4ff1a09577f30fb79f0b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:43:13.852130 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810e79d-e864-431b-9c00-7a8d966577ed service neutron] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:43:13.863030 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810e79d-e864-431b-9c00-7a8d966577ed service neutron] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:43:13.936814 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f983b6-7dfa-4c6c-b718-ea597df78665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:43:13.937693 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f983b6-7dfa-4c6c-b718-ea597df78665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:43:13.938011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f983b6-7dfa-4c6c-b718-ea597df78665 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:43:13.938283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f983b6-7dfa-4c6c-b718-ea597df78665 admin admin] PATH_INFO: `/v3/projects/c54669eadc784d4aac5d1a40d18858b1` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:43:13.939570 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f983b6-7dfa-4c6c-b718-ea597df78665 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c54669eadc784d4aac5d1a40d18858b1)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:43:13.942139 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f983b6-7dfa-4c6c-b718-ea597df78665 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:43:13.988619 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-44f983b6-7dfa-4c6c-b718-ea597df78665 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c54669eadc784d4aac5d1a40d18858b1', 'request_id': 'req-44f983b6-7dfa-4c6c-b718-ea597df78665'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:43:13.993886 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-44f983b6-7dfa-4c6c-b718-ea597df78665 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c54669eadc784d4aac5d1a40d18858b1', 'request_id': 'req-44f983b6-7dfa-4c6c-b718-ea597df78665'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:43:14.001688 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-44f983b6-7dfa-4c6c-b718-ea597df78665 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c54669eadc784d4aac5d1a40d18858b1', 'request_id': 'req-44f983b6-7dfa-4c6c-b718-ea597df78665'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:43:14.013890 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-44f983b6-7dfa-4c6c-b718-ea597df78665 admin admin] The token cache is being invalidate because project c54669eadc784d4aac5d1a40d18858b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:43:14.014260 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-44f983b6-7dfa-4c6c-b718-ea597df78665 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:43:14.014885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-44f983b6-7dfa-4c6c-b718-ea597df78665 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:43:14.016441 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1203/2401] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:43:13 2022] DELETE /identity/v3/projects/c54669eadc784d4aac5d1a40d18858b1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:43:14.021459 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a351a-bdcd-4a35-8f41-81b57b842bb0 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:43:14.021757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a351a-bdcd-4a35-8f41-81b57b842bb0 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:43:14.022064 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a351a-bdcd-4a35-8f41-81b57b842bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:43:14.040697 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-6d2a351a-bdcd-4a35-8f41-81b57b842bb0 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:43:14.041951 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-6d2a351a-bdcd-4a35-8f41-81b57b842bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:43:14.103931 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1199/2402] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:43:14.111419 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec5216-4b49-420b-a8b0-9df8b662d6eb None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:43:14.111710 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec5216-4b49-420b-a8b0-9df8b662d6eb None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:43:14.112520 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec5216-4b49-420b-a8b0-9df8b662d6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:43:14.131327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-12ec5216-4b49-420b-a8b0-9df8b662d6eb None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:43:14.132435 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-12ec5216-4b49-420b-a8b0-9df8b662d6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:43:14.140783 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1204/2403] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:43:14.145036 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a351a-bdcd-4a35-8f41-81b57b842bb0 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:43:14.154747 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a351a-bdcd-4a35-8f41-81b57b842bb0 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:43:14.159443 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbf00d-6217-4e65-bb65-c3a0bd859ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:43:14.160095 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbf00d-6217-4e65-bb65-c3a0bd859ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:43:14.160374 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbf00d-6217-4e65-bb65-c3a0bd859ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:43:14.160646 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbf00d-6217-4e65-bb65-c3a0bd859ea6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:43:14.161365 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbf00d-6217-4e65-bb65-c3a0bd859ea6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:43:14.161666 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbf00d-6217-4e65-bb65-c3a0bd859ea6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:43:14.163318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbf00d-6217-4e65-bb65-c3a0bd859ea6 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:43:14.175402 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1200/2404] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:43:14.179688 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec5216-4b49-420b-a8b0-9df8b662d6eb None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:43:14.196121 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec5216-4b49-420b-a8b0-9df8b662d6eb None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:43:14.200821 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee3b3c-58ab-4a2c-9d81-7244bdae4f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:43:14.201484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee3b3c-58ab-4a2c-9d81-7244bdae4f1c admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:43:14.201770 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee3b3c-58ab-4a2c-9d81-7244bdae4f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:43:14.202073 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee3b3c-58ab-4a2c-9d81-7244bdae4f1c admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:43:14.202771 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee3b3c-58ab-4a2c-9d81-7244bdae4f1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:43:14.204675 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee3b3c-58ab-4a2c-9d81-7244bdae4f1c admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:43:14.242871 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1205/2405] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:43:14 2022] POST /identity/v3/projects => generated 389 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:43:14.247119 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbf00d-6217-4e65-bb65-c3a0bd859ea6 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:43:14.258297 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbf00d-6217-4e65-bb65-c3a0bd859ea6 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:43:14.311847 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1252bd-b5af-4457-8168-b6596b567a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:43:14.312508 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1252bd-b5af-4457-8168-b6596b567a00 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:43:14.312789 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1252bd-b5af-4457-8168-b6596b567a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:43:14.313058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1252bd-b5af-4457-8168-b6596b567a00 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:43:14.313725 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1252bd-b5af-4457-8168-b6596b567a00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:43:14.316295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1252bd-b5af-4457-8168-b6596b567a00 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:43:14.334742 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1201/2406] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:43:14 2022] POST /identity/v3/users => generated 295 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:43:14.338923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee3b3c-58ab-4a2c-9d81-7244bdae4f1c admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:43:14.349376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee3b3c-58ab-4a2c-9d81-7244bdae4f1c admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:43:14.353933 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570d64a-91d8-441c-8d05-36135912ae36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:43:14.354587 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570d64a-91d8-441c-8d05-36135912ae36 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:43:14.354862 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570d64a-91d8-441c-8d05-36135912ae36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:43:14.355130 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570d64a-91d8-441c-8d05-36135912ae36 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:43:14.355879 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570d64a-91d8-441c-8d05-36135912ae36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:43:14.357460 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570d64a-91d8-441c-8d05-36135912ae36 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:43:14.367541 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1206/2407] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:43:14.371298 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1252bd-b5af-4457-8168-b6596b567a00 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:43:14.381152 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1252bd-b5af-4457-8168-b6596b567a00 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:43:14.386124 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa462207-2a8c-48a7-900e-5765098b340d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:43:14.386713 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa462207-2a8c-48a7-900e-5765098b340d admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:43:14.386993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa462207-2a8c-48a7-900e-5765098b340d admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:43:14.387264 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa462207-2a8c-48a7-900e-5765098b340d admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:43:14.387975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa462207-2a8c-48a7-900e-5765098b340d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:43:14.389576 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa462207-2a8c-48a7-900e-5765098b340d admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:43:14.399768 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1202/2408] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:43:14.403979 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570d64a-91d8-441c-8d05-36135912ae36 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:43:14.414261 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570d64a-91d8-441c-8d05-36135912ae36 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:43:14.418777 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857af6b7-8272-4aa7-8c20-21eb6d15ba47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:43:14.419634 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857af6b7-8272-4aa7-8c20-21eb6d15ba47 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:43:14.419908 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857af6b7-8272-4aa7-8c20-21eb6d15ba47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:43:14.420176 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857af6b7-8272-4aa7-8c20-21eb6d15ba47 admin admin] PATH_INFO: `/v3/projects/b879e240eb4f48139e28cc43223b21da/users/f739359acd844279aa56ef7d69f4c299/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:43:14.434612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857af6b7-8272-4aa7-8c20-21eb6d15ba47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b879e240eb4f48139e28cc43223b21da, user_id=f739359acd844279aa56ef7d69f4c299, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:43:14.437222 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857af6b7-8272-4aa7-8c20-21eb6d15ba47 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:43:14.450185 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1207/2409] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:43:14 2022] PUT /identity/v3/projects/b879e240eb4f48139e28cc43223b21da/users/f739359acd844279aa56ef7d69f4c299/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:43:14.455148 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b5654-1f61-4c02-88f0-6aacdf230b64 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:43:14.455440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b5654-1f61-4c02-88f0-6aacdf230b64 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:43:14.455715 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b5654-1f61-4c02-88f0-6aacdf230b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:43:14.473249 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-be8b5654-1f61-4c02-88f0-6aacdf230b64 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:43:14.474468 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-be8b5654-1f61-4c02-88f0-6aacdf230b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:43:14.531183 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1203/2410] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:43:14.541036 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857af6b7-8272-4aa7-8c20-21eb6d15ba47 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:43:14.542727 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-857af6b7-8272-4aa7-8c20-21eb6d15ba47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:43:14.596959 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857af6b7-8272-4aa7-8c20-21eb6d15ba47 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:43:14.600552 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31006c3f-fa69-40e8-9e8d-d0c9e20345c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:43:14.601179 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31006c3f-fa69-40e8-9e8d-d0c9e20345c3 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:43:14.601457 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31006c3f-fa69-40e8-9e8d-d0c9e20345c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:43:14.601726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31006c3f-fa69-40e8-9e8d-d0c9e20345c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:43:14.610885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31006c3f-fa69-40e8-9e8d-d0c9e20345c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:43:14.612860 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31006c3f-fa69-40e8-9e8d-d0c9e20345c3 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:43:14.622054 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1208/2411] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:43:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:43:18.802616 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa439f8-5023-4c68-b823-6a74ecfc85e9 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:43:18.803119 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa439f8-5023-4c68-b823-6a74ecfc85e9 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:43:18.803249 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa439f8-5023-4c68-b823-6a74ecfc85e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:43:18.830885 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-cfa439f8-5023-4c68-b823-6a74ecfc85e9 None None] MFA Rules not processed for user `f739359acd844279aa56ef7d69f4c299`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:43:18.832648 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-cfa439f8-5023-4c68-b823-6a74ecfc85e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:43:18.903714 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1204/2412] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:43:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:43:18.918205 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31006c3f-fa69-40e8-9e8d-d0c9e20345c3 service neutron] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:43:18.919619 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-31006c3f-fa69-40e8-9e8d-d0c9e20345c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:43:19.008470 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31006c3f-fa69-40e8-9e8d-d0c9e20345c3 service neutron] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:43:19.014173 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde0104-4a3a-424d-818a-a28992025220 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:43:19.015036 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde0104-4a3a-424d-818a-a28992025220 service nova] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:43:19.015318 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde0104-4a3a-424d-818a-a28992025220 service nova] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:43:19.016765 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde0104-4a3a-424d-818a-a28992025220 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:43:19.025757 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde0104-4a3a-424d-818a-a28992025220 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:43:19.027286 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde0104-4a3a-424d-818a-a28992025220 service nova] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:43:19.039210 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1209/2413] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:43:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:43:20.615252 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12d480-f053-432e-8406-1f4cedb286c3 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:43:20.615787 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12d480-f053-432e-8406-1f4cedb286c3 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:43:20.615787 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12d480-f053-432e-8406-1f4cedb286c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:43:20.633442 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-8c12d480-f053-432e-8406-1f4cedb286c3 None None] MFA Rules not processed for user `f739359acd844279aa56ef7d69f4c299`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:43:20.634668 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-8c12d480-f053-432e-8406-1f4cedb286c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:43:20.642532 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1205/2414] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:43:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:43:49.777171 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd57ac-569a-447d-b995-4104e04844da None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:43:49.777821 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd57ac-569a-447d-b995-4104e04844da None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:43:49.777821 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd57ac-569a-447d-b995-4104e04844da None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:43:49.779336 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1210/2415] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 12 09:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:43:49.785879 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bb8ee-288e-4e6e-bafa-a2a14491a3b7 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:43:49.786394 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bb8ee-288e-4e6e-bafa-a2a14491a3b7 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:43:49.786687 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bb8ee-288e-4e6e-bafa-a2a14491a3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:43:49.805088 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-973bb8ee-288e-4e6e-bafa-a2a14491a3b7 None None] MFA Rules not processed for user `bf7b793f84bd4a72a68d5ab65221e1a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:43:49.806384 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-973bb8ee-288e-4e6e-bafa-a2a14491a3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:43:49.813255 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1206/2416] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 12 09:43:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:43:49.826835 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd57ac-569a-447d-b995-4104e04844da None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:43:49.838852 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd57ac-569a-447d-b995-4104e04844da None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:43:49.842653 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c550693-097d-4907-80bd-167f15cc9f79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:43:49.843368 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c550693-097d-4907-80bd-167f15cc9f79 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:43:49.843800 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c550693-097d-4907-80bd-167f15cc9f79 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:43:49.844042 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c550693-097d-4907-80bd-167f15cc9f79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:43:49.852008 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c550693-097d-4907-80bd-167f15cc9f79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:43:49.853446 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c550693-097d-4907-80bd-167f15cc9f79 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:43:49.862522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1211/2417] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:43:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:43:49.950509 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0deec-63d1-41a9-90d4-e335b28aab11 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:43:49.950797 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0deec-63d1-41a9-90d4-e335b28aab11 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:43:49.951068 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0deec-63d1-41a9-90d4-e335b28aab11 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:43:49.952477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1207/2418] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 12 09:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:43:49.957289 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945a003-30ea-40f6-a8f3-151d39d2abbc None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:43:49.957578 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945a003-30ea-40f6-a8f3-151d39d2abbc None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:43:49.957853 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945a003-30ea-40f6-a8f3-151d39d2abbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:43:49.993178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-b945a003-30ea-40f6-a8f3-151d39d2abbc None None] MFA Rules not processed for user `2915babd40aa42e8bf7cc85c5a97daa6`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:43:49.994330 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-b945a003-30ea-40f6-a8f3-151d39d2abbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:43:50.003983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1212/2419] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 12 09:43:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:43:50.014515 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0deec-63d1-41a9-90d4-e335b28aab11 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:43:50.024964 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0deec-63d1-41a9-90d4-e335b28aab11 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:43:50.028502 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409ba31-4d69-48f4-9247-2d2901ffaf1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:43:50.029126 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409ba31-4d69-48f4-9247-2d2901ffaf1f service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:43:50.029405 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409ba31-4d69-48f4-9247-2d2901ffaf1f service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:43:50.029677 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409ba31-4d69-48f4-9247-2d2901ffaf1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:43:50.039511 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409ba31-4d69-48f4-9247-2d2901ffaf1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:43:50.040920 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409ba31-4d69-48f4-9247-2d2901ffaf1f service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:43:50.051775 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1208/2420] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:43:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:44:01.568291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945a003-30ea-40f6-a8f3-151d39d2abbc None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:44:01.569751 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-b945a003-30ea-40f6-a8f3-151d39d2abbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:44:01.581871 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945a003-30ea-40f6-a8f3-151d39d2abbc None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:44:01.585475 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e120f0-148a-42db-8689-6a63b32375cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:44:01.586266 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e120f0-148a-42db-8689-6a63b32375cc service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:44:01.586548 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e120f0-148a-42db-8689-6a63b32375cc service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:44:01.586971 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e120f0-148a-42db-8689-6a63b32375cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:44:01.589014 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-87e120f0-148a-42db-8689-6a63b32375cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:44:01.611518 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e120f0-148a-42db-8689-6a63b32375cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:44:01.613024 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e120f0-148a-42db-8689-6a63b32375cc service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:44:01.624884 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1213/2421] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:44:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:44:11.558939 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bc4fd-ffb2-4e4b-8365-3264d5934020 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:44:11.559447 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bc4fd-ffb2-4e4b-8365-3264d5934020 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:44:11.559561 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bc4fd-ffb2-4e4b-8365-3264d5934020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:44:11.604675 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-0f4bc4fd-ffb2-4e4b-8365-3264d5934020 None None] MFA Rules not processed for user `6c8297034cfa40438000e7d94419a429`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:44:11.605880 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-0f4bc4fd-ffb2-4e4b-8365-3264d5934020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:44:11.669480 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1209/2422] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:44:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:44:12.276583 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e120f0-148a-42db-8689-6a63b32375cc service neutron] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:44:12.277548 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bc4fd-ffb2-4e4b-8365-3264d5934020 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:44:12.278094 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-87e120f0-148a-42db-8689-6a63b32375cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:44:12.287681 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bc4fd-ffb2-4e4b-8365-3264d5934020 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:44:12.291405 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757947f-c485-46c3-b19f-d7a64305b042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:44:12.292078 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757947f-c485-46c3-b19f-d7a64305b042 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:44:12.292358 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757947f-c485-46c3-b19f-d7a64305b042 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:44:12.292627 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757947f-c485-46c3-b19f-d7a64305b042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:44:12.294386 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-e757947f-c485-46c3-b19f-d7a64305b042 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:44:12.307814 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757947f-c485-46c3-b19f-d7a64305b042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:44:12.309193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757947f-c485-46c3-b19f-d7a64305b042 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:44:12.320088 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1210/2423] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:44:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 09:44:12.346426 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e120f0-148a-42db-8689-6a63b32375cc service neutron] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:44:12.351562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542361f-45ac-4d22-8ca6-c4b6e4663754 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525f4699878f461e82f7f06ef60c176a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:44:12.352215 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542361f-45ac-4d22-8ca6-c4b6e4663754 service placement] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:44:12.352497 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542361f-45ac-4d22-8ca6-c4b6e4663754 service placement] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:44:12.352770 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542361f-45ac-4d22-8ca6-c4b6e4663754 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:44:12.354692 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-b542361f-45ac-4d22-8ca6-c4b6e4663754 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:44:12.366353 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b542361f-45ac-4d22-8ca6-c4b6e4663754 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:44:12.368078 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b542361f-45ac-4d22-8ca6-c4b6e4663754 service placement] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:44:12.377828 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1214/2424] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:44:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:44:17.988524 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757947f-c485-46c3-b19f-d7a64305b042 service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:44:17.999121 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757947f-c485-46c3-b19f-d7a64305b042 service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:44:18.003347 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a6dc9-27d4-45c9-9208-a5887002b7b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:44:18.003997 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a6dc9-27d4-45c9-9208-a5887002b7b1 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:44:18.004277 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a6dc9-27d4-45c9-9208-a5887002b7b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:44:18.004549 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a6dc9-27d4-45c9-9208-a5887002b7b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:44:18.006352 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-011a6dc9-27d4-45c9-9208-a5887002b7b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:44:18.016051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a6dc9-27d4-45c9-9208-a5887002b7b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:44:18.018057 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a6dc9-27d4-45c9-9208-a5887002b7b1 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:44:18.025801 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1211/2425] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:44:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:44:46.816693 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542361f-45ac-4d22-8ca6-c4b6e4663754 service placement] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:44:46.828703 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542361f-45ac-4d22-8ca6-c4b6e4663754 service placement] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:44:46.834108 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9d492-666e-4ca8-a04b-7e41af5fda0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:44:46.834739 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9d492-666e-4ca8-a04b-7e41af5fda0c service nova] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:44:46.835018 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9d492-666e-4ca8-a04b-7e41af5fda0c service nova] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:44:46.835311 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9d492-666e-4ca8-a04b-7e41af5fda0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:44:46.837021 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-5be9d492-666e-4ca8-a04b-7e41af5fda0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:44:46.913973 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be9d492-666e-4ca8-a04b-7e41af5fda0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:44:46.915557 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be9d492-666e-4ca8-a04b-7e41af5fda0c service nova] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:44:46.933476 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1215/2426] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:44:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:45:12.808632 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a6dc9-27d4-45c9-9208-a5887002b7b1 service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:12.823184 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a6dc9-27d4-45c9-9208-a5887002b7b1 service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:12.845685 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f4162-62d2-4e5a-8b97-cbb29859369c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:12.847027 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f4162-62d2-4e5a-8b97-cbb29859369c service nova] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:12.847322 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f4162-62d2-4e5a-8b97-cbb29859369c service nova] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:12.847602 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f4162-62d2-4e5a-8b97-cbb29859369c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:12.849945 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-fa4f4162-62d2-4e5a-8b97-cbb29859369c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:12.876260 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4f4162-62d2-4e5a-8b97-cbb29859369c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:12.878301 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4f4162-62d2-4e5a-8b97-cbb29859369c service nova] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:12.892236 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1212/2427] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:45:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:45:18.145399 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9d492-666e-4ca8-a04b-7e41af5fda0c service nova] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:18.154484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9d492-666e-4ca8-a04b-7e41af5fda0c service nova] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:18.158321 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2414d1c-c471-410b-ad85-2cd10520c85c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:18.158983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2414d1c-c471-410b-ad85-2cd10520c85c service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:18.159262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2414d1c-c471-410b-ad85-2cd10520c85c service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:18.160068 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2414d1c-c471-410b-ad85-2cd10520c85c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:18.162360 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-e2414d1c-c471-410b-ad85-2cd10520c85c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:18.175916 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2414d1c-c471-410b-ad85-2cd10520c85c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:18.177372 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2414d1c-c471-410b-ad85-2cd10520c85c service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:18.189125 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1216/2428] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:45:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:45:21.550157 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f4162-62d2-4e5a-8b97-cbb29859369c service nova] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:21.553529 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-fa4f4162-62d2-4e5a-8b97-cbb29859369c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:21.575450 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f4162-62d2-4e5a-8b97-cbb29859369c service nova] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:21.580207 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba116dc-69e4-437c-a33d-8379d4e5bd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:21.581098 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba116dc-69e4-437c-a33d-8379d4e5bd75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:21.581929 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba116dc-69e4-437c-a33d-8379d4e5bd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:21.582246 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba116dc-69e4-437c-a33d-8379d4e5bd75 admin admin] PATH_INFO: `/v3/users/2efdff1c390f4271963e932af8abd473` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:21.583468 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba116dc-69e4-437c-a33d-8379d4e5bd75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2efdff1c390f4271963e932af8abd473)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:21.585394 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba116dc-69e4-437c-a33d-8379d4e5bd75 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:21.652607 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-4ba116dc-69e4-437c-a33d-8379d4e5bd75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2efdff1c390f4271963e932af8abd473'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:21.664366 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-4ba116dc-69e4-437c-a33d-8379d4e5bd75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2efdff1c390f4271963e932af8abd473'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:21.665063 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-4ba116dc-69e4-437c-a33d-8379d4e5bd75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2efdff1c390f4271963e932af8abd473'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:21.674010 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-4ba116dc-69e4-437c-a33d-8379d4e5bd75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2efdff1c390f4271963e932af8abd473'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:21.681647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-4ba116dc-69e4-437c-a33d-8379d4e5bd75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2efdff1c390f4271963e932af8abd473'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:21.687399 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1213/2429] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:45:21 2022] DELETE /identity/v3/users/2efdff1c390f4271963e932af8abd473 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:45:21.857394 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2414d1c-c471-410b-ad85-2cd10520c85c service neutron] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:21.873592 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2414d1c-c471-410b-ad85-2cd10520c85c service neutron] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:21.932449 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30005ae7-0334-4595-8a1a-cd02fa222e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:21.933315 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30005ae7-0334-4595-8a1a-cd02fa222e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:21.933597 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30005ae7-0334-4595-8a1a-cd02fa222e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:21.933869 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30005ae7-0334-4595-8a1a-cd02fa222e5c admin admin] PATH_INFO: `/v3/projects/da5b9f41ad6b4506872df6cb86ae9f73` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:21.935090 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30005ae7-0334-4595-8a1a-cd02fa222e5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=da5b9f41ad6b4506872df6cb86ae9f73)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:21.936991 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30005ae7-0334-4595-8a1a-cd02fa222e5c admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:21.983389 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-30005ae7-0334-4595-8a1a-cd02fa222e5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da5b9f41ad6b4506872df6cb86ae9f73', 'request_id': 'req-30005ae7-0334-4595-8a1a-cd02fa222e5c'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:21.991928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-30005ae7-0334-4595-8a1a-cd02fa222e5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da5b9f41ad6b4506872df6cb86ae9f73', 'request_id': 'req-30005ae7-0334-4595-8a1a-cd02fa222e5c'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:22.000278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-30005ae7-0334-4595-8a1a-cd02fa222e5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da5b9f41ad6b4506872df6cb86ae9f73', 'request_id': 'req-30005ae7-0334-4595-8a1a-cd02fa222e5c'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:22.012351 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-30005ae7-0334-4595-8a1a-cd02fa222e5c admin admin] The token cache is being invalidate because project da5b9f41ad6b4506872df6cb86ae9f73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:45:22.012634 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-30005ae7-0334-4595-8a1a-cd02fa222e5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:22.013258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-30005ae7-0334-4595-8a1a-cd02fa222e5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:22.014827 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1217/2430] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:45:21 2022] DELETE /identity/v3/projects/da5b9f41ad6b4506872df6cb86ae9f73 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:45:22.020239 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09237317-7706-40e1-adb8-533e94017191 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:22.020523 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09237317-7706-40e1-adb8-533e94017191 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:22.020797 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09237317-7706-40e1-adb8-533e94017191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:22.038424 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-09237317-7706-40e1-adb8-533e94017191 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:45:22.039600 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-09237317-7706-40e1-adb8-533e94017191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:22.095570 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1214/2431] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:45:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:45:22.103367 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388e844-3081-49e3-b4b9-115e3fab6409 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:22.103648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388e844-3081-49e3-b4b9-115e3fab6409 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:22.103918 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388e844-3081-49e3-b4b9-115e3fab6409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:22.121621 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-0388e844-3081-49e3-b4b9-115e3fab6409 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:45:22.122837 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-0388e844-3081-49e3-b4b9-115e3fab6409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:22.131133 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1218/2432] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:45:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:45:22.135252 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09237317-7706-40e1-adb8-533e94017191 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:22.145616 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09237317-7706-40e1-adb8-533e94017191 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:22.150230 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c04e8-20f5-45da-9c08-d336397d7577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:22.150892 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c04e8-20f5-45da-9c08-d336397d7577 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:22.151173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c04e8-20f5-45da-9c08-d336397d7577 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:22.151449 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c04e8-20f5-45da-9c08-d336397d7577 admin admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:22.152173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c04e8-20f5-45da-9c08-d336397d7577 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:45:22.152515 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c04e8-20f5-45da-9c08-d336397d7577 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:22.154136 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c04e8-20f5-45da-9c08-d336397d7577 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:22.165984 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1215/2433] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:45:22.170360 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388e844-3081-49e3-b4b9-115e3fab6409 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:22.179372 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388e844-3081-49e3-b4b9-115e3fab6409 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:22.184239 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbdbc2-6f6a-4812-88ce-c3d9423f4831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:22.184918 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbdbc2-6f6a-4812-88ce-c3d9423f4831 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:22.185198 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbdbc2-6f6a-4812-88ce-c3d9423f4831 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:22.185468 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbdbc2-6f6a-4812-88ce-c3d9423f4831 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:22.186211 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfbdbc2-6f6a-4812-88ce-c3d9423f4831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:22.188103 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfbdbc2-6f6a-4812-88ce-c3d9423f4831 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:22.213994 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1219/2434] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:45:22 2022] POST /identity/v3/projects => generated 405 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:45:22.218183 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c04e8-20f5-45da-9c08-d336397d7577 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:22.228850 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c04e8-20f5-45da-9c08-d336397d7577 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:22.290622 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1d6bf-00df-4a99-bd05-7cf2c8b3c0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:22.291198 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1d6bf-00df-4a99-bd05-7cf2c8b3c0b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:22.291477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1d6bf-00df-4a99-bd05-7cf2c8b3c0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:22.291748 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1d6bf-00df-4a99-bd05-7cf2c8b3c0b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:22.292450 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1d6bf-00df-4a99-bd05-7cf2c8b3c0b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:22.294364 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1d6bf-00df-4a99-bd05-7cf2c8b3c0b1 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:22.313754 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1216/2435] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:45:22 2022] POST /identity/v3/users => generated 303 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:45:22.318619 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbdbc2-6f6a-4812-88ce-c3d9423f4831 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:22.328854 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbdbc2-6f6a-4812-88ce-c3d9423f4831 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:22.333484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b893a-5228-4231-b55a-524dc53b700d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:22.334167 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b893a-5228-4231-b55a-524dc53b700d admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:22.334450 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b893a-5228-4231-b55a-524dc53b700d admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:22.334720 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b893a-5228-4231-b55a-524dc53b700d admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:22.335440 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b893a-5228-4231-b55a-524dc53b700d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:22.337019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b893a-5228-4231-b55a-524dc53b700d admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:22.347174 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1220/2436] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:45:22.350782 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1d6bf-00df-4a99-bd05-7cf2c8b3c0b1 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:22.360737 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1d6bf-00df-4a99-bd05-7cf2c8b3c0b1 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:22.365842 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055653de-3900-45d0-b86f-b11d3a6fd795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:22.366513 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055653de-3900-45d0-b86f-b11d3a6fd795 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:22.366793 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055653de-3900-45d0-b86f-b11d3a6fd795 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:22.367176 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055653de-3900-45d0-b86f-b11d3a6fd795 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:22.367890 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055653de-3900-45d0-b86f-b11d3a6fd795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:22.371052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055653de-3900-45d0-b86f-b11d3a6fd795 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:22.382853 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1217/2437] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:45:22.388772 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b893a-5228-4231-b55a-524dc53b700d admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:22.399237 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b893a-5228-4231-b55a-524dc53b700d admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:22.403881 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc392c-8405-4562-89eb-d839cf48cbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:22.404748 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc392c-8405-4562-89eb-d839cf48cbad admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:22.405028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc392c-8405-4562-89eb-d839cf48cbad admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:22.405304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc392c-8405-4562-89eb-d839cf48cbad admin admin] PATH_INFO: `/v3/projects/fa27a22ea2984a15ba7269bed9355b6c/users/44a94fa29dbc4738b0030087e6125429/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:22.419900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc392c-8405-4562-89eb-d839cf48cbad admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa27a22ea2984a15ba7269bed9355b6c, user_id=44a94fa29dbc4738b0030087e6125429, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:22.422542 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc392c-8405-4562-89eb-d839cf48cbad admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:22.435136 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1221/2438] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:45:22 2022] PUT /identity/v3/projects/fa27a22ea2984a15ba7269bed9355b6c/users/44a94fa29dbc4738b0030087e6125429/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:45:22.446307 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870893f2-bc34-4907-bf36-90acbbfab134 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:22.446596 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870893f2-bc34-4907-bf36-90acbbfab134 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:22.446869 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870893f2-bc34-4907-bf36-90acbbfab134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:22.473031 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-870893f2-bc34-4907-bf36-90acbbfab134 None None] MFA Rules not processed for user `44a94fa29dbc4738b0030087e6125429`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:45:22.474282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-870893f2-bc34-4907-bf36-90acbbfab134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:22.533994 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1218/2439] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:45:22 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:45:22.539005 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc392c-8405-4562-89eb-d839cf48cbad admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:22.597770 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc392c-8405-4562-89eb-d839cf48cbad admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:22.602359 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3da9c-76d0-4035-8366-87be281bf531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:22.602999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3da9c-76d0-4035-8366-87be281bf531 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:22.603278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3da9c-76d0-4035-8366-87be281bf531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:22.603553 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3da9c-76d0-4035-8366-87be281bf531 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:22.604232 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3da9c-76d0-4035-8366-87be281bf531 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:22.606135 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3da9c-76d0-4035-8366-87be281bf531 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:22.629996 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1222/2440] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:45:22 2022] POST /identity/v3/projects => generated 405 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:45:22.634160 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870893f2-bc34-4907-bf36-90acbbfab134 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:22.645343 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870893f2-bc34-4907-bf36-90acbbfab134 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:22.706908 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb0f70-e493-4cb0-a77b-e02a2e18d2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:22.707600 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb0f70-e493-4cb0-a77b-e02a2e18d2ee admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:22.709582 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb0f70-e493-4cb0-a77b-e02a2e18d2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:22.709878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb0f70-e493-4cb0-a77b-e02a2e18d2ee admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:22.710611 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb0f70-e493-4cb0-a77b-e02a2e18d2ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:22.712570 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb0f70-e493-4cb0-a77b-e02a2e18d2ee admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:22.734443 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1219/2441] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:45:22 2022] POST /identity/v3/users => generated 309 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:45:22.736912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3da9c-76d0-4035-8366-87be281bf531 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:22.747687 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3da9c-76d0-4035-8366-87be281bf531 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:22.752444 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22821c28-273a-40b0-8946-bf7d6f0688f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:22.753671 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22821c28-273a-40b0-8946-bf7d6f0688f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:22.753994 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22821c28-273a-40b0-8946-bf7d6f0688f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:22.754268 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22821c28-273a-40b0-8946-bf7d6f0688f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:22.755003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22821c28-273a-40b0-8946-bf7d6f0688f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:22.756605 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22821c28-273a-40b0-8946-bf7d6f0688f6 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:22.767705 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1223/2442] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:45:22.772199 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb0f70-e493-4cb0-a77b-e02a2e18d2ee admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:22.781948 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb0f70-e493-4cb0-a77b-e02a2e18d2ee admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:22.786748 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38637be3-f7d0-49c9-a585-9853a0cf5536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:22.787616 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38637be3-f7d0-49c9-a585-9853a0cf5536 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:22.787907 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38637be3-f7d0-49c9-a585-9853a0cf5536 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:22.788183 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38637be3-f7d0-49c9-a585-9853a0cf5536 admin admin] PATH_INFO: `/v3/projects/f464070e84904873bf420d50745bb1a5/users/9c21e81ecef54004a2e8656f1917f8c2/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:22.803277 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38637be3-f7d0-49c9-a585-9853a0cf5536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f464070e84904873bf420d50745bb1a5, user_id=9c21e81ecef54004a2e8656f1917f8c2, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:22.806083 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38637be3-f7d0-49c9-a585-9853a0cf5536 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:22.819751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1220/2443] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:45:22 2022] PUT /identity/v3/projects/f464070e84904873bf420d50745bb1a5/users/9c21e81ecef54004a2e8656f1917f8c2/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:45:22.823616 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22821c28-273a-40b0-8946-bf7d6f0688f6 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:22.833997 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22821c28-273a-40b0-8946-bf7d6f0688f6 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:22.886925 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8506422-0ad5-4721-852b-5317dedbfb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:22.887526 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8506422-0ad5-4721-852b-5317dedbfb85 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:22.887783 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8506422-0ad5-4721-852b-5317dedbfb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:22.888061 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8506422-0ad5-4721-852b-5317dedbfb85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:22.888774 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8506422-0ad5-4721-852b-5317dedbfb85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:22.890392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8506422-0ad5-4721-852b-5317dedbfb85 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:22.900410 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1224/2444] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:45:22.904559 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38637be3-f7d0-49c9-a585-9853a0cf5536 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:22.915176 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38637be3-f7d0-49c9-a585-9853a0cf5536 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:22.919881 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280cca1-5a36-4b59-b69e-19010755d67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:22.920753 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280cca1-5a36-4b59-b69e-19010755d67b admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:22.921034 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280cca1-5a36-4b59-b69e-19010755d67b admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:22.921309 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280cca1-5a36-4b59-b69e-19010755d67b admin admin] PATH_INFO: `/v3/projects/f464070e84904873bf420d50745bb1a5/users/9c21e81ecef54004a2e8656f1917f8c2/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:22.923319 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280cca1-5a36-4b59-b69e-19010755d67b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f464070e84904873bf420d50745bb1a5, user_id=9c21e81ecef54004a2e8656f1917f8c2, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:22.926128 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280cca1-5a36-4b59-b69e-19010755d67b admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:22.935940 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1221/2445] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:45:22 2022] PUT /identity/v3/projects/f464070e84904873bf420d50745bb1a5/users/9c21e81ecef54004a2e8656f1917f8c2/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:45:22.946502 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9887d-b4de-48fd-bad8-9ee29d03b17e None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:22.946792 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9887d-b4de-48fd-bad8-9ee29d03b17e None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:22.947071 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9887d-b4de-48fd-bad8-9ee29d03b17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:22.972454 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-b8b9887d-b4de-48fd-bad8-9ee29d03b17e None None] MFA Rules not processed for user `9c21e81ecef54004a2e8656f1917f8c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:45:22.973643 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-b8b9887d-b4de-48fd-bad8-9ee29d03b17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:23.039499 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1225/2446] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:45:22 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:45:23.050732 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280cca1-5a36-4b59-b69e-19010755d67b admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:23.052389 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-e280cca1-5a36-4b59-b69e-19010755d67b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:23.108259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280cca1-5a36-4b59-b69e-19010755d67b admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:23.113370 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfd3e2-cfb8-4f71-8915-168f708ddcf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:23.114062 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfd3e2-cfb8-4f71-8915-168f708ddcf1 service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:23.114375 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfd3e2-cfb8-4f71-8915-168f708ddcf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:23.115201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfd3e2-cfb8-4f71-8915-168f708ddcf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:23.123714 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dfd3e2-cfb8-4f71-8915-168f708ddcf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:23.125119 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dfd3e2-cfb8-4f71-8915-168f708ddcf1 service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:23.134856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1222/2447] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:45:23 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:45:23.273100 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9887d-b4de-48fd-bad8-9ee29d03b17e None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:23.332146 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9887d-b4de-48fd-bad8-9ee29d03b17e None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:23.336661 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db000d8-1970-4673-a496-f507cee84154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:23.337520 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db000d8-1970-4673-a496-f507cee84154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:23.337802 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db000d8-1970-4673-a496-f507cee84154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:23.338125 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db000d8-1970-4673-a496-f507cee84154 admin admin] PATH_INFO: `/v3/users/44a94fa29dbc4738b0030087e6125429` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:23.339311 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db000d8-1970-4673-a496-f507cee84154 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44a94fa29dbc4738b0030087e6125429)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:23.341223 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db000d8-1970-4673-a496-f507cee84154 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:23.385252 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-8db000d8-1970-4673-a496-f507cee84154 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44a94fa29dbc4738b0030087e6125429'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:23.396778 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-8db000d8-1970-4673-a496-f507cee84154 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44a94fa29dbc4738b0030087e6125429'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:23.397377 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-8db000d8-1970-4673-a496-f507cee84154 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44a94fa29dbc4738b0030087e6125429'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:23.404605 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-8db000d8-1970-4673-a496-f507cee84154 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44a94fa29dbc4738b0030087e6125429'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:23.412087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-8db000d8-1970-4673-a496-f507cee84154 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44a94fa29dbc4738b0030087e6125429'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:23.418028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1226/2448] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:45:23 2022] DELETE /identity/v3/users/44a94fa29dbc4738b0030087e6125429 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:45:23.422503 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05624147-e9d8-4154-a332-85781a9d2d34 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:23.422791 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05624147-e9d8-4154-a332-85781a9d2d34 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:23.423065 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05624147-e9d8-4154-a332-85781a9d2d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:23.440602 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-05624147-e9d8-4154-a332-85781a9d2d34 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:45:23.441793 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-05624147-e9d8-4154-a332-85781a9d2d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:23.498163 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1223/2449] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:45:23.507563 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db000d8-1970-4673-a496-f507cee84154 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:23.508920 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-8db000d8-1970-4673-a496-f507cee84154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:23.564541 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db000d8-1970-4673-a496-f507cee84154 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:23.568112 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e8e94-c391-48b8-86f0-ceedcfc2e5bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:23.568735 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e8e94-c391-48b8-86f0-ceedcfc2e5bd service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:23.569010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e8e94-c391-48b8-86f0-ceedcfc2e5bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:23.569278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e8e94-c391-48b8-86f0-ceedcfc2e5bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:23.577949 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e8e94-c391-48b8-86f0-ceedcfc2e5bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:23.579361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e8e94-c391-48b8-86f0-ceedcfc2e5bd service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:23.588682 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1227/2450] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:45:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:45:23.845596 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05624147-e9d8-4154-a332-85781a9d2d34 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:23.847755 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-05624147-e9d8-4154-a332-85781a9d2d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:23.873123 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05624147-e9d8-4154-a332-85781a9d2d34 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:23.878487 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c1af9-396a-471a-983d-ae76d990b005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:23.879433 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c1af9-396a-471a-983d-ae76d990b005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:23.879723 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c1af9-396a-471a-983d-ae76d990b005 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:23.879997 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c1af9-396a-471a-983d-ae76d990b005 admin admin] PATH_INFO: `/v3/projects/fa27a22ea2984a15ba7269bed9355b6c` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:23.881193 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c1af9-396a-471a-983d-ae76d990b005 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa27a22ea2984a15ba7269bed9355b6c)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:23.883176 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c1af9-396a-471a-983d-ae76d990b005 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:23.930402 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-530c1af9-396a-471a-983d-ae76d990b005 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa27a22ea2984a15ba7269bed9355b6c', 'request_id': 'req-530c1af9-396a-471a-983d-ae76d990b005'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:23.935607 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-530c1af9-396a-471a-983d-ae76d990b005 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa27a22ea2984a15ba7269bed9355b6c', 'request_id': 'req-530c1af9-396a-471a-983d-ae76d990b005'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:23.943928 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-530c1af9-396a-471a-983d-ae76d990b005 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa27a22ea2984a15ba7269bed9355b6c', 'request_id': 'req-530c1af9-396a-471a-983d-ae76d990b005'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:23.955072 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-530c1af9-396a-471a-983d-ae76d990b005 admin admin] The token cache is being invalidate because project fa27a22ea2984a15ba7269bed9355b6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:45:23.955371 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-530c1af9-396a-471a-983d-ae76d990b005 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:23.956116 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-530c1af9-396a-471a-983d-ae76d990b005 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:23.958214 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1224/2451] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:45:23 2022] DELETE /identity/v3/projects/fa27a22ea2984a15ba7269bed9355b6c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:45:23.962184 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e8e94-c391-48b8-86f0-ceedcfc2e5bd service neutron] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:23.976983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e8e94-c391-48b8-86f0-ceedcfc2e5bd service neutron] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:24.031999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd90ef5-fc03-4da6-a207-a0e5d70c66ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:24.032861 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd90ef5-fc03-4da6-a207-a0e5d70c66ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:24.033140 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd90ef5-fc03-4da6-a207-a0e5d70c66ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:24.033412 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd90ef5-fc03-4da6-a207-a0e5d70c66ad admin admin] PATH_INFO: `/v3/users/9c21e81ecef54004a2e8656f1917f8c2` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:24.035233 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd90ef5-fc03-4da6-a207-a0e5d70c66ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c21e81ecef54004a2e8656f1917f8c2)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:24.037132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd90ef5-fc03-4da6-a207-a0e5d70c66ad admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:24.081083 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-afd90ef5-fc03-4da6-a207-a0e5d70c66ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c21e81ecef54004a2e8656f1917f8c2'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:24.093001 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-afd90ef5-fc03-4da6-a207-a0e5d70c66ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c21e81ecef54004a2e8656f1917f8c2'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:24.093643 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-afd90ef5-fc03-4da6-a207-a0e5d70c66ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c21e81ecef54004a2e8656f1917f8c2'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:24.102260 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-afd90ef5-fc03-4da6-a207-a0e5d70c66ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c21e81ecef54004a2e8656f1917f8c2'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:24.109441 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-afd90ef5-fc03-4da6-a207-a0e5d70c66ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c21e81ecef54004a2e8656f1917f8c2'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:24.115303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1228/2452] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:45:23 2022] DELETE /identity/v3/users/9c21e81ecef54004a2e8656f1917f8c2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:45:24.371890 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c1af9-396a-471a-983d-ae76d990b005 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:24.373313 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-530c1af9-396a-471a-983d-ae76d990b005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:24.387005 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c1af9-396a-471a-983d-ae76d990b005 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:24.443902 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f1f3b-7901-4e54-a247-b6070fab457e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:24.444759 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f1f3b-7901-4e54-a247-b6070fab457e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:24.445040 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f1f3b-7901-4e54-a247-b6070fab457e admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:24.445316 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f1f3b-7901-4e54-a247-b6070fab457e admin admin] PATH_INFO: `/v3/projects/f464070e84904873bf420d50745bb1a5` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:24.446514 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f1f3b-7901-4e54-a247-b6070fab457e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f464070e84904873bf420d50745bb1a5)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:24.448391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f1f3b-7901-4e54-a247-b6070fab457e admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:24.491012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-d06f1f3b-7901-4e54-a247-b6070fab457e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f464070e84904873bf420d50745bb1a5', 'request_id': 'req-d06f1f3b-7901-4e54-a247-b6070fab457e'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:24.496168 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-d06f1f3b-7901-4e54-a247-b6070fab457e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f464070e84904873bf420d50745bb1a5', 'request_id': 'req-d06f1f3b-7901-4e54-a247-b6070fab457e'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:24.504249 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-d06f1f3b-7901-4e54-a247-b6070fab457e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f464070e84904873bf420d50745bb1a5', 'request_id': 'req-d06f1f3b-7901-4e54-a247-b6070fab457e'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:24.516470 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-d06f1f3b-7901-4e54-a247-b6070fab457e admin admin] The token cache is being invalidate because project f464070e84904873bf420d50745bb1a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:45:24.516757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-d06f1f3b-7901-4e54-a247-b6070fab457e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:24.517500 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-d06f1f3b-7901-4e54-a247-b6070fab457e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:24.519645 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1225/2453] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:45:24 2022] DELETE /identity/v3/projects/f464070e84904873bf420d50745bb1a5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:45:24.525805 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e6ad1-b1cd-4302-81c8-7545231b168c None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:24.526193 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e6ad1-b1cd-4302-81c8-7545231b168c None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:24.526470 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e6ad1-b1cd-4302-81c8-7545231b168c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:24.544420 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-013e6ad1-b1cd-4302-81c8-7545231b168c None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:45:24.545615 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-013e6ad1-b1cd-4302-81c8-7545231b168c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:24.601215 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1229/2454] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:45:24.609022 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b3658-14a5-43b1-bf6f-09c59204c3d3 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:24.609314 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b3658-14a5-43b1-bf6f-09c59204c3d3 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:24.609596 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b3658-14a5-43b1-bf6f-09c59204c3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:24.628725 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-8d5b3658-14a5-43b1-bf6f-09c59204c3d3 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:45:24.629942 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-8d5b3658-14a5-43b1-bf6f-09c59204c3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:24.638160 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1226/2455] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:45:24.642309 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e6ad1-b1cd-4302-81c8-7545231b168c None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:24.651748 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e6ad1-b1cd-4302-81c8-7545231b168c None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:24.656275 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ccc1b2-4f4f-4524-8379-1b828ca8b3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:24.656916 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ccc1b2-4f4f-4524-8379-1b828ca8b3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:24.657197 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ccc1b2-4f4f-4524-8379-1b828ca8b3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:24.657471 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ccc1b2-4f4f-4524-8379-1b828ca8b3a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:24.658228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ccc1b2-4f4f-4524-8379-1b828ca8b3a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:45:24.658535 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ccc1b2-4f4f-4524-8379-1b828ca8b3a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:24.660170 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ccc1b2-4f4f-4524-8379-1b828ca8b3a2 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:24.671226 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1230/2456] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:45:24.676094 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b3658-14a5-43b1-bf6f-09c59204c3d3 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:24.685076 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b3658-14a5-43b1-bf6f-09c59204c3d3 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:24.691267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f04f38-2b73-47ac-b030-7f813bbf6d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:24.691944 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f04f38-2b73-47ac-b030-7f813bbf6d02 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:24.692226 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f04f38-2b73-47ac-b030-7f813bbf6d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:24.692497 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f04f38-2b73-47ac-b030-7f813bbf6d02 admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:24.693169 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f04f38-2b73-47ac-b030-7f813bbf6d02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:24.695109 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f04f38-2b73-47ac-b030-7f813bbf6d02 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:24.719214 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1227/2457] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:45:24 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:45:24.723339 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ccc1b2-4f4f-4524-8379-1b828ca8b3a2 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:24.733050 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ccc1b2-4f4f-4524-8379-1b828ca8b3a2 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:24.787354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef65a9e-66b7-4a67-8cef-afe1c445fc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:24.787936 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef65a9e-66b7-4a67-8cef-afe1c445fc26 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:24.788220 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef65a9e-66b7-4a67-8cef-afe1c445fc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:24.788496 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef65a9e-66b7-4a67-8cef-afe1c445fc26 admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:24.789178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef65a9e-66b7-4a67-8cef-afe1c445fc26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:24.791120 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef65a9e-66b7-4a67-8cef-afe1c445fc26 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:24.810288 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1231/2458] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:45:24 2022] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:45:24.814549 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f04f38-2b73-47ac-b030-7f813bbf6d02 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:24.825225 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f04f38-2b73-47ac-b030-7f813bbf6d02 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:24.829836 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9b314-b2a5-4f84-ab40-9d2793433341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:24.830525 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9b314-b2a5-4f84-ab40-9d2793433341 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:24.830809 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9b314-b2a5-4f84-ab40-9d2793433341 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:24.831086 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9b314-b2a5-4f84-ab40-9d2793433341 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:24.831813 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9b314-b2a5-4f84-ab40-9d2793433341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:24.833395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9b314-b2a5-4f84-ab40-9d2793433341 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:24.843384 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1228/2459] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:45:24.847363 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef65a9e-66b7-4a67-8cef-afe1c445fc26 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:24.857207 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef65a9e-66b7-4a67-8cef-afe1c445fc26 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:24.863593 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b33a5-b04e-4163-8acd-f9cb273d67f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:24.864428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b33a5-b04e-4163-8acd-f9cb273d67f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:24.864710 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b33a5-b04e-4163-8acd-f9cb273d67f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:24.865012 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b33a5-b04e-4163-8acd-f9cb273d67f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:24.865728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b33a5-b04e-4163-8acd-f9cb273d67f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:24.867354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b33a5-b04e-4163-8acd-f9cb273d67f1 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:24.877707 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1232/2460] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:45:24.882387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9b314-b2a5-4f84-ab40-9d2793433341 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:24.892464 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9b314-b2a5-4f84-ab40-9d2793433341 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:24.897068 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22778478-a464-4dd8-a5d2-40eca592fb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:24.897993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22778478-a464-4dd8-a5d2-40eca592fb61 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:24.898281 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22778478-a464-4dd8-a5d2-40eca592fb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:24.898555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22778478-a464-4dd8-a5d2-40eca592fb61 admin admin] PATH_INFO: `/v3/projects/dde06caff7214a83ba853c9cb42c706e/users/b38cc7d267134e5bb99cf36208856460/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:24.913166 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22778478-a464-4dd8-a5d2-40eca592fb61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dde06caff7214a83ba853c9cb42c706e, user_id=b38cc7d267134e5bb99cf36208856460, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:24.915933 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22778478-a464-4dd8-a5d2-40eca592fb61 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:24.928483 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1229/2461] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:45:24 2022] PUT /identity/v3/projects/dde06caff7214a83ba853c9cb42c706e/users/b38cc7d267134e5bb99cf36208856460/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:45:24.939678 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4899a43-d382-4916-a31f-f600c14b8ca0 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:24.939966 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4899a43-d382-4916-a31f-f600c14b8ca0 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:24.940242 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4899a43-d382-4916-a31f-f600c14b8ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:24.965435 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-f4899a43-d382-4916-a31f-f600c14b8ca0 None None] MFA Rules not processed for user `b38cc7d267134e5bb99cf36208856460`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:45:24.966695 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-f4899a43-d382-4916-a31f-f600c14b8ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:25.030316 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1233/2462] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:45:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:45:25.044485 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22778478-a464-4dd8-a5d2-40eca592fb61 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:25.046251 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-22778478-a464-4dd8-a5d2-40eca592fb61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:25.106827 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22778478-a464-4dd8-a5d2-40eca592fb61 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:25.110717 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c15b0-4456-4fee-92ec-461557111760 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:25.111387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c15b0-4456-4fee-92ec-461557111760 service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:25.111668 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c15b0-4456-4fee-92ec-461557111760 service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:25.111941 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c15b0-4456-4fee-92ec-461557111760 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:25.121160 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c15b0-4456-4fee-92ec-461557111760 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:25.122613 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c15b0-4456-4fee-92ec-461557111760 service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:25.131508 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1230/2463] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:45:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 09:45:48.708736 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4899a43-d382-4916-a31f-f600c14b8ca0 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:48.710190 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-f4899a43-d382-4916-a31f-f600c14b8ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:48.785643 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4899a43-d382-4916-a31f-f600c14b8ca0 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:48.791085 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc9580-7c35-4a94-9908-986f303f2a0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:48.791726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc9580-7c35-4a94-9908-986f303f2a0d service nova] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:48.792028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc9580-7c35-4a94-9908-986f303f2a0d service nova] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:48.792301 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc9580-7c35-4a94-9908-986f303f2a0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:48.794102 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-9fbc9580-7c35-4a94-9908-986f303f2a0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:48.806436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc9580-7c35-4a94-9908-986f303f2a0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:48.808027 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc9580-7c35-4a94-9908-986f303f2a0d service nova] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:48.818852 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1234/2464] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:45:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:45:49.467983 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb52c4-014c-41e9-b09c-f007a1e4ef76 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:49.468502 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb52c4-014c-41e9-b09c-f007a1e4ef76 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:49.468607 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb52c4-014c-41e9-b09c-f007a1e4ef76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:49.486823 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-1acb52c4-014c-41e9-b09c-f007a1e4ef76 None None] MFA Rules not processed for user `bd41f419750140268f4d4b77456065c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:45:49.488059 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-1acb52c4-014c-41e9-b09c-f007a1e4ef76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:49.543327 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1231/2465] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 12 09:45:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:45:49.592027 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc9580-7c35-4a94-9908-986f303f2a0d service nova] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:49.593413 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-9fbc9580-7c35-4a94-9908-986f303f2a0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:49.670802 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc9580-7c35-4a94-9908-986f303f2a0d service nova] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:49.675764 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5a342-c607-481a-adaa-01332785c7fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7693a31911346f9bb2c01efcd8e16e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:49.676403 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5a342-c607-481a-adaa-01332785c7fc service swift] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:49.676684 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5a342-c607-481a-adaa-01332785c7fc service swift] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:49.676960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5a342-c607-481a-adaa-01332785c7fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:49.684815 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5a342-c607-481a-adaa-01332785c7fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:49.686428 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5a342-c607-481a-adaa-01332785c7fc service swift] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:49.695373 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1235/2466] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 12 09:45:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 09:45:51.829088 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb52c4-014c-41e9-b09c-f007a1e4ef76 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:51.911715 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb52c4-014c-41e9-b09c-f007a1e4ef76 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:51.924481 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fc472-da61-4b70-9f5f-be2d3a857367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:51.926253 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fc472-da61-4b70-9f5f-be2d3a857367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:51.926825 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fc472-da61-4b70-9f5f-be2d3a857367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:51.927046 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fc472-da61-4b70-9f5f-be2d3a857367 admin admin] PATH_INFO: `/v3/users/b38cc7d267134e5bb99cf36208856460` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:51.928206 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fc472-da61-4b70-9f5f-be2d3a857367 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b38cc7d267134e5bb99cf36208856460)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:51.930492 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fc472-da61-4b70-9f5f-be2d3a857367 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:51.997456 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-063fc472-da61-4b70-9f5f-be2d3a857367 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b38cc7d267134e5bb99cf36208856460'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:52.017381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-063fc472-da61-4b70-9f5f-be2d3a857367 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b38cc7d267134e5bb99cf36208856460'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:52.018139 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-063fc472-da61-4b70-9f5f-be2d3a857367 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b38cc7d267134e5bb99cf36208856460'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:52.029033 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-063fc472-da61-4b70-9f5f-be2d3a857367 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b38cc7d267134e5bb99cf36208856460'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:52.038184 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-063fc472-da61-4b70-9f5f-be2d3a857367 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b38cc7d267134e5bb99cf36208856460'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:52.052577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1232/2467] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:45:51 2022] DELETE /identity/v3/users/b38cc7d267134e5bb99cf36208856460 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:45:52.056681 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e079c-ef24-47bb-8559-db5bc0b7d906 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:52.057180 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e079c-ef24-47bb-8559-db5bc0b7d906 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:52.057268 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e079c-ef24-47bb-8559-db5bc0b7d906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:52.076274 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-167e079c-ef24-47bb-8559-db5bc0b7d906 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:45:52.077466 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-167e079c-ef24-47bb-8559-db5bc0b7d906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:52.153642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1236/2468] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:45:52.160026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fc472-da61-4b70-9f5f-be2d3a857367 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:52.161542 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-063fc472-da61-4b70-9f5f-be2d3a857367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:52.223439 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fc472-da61-4b70-9f5f-be2d3a857367 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:52.227258 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83083b-9742-4696-a45e-b5986edcdc0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:52.228635 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83083b-9742-4696-a45e-b5986edcdc0b service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:52.228924 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83083b-9742-4696-a45e-b5986edcdc0b service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:52.229206 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83083b-9742-4696-a45e-b5986edcdc0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:52.239801 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83083b-9742-4696-a45e-b5986edcdc0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:52.241253 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83083b-9742-4696-a45e-b5986edcdc0b service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:52.254329 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1233/2469] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:45:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:45:52.258095 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e079c-ef24-47bb-8559-db5bc0b7d906 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:52.259798 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-167e079c-ef24-47bb-8559-db5bc0b7d906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:52.277192 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e079c-ef24-47bb-8559-db5bc0b7d906 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:52.286310 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49224ec7-f8af-4083-97ab-2eed93cd9691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:52.286990 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49224ec7-f8af-4083-97ab-2eed93cd9691 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:52.287275 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49224ec7-f8af-4083-97ab-2eed93cd9691 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:52.287553 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49224ec7-f8af-4083-97ab-2eed93cd9691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:52.289758 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-49224ec7-f8af-4083-97ab-2eed93cd9691 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:52.379945 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49224ec7-f8af-4083-97ab-2eed93cd9691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:52.381753 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49224ec7-f8af-4083-97ab-2eed93cd9691 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:52.394595 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1237/2470] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:45:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:45:52.589996 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83083b-9742-4696-a45e-b5986edcdc0b service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:52.591434 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-9b83083b-9742-4696-a45e-b5986edcdc0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:52.606306 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83083b-9742-4696-a45e-b5986edcdc0b service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:52.617490 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f954d-4976-4cab-be6c-4963b6021d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:52.618001 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f954d-4976-4cab-be6c-4963b6021d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:52.618286 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f954d-4976-4cab-be6c-4963b6021d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:52.618559 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f954d-4976-4cab-be6c-4963b6021d96 admin admin] PATH_INFO: `/v3/projects/dde06caff7214a83ba853c9cb42c706e` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:52.620617 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f954d-4976-4cab-be6c-4963b6021d96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dde06caff7214a83ba853c9cb42c706e)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:52.624090 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f954d-4976-4cab-be6c-4963b6021d96 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:52.694995 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-129f954d-4976-4cab-be6c-4963b6021d96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dde06caff7214a83ba853c9cb42c706e', 'request_id': 'req-129f954d-4976-4cab-be6c-4963b6021d96'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:52.704832 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-129f954d-4976-4cab-be6c-4963b6021d96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dde06caff7214a83ba853c9cb42c706e', 'request_id': 'req-129f954d-4976-4cab-be6c-4963b6021d96'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:52.717731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-129f954d-4976-4cab-be6c-4963b6021d96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dde06caff7214a83ba853c9cb42c706e', 'request_id': 'req-129f954d-4976-4cab-be6c-4963b6021d96'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:52.731169 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-129f954d-4976-4cab-be6c-4963b6021d96 admin admin] The token cache is being invalidate because project dde06caff7214a83ba853c9cb42c706e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:45:52.731441 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-129f954d-4976-4cab-be6c-4963b6021d96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:52.733414 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-129f954d-4976-4cab-be6c-4963b6021d96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:52.739887 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1234/2471] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:45:52 2022] DELETE /identity/v3/projects/dde06caff7214a83ba853c9cb42c706e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:45:52.741809 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f52a3c-1817-4856-9868-5414b3a18a8c None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:52.742141 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f52a3c-1817-4856-9868-5414b3a18a8c None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:52.742423 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f52a3c-1817-4856-9868-5414b3a18a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:52.772109 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-86f52a3c-1817-4856-9868-5414b3a18a8c None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:45:52.776433 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-86f52a3c-1817-4856-9868-5414b3a18a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:52.866083 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1238/2472] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:45:52.875464 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e095fa-9de2-4d25-aced-10c6384636be None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:52.876363 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e095fa-9de2-4d25-aced-10c6384636be None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:52.876974 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e095fa-9de2-4d25-aced-10c6384636be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:52.903672 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-b4e095fa-9de2-4d25-aced-10c6384636be None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:45:52.905231 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-b4e095fa-9de2-4d25-aced-10c6384636be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:52.917543 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1235/2473] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:45:52.922226 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f52a3c-1817-4856-9868-5414b3a18a8c None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:52.937311 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f52a3c-1817-4856-9868-5414b3a18a8c None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:52.943667 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a10fbd-4aa6-43bd-99a9-40c60b9f2c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:52.944591 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a10fbd-4aa6-43bd-99a9-40c60b9f2c98 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:52.944979 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a10fbd-4aa6-43bd-99a9-40c60b9f2c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:52.945408 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a10fbd-4aa6-43bd-99a9-40c60b9f2c98 admin admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:52.946286 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a10fbd-4aa6-43bd-99a9-40c60b9f2c98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:45:52.946714 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a10fbd-4aa6-43bd-99a9-40c60b9f2c98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:52.948580 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a10fbd-4aa6-43bd-99a9-40c60b9f2c98 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:52.965797 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1239/2474] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:45:52.967051 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e095fa-9de2-4d25-aced-10c6384636be None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:52.977128 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e095fa-9de2-4d25-aced-10c6384636be None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:52.982631 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317e66e-03d1-4b5c-91eb-0b5b42c787fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:52.983300 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317e66e-03d1-4b5c-91eb-0b5b42c787fb admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:52.983582 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317e66e-03d1-4b5c-91eb-0b5b42c787fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:52.984348 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317e66e-03d1-4b5c-91eb-0b5b42c787fb admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:52.985086 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317e66e-03d1-4b5c-91eb-0b5b42c787fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:52.987102 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317e66e-03d1-4b5c-91eb-0b5b42c787fb admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:53.029952 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1236/2475] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:45:52 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:45:53.030371 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a10fbd-4aa6-43bd-99a9-40c60b9f2c98 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:53.042917 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a10fbd-4aa6-43bd-99a9-40c60b9f2c98 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:53.128543 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedf547-0d59-4597-ba0e-82564cbc75f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:53.129773 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedf547-0d59-4597-ba0e-82564cbc75f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:53.129773 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedf547-0d59-4597-ba0e-82564cbc75f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:53.130487 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedf547-0d59-4597-ba0e-82564cbc75f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:53.131214 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acedf547-0d59-4597-ba0e-82564cbc75f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:53.133738 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acedf547-0d59-4597-ba0e-82564cbc75f8 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:53.176893 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1240/2476] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:45:53 2022] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:45:53.180557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317e66e-03d1-4b5c-91eb-0b5b42c787fb admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:53.193620 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317e66e-03d1-4b5c-91eb-0b5b42c787fb admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:53.199877 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b3aba-87d1-4b5d-8194-3f6e2cf80bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:53.200572 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b3aba-87d1-4b5d-8194-3f6e2cf80bec admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:53.200848 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b3aba-87d1-4b5d-8194-3f6e2cf80bec admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:53.201123 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b3aba-87d1-4b5d-8194-3f6e2cf80bec admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:53.202070 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b3aba-87d1-4b5d-8194-3f6e2cf80bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:53.204014 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b3aba-87d1-4b5d-8194-3f6e2cf80bec admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:53.227237 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedf547-0d59-4597-ba0e-82564cbc75f8 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:53.231936 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1237/2477] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:45:53.239119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedf547-0d59-4597-ba0e-82564cbc75f8 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:53.252448 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49361808-b731-4801-8086-38ef76f78b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:53.253511 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49361808-b731-4801-8086-38ef76f78b19 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:53.255807 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49361808-b731-4801-8086-38ef76f78b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:53.256031 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49361808-b731-4801-8086-38ef76f78b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:53.257276 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49361808-b731-4801-8086-38ef76f78b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:53.262159 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49361808-b731-4801-8086-38ef76f78b19 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:53.289651 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1241/2478] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 09:45:53.290856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b3aba-87d1-4b5d-8194-3f6e2cf80bec admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:53.310147 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b3aba-87d1-4b5d-8194-3f6e2cf80bec admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:53.319323 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2746a9-348b-4157-aebf-f332eb2f4ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:53.331269 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2746a9-348b-4157-aebf-f332eb2f4ccd admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:53.336805 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2746a9-348b-4157-aebf-f332eb2f4ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:53.337315 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2746a9-348b-4157-aebf-f332eb2f4ccd admin admin] PATH_INFO: `/v3/projects/3dcae868c5cd4bbca126384c84c67c25/users/aea2500e8c4a4d19a8375fc7831c8925/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:53.360820 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2746a9-348b-4157-aebf-f332eb2f4ccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dcae868c5cd4bbca126384c84c67c25, user_id=aea2500e8c4a4d19a8375fc7831c8925, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:53.365229 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2746a9-348b-4157-aebf-f332eb2f4ccd admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:53.402118 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1238/2479] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:45:53 2022] PUT /identity/v3/projects/3dcae868c5cd4bbca126384c84c67c25/users/aea2500e8c4a4d19a8375fc7831c8925/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:45:53.419171 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b142cbe-90b5-4888-bc0c-553a8cbb145d None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:53.419952 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b142cbe-90b5-4888-bc0c-553a8cbb145d None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:53.419952 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b142cbe-90b5-4888-bc0c-553a8cbb145d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:53.431160 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2746a9-348b-4157-aebf-f332eb2f4ccd admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:53.433749 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-ab2746a9-348b-4157-aebf-f332eb2f4ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:53.453690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-0b142cbe-90b5-4888-bc0c-553a8cbb145d None None] MFA Rules not processed for user `aea2500e8c4a4d19a8375fc7831c8925`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:45:53.455064 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-0b142cbe-90b5-4888-bc0c-553a8cbb145d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:53.548954 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1242/2480] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:45:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:45:53.557021 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b142cbe-90b5-4888-bc0c-553a8cbb145d None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:53.559516 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-0b142cbe-90b5-4888-bc0c-553a8cbb145d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:53.583301 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2746a9-348b-4157-aebf-f332eb2f4ccd admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:53.593141 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717cffef-914b-4689-b4df-06445109f224 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:53.594425 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cffef-914b-4689-b4df-06445109f224 service nova] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:53.594927 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cffef-914b-4689-b4df-06445109f224 service nova] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:53.595658 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cffef-914b-4689-b4df-06445109f224 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:53.598600 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-717cffef-914b-4689-b4df-06445109f224 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:53.615683 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717cffef-914b-4689-b4df-06445109f224 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:53.618543 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717cffef-914b-4689-b4df-06445109f224 service nova] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:53.633339 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1239/2481] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:45:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 09:45:53.696955 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b142cbe-90b5-4888-bc0c-553a8cbb145d None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:53.701650 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200d1c1-a8f9-41f4-a389-8d9d8755b414 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:53.702382 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200d1c1-a8f9-41f4-a389-8d9d8755b414 service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:53.702666 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200d1c1-a8f9-41f4-a389-8d9d8755b414 service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:53.703145 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200d1c1-a8f9-41f4-a389-8d9d8755b414 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:53.716396 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200d1c1-a8f9-41f4-a389-8d9d8755b414 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:53.719706 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200d1c1-a8f9-41f4-a389-8d9d8755b414 service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:53.732491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1243/2482] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:45:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 09:45:57.357652 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717cffef-914b-4689-b4df-06445109f224 service nova] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:57.434800 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717cffef-914b-4689-b4df-06445109f224 service nova] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:57.439848 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b30fd-5678-455e-bc7a-cf20512224c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:57.440843 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b30fd-5678-455e-bc7a-cf20512224c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:57.441125 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b30fd-5678-455e-bc7a-cf20512224c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:57.441448 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b30fd-5678-455e-bc7a-cf20512224c0 admin admin] PATH_INFO: `/v3/users/aea2500e8c4a4d19a8375fc7831c8925` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:57.442855 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b30fd-5678-455e-bc7a-cf20512224c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aea2500e8c4a4d19a8375fc7831c8925)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:57.444965 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b30fd-5678-455e-bc7a-cf20512224c0 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:57.496801 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-8c4b30fd-5678-455e-bc7a-cf20512224c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aea2500e8c4a4d19a8375fc7831c8925'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:57.508471 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-8c4b30fd-5678-455e-bc7a-cf20512224c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aea2500e8c4a4d19a8375fc7831c8925'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:57.509203 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-8c4b30fd-5678-455e-bc7a-cf20512224c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aea2500e8c4a4d19a8375fc7831c8925'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:57.517106 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-8c4b30fd-5678-455e-bc7a-cf20512224c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aea2500e8c4a4d19a8375fc7831c8925'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:57.525146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-8c4b30fd-5678-455e-bc7a-cf20512224c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aea2500e8c4a4d19a8375fc7831c8925'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:57.531292 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1240/2483] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:45:57 2022] DELETE /identity/v3/users/aea2500e8c4a4d19a8375fc7831c8925 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:45:57.536229 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1da9ed-38c2-41b1-9edd-23fab3506aa0 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:57.536709 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1da9ed-38c2-41b1-9edd-23fab3506aa0 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:57.536954 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1da9ed-38c2-41b1-9edd-23fab3506aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:57.557306 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-4a1da9ed-38c2-41b1-9edd-23fab3506aa0 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:45:57.558639 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-4a1da9ed-38c2-41b1-9edd-23fab3506aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:57.625786 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1244/2484] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:45:57.635852 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b30fd-5678-455e-bc7a-cf20512224c0 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:57.638279 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-8c4b30fd-5678-455e-bc7a-cf20512224c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:57.709595 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b30fd-5678-455e-bc7a-cf20512224c0 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:57.713221 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94450915-9881-4074-a740-df0e2c60137d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:57.713868 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94450915-9881-4074-a740-df0e2c60137d service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:57.714207 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94450915-9881-4074-a740-df0e2c60137d service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:57.714480 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94450915-9881-4074-a740-df0e2c60137d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:57.725793 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94450915-9881-4074-a740-df0e2c60137d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:57.728111 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94450915-9881-4074-a740-df0e2c60137d service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:57.739625 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1241/2485] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:45:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:45:58.132162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1da9ed-38c2-41b1-9edd-23fab3506aa0 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:58.135137 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-4a1da9ed-38c2-41b1-9edd-23fab3506aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:58.150430 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1da9ed-38c2-41b1-9edd-23fab3506aa0 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:58.154101 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31e705-b60d-46b5-8c13-726e6b44ad8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:58.155017 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31e705-b60d-46b5-8c13-726e6b44ad8f service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:58.155968 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31e705-b60d-46b5-8c13-726e6b44ad8f service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:58.155968 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31e705-b60d-46b5-8c13-726e6b44ad8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:58.158451 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-ff31e705-b60d-46b5-8c13-726e6b44ad8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:58.175286 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31e705-b60d-46b5-8c13-726e6b44ad8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:58.176795 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31e705-b60d-46b5-8c13-726e6b44ad8f service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:58.182403 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94450915-9881-4074-a740-df0e2c60137d service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:58.183854 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-94450915-9881-4074-a740-df0e2c60137d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:58.198449 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94450915-9881-4074-a740-df0e2c60137d service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:58.204520 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1245/2486] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:45:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:45:58.208983 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf4793-883a-4e53-94f2-8c0c3d0776fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:58.209869 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf4793-883a-4e53-94f2-8c0c3d0776fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:58.210196 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf4793-883a-4e53-94f2-8c0c3d0776fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:58.210468 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf4793-883a-4e53-94f2-8c0c3d0776fd admin admin] PATH_INFO: `/v3/projects/3dcae868c5cd4bbca126384c84c67c25` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:58.211675 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf4793-883a-4e53-94f2-8c0c3d0776fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dcae868c5cd4bbca126384c84c67c25)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:58.213597 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf4793-883a-4e53-94f2-8c0c3d0776fd admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:58.271631 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-11cf4793-883a-4e53-94f2-8c0c3d0776fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dcae868c5cd4bbca126384c84c67c25', 'request_id': 'req-11cf4793-883a-4e53-94f2-8c0c3d0776fd'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:58.278707 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-11cf4793-883a-4e53-94f2-8c0c3d0776fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dcae868c5cd4bbca126384c84c67c25', 'request_id': 'req-11cf4793-883a-4e53-94f2-8c0c3d0776fd'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:58.289548 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-11cf4793-883a-4e53-94f2-8c0c3d0776fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dcae868c5cd4bbca126384c84c67c25', 'request_id': 'req-11cf4793-883a-4e53-94f2-8c0c3d0776fd'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:58.308390 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-11cf4793-883a-4e53-94f2-8c0c3d0776fd admin admin] The token cache is being invalidate because project 3dcae868c5cd4bbca126384c84c67c25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:45:58.309036 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-11cf4793-883a-4e53-94f2-8c0c3d0776fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:58.310243 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-11cf4793-883a-4e53-94f2-8c0c3d0776fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:45:58.312125 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1242/2487] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:45:58 2022] DELETE /identity/v3/projects/3dcae868c5cd4bbca126384c84c67c25 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:45:58.318005 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480eaf6-8b73-435d-b2c3-5d820e28c7f8 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:58.318266 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480eaf6-8b73-435d-b2c3-5d820e28c7f8 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:58.318542 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480eaf6-8b73-435d-b2c3-5d820e28c7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:58.340616 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-4480eaf6-8b73-435d-b2c3-5d820e28c7f8 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:45:58.341822 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-4480eaf6-8b73-435d-b2c3-5d820e28c7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:58.416497 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1246/2488] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:45:58.424235 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4238187-2f5c-47d7-82d1-127a207fedb0 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:58.425622 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4238187-2f5c-47d7-82d1-127a207fedb0 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:58.426751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4238187-2f5c-47d7-82d1-127a207fedb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:58.449954 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-f4238187-2f5c-47d7-82d1-127a207fedb0 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:45:58.451186 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-f4238187-2f5c-47d7-82d1-127a207fedb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:58.460511 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1243/2489] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:45:58.465001 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480eaf6-8b73-435d-b2c3-5d820e28c7f8 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:58.475775 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480eaf6-8b73-435d-b2c3-5d820e28c7f8 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:58.481992 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917490e6-d999-4e52-b4bc-2cdca1163735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:58.482921 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917490e6-d999-4e52-b4bc-2cdca1163735 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:58.483262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917490e6-d999-4e52-b4bc-2cdca1163735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:58.483598 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917490e6-d999-4e52-b4bc-2cdca1163735 admin admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:58.484403 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917490e6-d999-4e52-b4bc-2cdca1163735 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:45:58.484781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917490e6-d999-4e52-b4bc-2cdca1163735 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:58.486569 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917490e6-d999-4e52-b4bc-2cdca1163735 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:58.506945 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1247/2490] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:45:58.513797 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4238187-2f5c-47d7-82d1-127a207fedb0 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:58.529403 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4238187-2f5c-47d7-82d1-127a207fedb0 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:58.535726 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d2e1f-cc86-48ba-b096-d918e7bbd44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:58.536404 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d2e1f-cc86-48ba-b096-d918e7bbd44e admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:58.536688 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d2e1f-cc86-48ba-b096-d918e7bbd44e admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:58.536965 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d2e1f-cc86-48ba-b096-d918e7bbd44e admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:58.537657 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d2e1f-cc86-48ba-b096-d918e7bbd44e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:58.539615 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d2e1f-cc86-48ba-b096-d918e7bbd44e admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:58.576224 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1244/2491] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:45:58 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:45:58.582910 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917490e6-d999-4e52-b4bc-2cdca1163735 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:58.594150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917490e6-d999-4e52-b4bc-2cdca1163735 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:58.691414 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4050e1-91e9-4e83-a71e-b053359af9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:58.692370 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4050e1-91e9-4e83-a71e-b053359af9ab admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:58.692651 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4050e1-91e9-4e83-a71e-b053359af9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:58.692926 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4050e1-91e9-4e83-a71e-b053359af9ab admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:58.693621 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4050e1-91e9-4e83-a71e-b053359af9ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:58.696023 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4050e1-91e9-4e83-a71e-b053359af9ab admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:58.719419 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1248/2492] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:45:58 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:45:58.723974 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d2e1f-cc86-48ba-b096-d918e7bbd44e admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:58.734491 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d2e1f-cc86-48ba-b096-d918e7bbd44e admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:58.740607 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c5b4c-5fd6-472c-80f9-c95aa3be00f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:58.741573 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c5b4c-5fd6-472c-80f9-c95aa3be00f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:58.741694 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c5b4c-5fd6-472c-80f9-c95aa3be00f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:58.742043 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c5b4c-5fd6-472c-80f9-c95aa3be00f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:58.742815 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c5b4c-5fd6-472c-80f9-c95aa3be00f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:58.744499 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c5b4c-5fd6-472c-80f9-c95aa3be00f0 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:58.758702 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1245/2493] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:45:58.762876 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4050e1-91e9-4e83-a71e-b053359af9ab admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:58.774838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4050e1-91e9-4e83-a71e-b053359af9ab admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:58.780119 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20ac22-b03b-4df0-8ed0-3ebff0ab47ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:58.780796 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20ac22-b03b-4df0-8ed0-3ebff0ab47ec admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:58.781080 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20ac22-b03b-4df0-8ed0-3ebff0ab47ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:58.781353 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20ac22-b03b-4df0-8ed0-3ebff0ab47ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:58.782258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20ac22-b03b-4df0-8ed0-3ebff0ab47ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:58.783874 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20ac22-b03b-4df0-8ed0-3ebff0ab47ec admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:58.798505 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1249/2494] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:45:58.799250 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c5b4c-5fd6-472c-80f9-c95aa3be00f0 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:58.810797 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c5b4c-5fd6-472c-80f9-c95aa3be00f0 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:58.819470 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e586d-41c1-4437-bde9-9f2cad5cbdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:58.820382 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e586d-41c1-4437-bde9-9f2cad5cbdee admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:58.820891 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e586d-41c1-4437-bde9-9f2cad5cbdee admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:58.821188 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e586d-41c1-4437-bde9-9f2cad5cbdee admin admin] PATH_INFO: `/v3/projects/fdf8fd68dc204ced92a64f35ff547353/users/b2013d3e84864823b890ff7d43d4a2bf/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:58.840717 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e586d-41c1-4437-bde9-9f2cad5cbdee admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdf8fd68dc204ced92a64f35ff547353, user_id=b2013d3e84864823b890ff7d43d4a2bf, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:58.845547 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e586d-41c1-4437-bde9-9f2cad5cbdee admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:58.872338 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1246/2495] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:45:58 2022] PUT /identity/v3/projects/fdf8fd68dc204ced92a64f35ff547353/users/b2013d3e84864823b890ff7d43d4a2bf/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:45:58.874060 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cb7cb-8263-4bda-857a-132eedc90c79 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:58.874354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cb7cb-8263-4bda-857a-132eedc90c79 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:58.874635 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cb7cb-8263-4bda-857a-132eedc90c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:58.907327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-9c3cb7cb-8263-4bda-857a-132eedc90c79 None None] MFA Rules not processed for user `b2013d3e84864823b890ff7d43d4a2bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:45:58.909883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-9c3cb7cb-8263-4bda-857a-132eedc90c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:58.994186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1250/2496] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:45:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:45:58.995324 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e586d-41c1-4437-bde9-9f2cad5cbdee admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:59.071780 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e586d-41c1-4437-bde9-9f2cad5cbdee admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:59.079698 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249ee7b-9e30-4763-88ac-20c8134ad9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:59.080795 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249ee7b-9e30-4763-88ac-20c8134ad9f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:59.081961 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249ee7b-9e30-4763-88ac-20c8134ad9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:59.082434 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249ee7b-9e30-4763-88ac-20c8134ad9f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:59.084069 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249ee7b-9e30-4763-88ac-20c8134ad9f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:59.086870 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249ee7b-9e30-4763-88ac-20c8134ad9f8 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:59.132541 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1247/2497] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:45:58 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:45:59.133598 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cb7cb-8263-4bda-857a-132eedc90c79 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:59.145149 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cb7cb-8263-4bda-857a-132eedc90c79 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:59.230488 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd247a-922a-4eb6-a688-23c6ab92d089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:59.231300 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd247a-922a-4eb6-a688-23c6ab92d089 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:59.231643 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd247a-922a-4eb6-a688-23c6ab92d089 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:59.231991 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd247a-922a-4eb6-a688-23c6ab92d089 admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:59.232771 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd247a-922a-4eb6-a688-23c6ab92d089 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:59.235796 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd247a-922a-4eb6-a688-23c6ab92d089 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:59.260303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1251/2498] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:45:59 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:45:59.264314 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249ee7b-9e30-4763-88ac-20c8134ad9f8 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:59.276919 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249ee7b-9e30-4763-88ac-20c8134ad9f8 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:59.282318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bcedc8-955a-4ec0-a80b-4d73f694bf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:59.283017 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcedc8-955a-4ec0-a80b-4d73f694bf69 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:59.283283 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcedc8-955a-4ec0-a80b-4d73f694bf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:59.284804 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcedc8-955a-4ec0-a80b-4d73f694bf69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:59.287058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bcedc8-955a-4ec0-a80b-4d73f694bf69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:59.289163 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bcedc8-955a-4ec0-a80b-4d73f694bf69 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:59.301077 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1248/2499] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:45:59.304916 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd247a-922a-4eb6-a688-23c6ab92d089 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:59.321622 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd247a-922a-4eb6-a688-23c6ab92d089 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:59.328054 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14de0a-288c-4e9f-b5ad-3ac803e4f04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:59.328903 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14de0a-288c-4e9f-b5ad-3ac803e4f04b admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:59.329279 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14de0a-288c-4e9f-b5ad-3ac803e4f04b admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:59.329706 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14de0a-288c-4e9f-b5ad-3ac803e4f04b admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:59.330731 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14de0a-288c-4e9f-b5ad-3ac803e4f04b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:59.333142 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14de0a-288c-4e9f-b5ad-3ac803e4f04b admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:59.360715 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1252/2500] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:45:59.361595 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bcedc8-955a-4ec0-a80b-4d73f694bf69 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:59.378624 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bcedc8-955a-4ec0-a80b-4d73f694bf69 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:59.384712 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0b5e3-84ec-414d-a79e-711c565f72d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:59.385732 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0b5e3-84ec-414d-a79e-711c565f72d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:59.386358 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0b5e3-84ec-414d-a79e-711c565f72d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:59.386697 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0b5e3-84ec-414d-a79e-711c565f72d9 admin admin] PATH_INFO: `/v3/projects/073f8ddfbd5549678e50adaca20fa9c0/users/32ed64b99e2c47aa9641e02d6145f152/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:59.414823 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0b5e3-84ec-414d-a79e-711c565f72d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=073f8ddfbd5549678e50adaca20fa9c0, user_id=32ed64b99e2c47aa9641e02d6145f152, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:59.418250 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0b5e3-84ec-414d-a79e-711c565f72d9 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:59.448221 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1249/2501] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:45:59 2022] PUT /identity/v3/projects/073f8ddfbd5549678e50adaca20fa9c0/users/32ed64b99e2c47aa9641e02d6145f152/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:45:59.462862 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489230e-b52c-4e38-86c9-c44fa7dfb44a None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:59.463223 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489230e-b52c-4e38-86c9-c44fa7dfb44a None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:59.463423 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489230e-b52c-4e38-86c9-c44fa7dfb44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:59.520371 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-4489230e-b52c-4e38-86c9-c44fa7dfb44a None None] MFA Rules not processed for user `32ed64b99e2c47aa9641e02d6145f152`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:45:59.521615 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-4489230e-b52c-4e38-86c9-c44fa7dfb44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:45:59.638248 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1253/2502] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:45:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:45:59.640210 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0b5e3-84ec-414d-a79e-711c565f72d9 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:59.735367 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0b5e3-84ec-414d-a79e-711c565f72d9 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:59.747647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393fdb7-16ca-4fa8-ab2c-3c664379865f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:59.748248 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393fdb7-16ca-4fa8-ab2c-3c664379865f admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:59.748684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393fdb7-16ca-4fa8-ab2c-3c664379865f admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:59.748971 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393fdb7-16ca-4fa8-ab2c-3c664379865f admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:59.749711 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393fdb7-16ca-4fa8-ab2c-3c664379865f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:59.752305 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393fdb7-16ca-4fa8-ab2c-3c664379865f admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:59.789933 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1250/2503] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:45:59 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:45:59.791626 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489230e-b52c-4e38-86c9-c44fa7dfb44a None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:59.810026 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489230e-b52c-4e38-86c9-c44fa7dfb44a None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:59.890844 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589d417-a726-4164-aa6a-ac24f24ac984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:59.891787 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589d417-a726-4164-aa6a-ac24f24ac984 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:59.892245 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589d417-a726-4164-aa6a-ac24f24ac984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:59.892690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589d417-a726-4164-aa6a-ac24f24ac984 admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:59.894463 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589d417-a726-4164-aa6a-ac24f24ac984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:59.898796 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589d417-a726-4164-aa6a-ac24f24ac984 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:59.933450 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1254/2504] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:45:59 2022] POST /identity/v3/users => generated 294 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:45:59.937935 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393fdb7-16ca-4fa8-ab2c-3c664379865f admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:59.949853 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393fdb7-16ca-4fa8-ab2c-3c664379865f admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:45:59.956831 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f554379-043e-49c0-82c5-32f600b51e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:45:59.957536 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f554379-043e-49c0-82c5-32f600b51e00 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:45:59.957834 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f554379-043e-49c0-82c5-32f600b51e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:45:59.958121 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f554379-043e-49c0-82c5-32f600b51e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:45:59.958780 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f554379-043e-49c0-82c5-32f600b51e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:45:59.961413 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f554379-043e-49c0-82c5-32f600b51e00 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:45:59.978575 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1251/2505] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:45:59.979137 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589d417-a726-4164-aa6a-ac24f24ac984 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:45:59.998914 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589d417-a726-4164-aa6a-ac24f24ac984 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:00.006847 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54fed1a-0543-4385-85ed-f338d5f8af2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:00.008248 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fed1a-0543-4385-85ed-f338d5f8af2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:00.008750 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fed1a-0543-4385-85ed-f338d5f8af2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:00.009241 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fed1a-0543-4385-85ed-f338d5f8af2c admin admin] PATH_INFO: `/v3/projects/6b2b1acfdc944d3fa0e421e941b4e6df/users/53202ba5df5a46708f49e0790996dc18/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:00.037643 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54fed1a-0543-4385-85ed-f338d5f8af2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b2b1acfdc944d3fa0e421e941b4e6df, user_id=53202ba5df5a46708f49e0790996dc18, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:00.040469 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54fed1a-0543-4385-85ed-f338d5f8af2c admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:00.064232 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1255/2506] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:45:59 2022] PUT /identity/v3/projects/6b2b1acfdc944d3fa0e421e941b4e6df/users/53202ba5df5a46708f49e0790996dc18/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:46:00.066561 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f554379-043e-49c0-82c5-32f600b51e00 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:00.077165 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f554379-043e-49c0-82c5-32f600b51e00 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:00.154221 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6160acb-3044-48ee-8c6a-c150bec462c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:00.154977 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6160acb-3044-48ee-8c6a-c150bec462c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:00.155264 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6160acb-3044-48ee-8c6a-c150bec462c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:00.155543 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6160acb-3044-48ee-8c6a-c150bec462c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:00.156284 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6160acb-3044-48ee-8c6a-c150bec462c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:00.158122 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6160acb-3044-48ee-8c6a-c150bec462c9 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:00.173834 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1252/2507] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:46:00.175605 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54fed1a-0543-4385-85ed-f338d5f8af2c admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:00.202972 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54fed1a-0543-4385-85ed-f338d5f8af2c admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:00.208315 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c389ff-f39f-4137-a1f0-79e4b2102f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:00.209351 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c389ff-f39f-4137-a1f0-79e4b2102f84 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:00.209568 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c389ff-f39f-4137-a1f0-79e4b2102f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:00.209842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c389ff-f39f-4137-a1f0-79e4b2102f84 admin admin] PATH_INFO: `/v3/projects/6b2b1acfdc944d3fa0e421e941b4e6df/users/53202ba5df5a46708f49e0790996dc18/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:00.213467 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c389ff-f39f-4137-a1f0-79e4b2102f84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b2b1acfdc944d3fa0e421e941b4e6df, user_id=53202ba5df5a46708f49e0790996dc18, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:00.217020 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c389ff-f39f-4137-a1f0-79e4b2102f84 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:00.231925 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1256/2508] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:46:00 2022] PUT /identity/v3/projects/6b2b1acfdc944d3fa0e421e941b4e6df/users/53202ba5df5a46708f49e0790996dc18/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:46:00.242439 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d2a1c-1571-433f-88db-0155e69e69de None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:00.242768 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d2a1c-1571-433f-88db-0155e69e69de None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:00.243002 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d2a1c-1571-433f-88db-0155e69e69de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:00.278498 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-1a2d2a1c-1571-433f-88db-0155e69e69de None None] MFA Rules not processed for user `53202ba5df5a46708f49e0790996dc18`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:46:00.280402 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-1a2d2a1c-1571-433f-88db-0155e69e69de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:00.381023 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1253/2509] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:46:00 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:46:00.387030 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c389ff-f39f-4137-a1f0-79e4b2102f84 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:00.388854 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-61c389ff-f39f-4137-a1f0-79e4b2102f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:00.469276 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c389ff-f39f-4137-a1f0-79e4b2102f84 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:00.479655 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5424ce6-b45e-4ffe-8e55-7288cf9671f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:00.481784 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5424ce6-b45e-4ffe-8e55-7288cf9671f4 service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:00.482522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5424ce6-b45e-4ffe-8e55-7288cf9671f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:00.482879 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5424ce6-b45e-4ffe-8e55-7288cf9671f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:00.600828 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5424ce6-b45e-4ffe-8e55-7288cf9671f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:00.602336 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5424ce6-b45e-4ffe-8e55-7288cf9671f4 service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:00.618160 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1257/2510] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:46:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:46:02.360101 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d2a1c-1571-433f-88db-0155e69e69de None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:02.362173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-1a2d2a1c-1571-433f-88db-0155e69e69de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:02.405364 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d2a1c-1571-433f-88db-0155e69e69de None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:02.409765 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad318d85-a76a-4b98-9830-0d63f32f5eb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:02.410753 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad318d85-a76a-4b98-9830-0d63f32f5eb0 service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:02.411036 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad318d85-a76a-4b98-9830-0d63f32f5eb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:02.411308 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad318d85-a76a-4b98-9830-0d63f32f5eb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:02.519715 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad318d85-a76a-4b98-9830-0d63f32f5eb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:02.521355 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad318d85-a76a-4b98-9830-0d63f32f5eb0 service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:02.531807 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1254/2511] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:46:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:46:03.129211 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5424ce6-b45e-4ffe-8e55-7288cf9671f4 service cinder] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:03.151084 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5424ce6-b45e-4ffe-8e55-7288cf9671f4 service cinder] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:03.154871 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785187c-96ea-436a-abae-0886ac132ebe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:03.155513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785187c-96ea-436a-abae-0886ac132ebe service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:03.155983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785187c-96ea-436a-abae-0886ac132ebe service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:03.156259 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785187c-96ea-436a-abae-0886ac132ebe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:03.179342 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785187c-96ea-436a-abae-0886ac132ebe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:03.181889 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785187c-96ea-436a-abae-0886ac132ebe service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:03.192538 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1258/2512] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:46:03 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:46:06.533622 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad318d85-a76a-4b98-9830-0d63f32f5eb0 service cinder] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:06.536081 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-ad318d85-a76a-4b98-9830-0d63f32f5eb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:06.658596 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07bb95-db56-4439-b537-77c21ca52ae5 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:06.659827 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07bb95-db56-4439-b537-77c21ca52ae5 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:06.659827 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07bb95-db56-4439-b537-77c21ca52ae5 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:06.661394 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1259/2513] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 12 09:46:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 09:46:06.668624 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1efea-207c-4586-8565-64d5eb7ee9c5 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:06.669159 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1efea-207c-4586-8565-64d5eb7ee9c5 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:06.669605 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1efea-207c-4586-8565-64d5eb7ee9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:06.673320 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad318d85-a76a-4b98-9830-0d63f32f5eb0 service cinder] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:06.678717 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6472973-3c35-4548-bcef-72f53653f997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:06.679615 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6472973-3c35-4548-bcef-72f53653f997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:06.679983 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6472973-3c35-4548-bcef-72f53653f997 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:06.680267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6472973-3c35-4548-bcef-72f53653f997 admin admin] PATH_INFO: `/v3/users/fde21f628031431583e085d26485451d` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:06.681654 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6472973-3c35-4548-bcef-72f53653f997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fde21f628031431583e085d26485451d)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:06.686763 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6472973-3c35-4548-bcef-72f53653f997 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:06.696100 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-4df1efea-207c-4586-8565-64d5eb7ee9c5 None None] MFA Rules not processed for user `2915babd40aa42e8bf7cc85c5a97daa6`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:46:06.697663 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-4df1efea-207c-4586-8565-64d5eb7ee9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:06.767092 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-d6472973-3c35-4548-bcef-72f53653f997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fde21f628031431583e085d26485451d'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:06.785874 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-d6472973-3c35-4548-bcef-72f53653f997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fde21f628031431583e085d26485451d'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:06.786699 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-d6472973-3c35-4548-bcef-72f53653f997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fde21f628031431583e085d26485451d'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:06.797120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-d6472973-3c35-4548-bcef-72f53653f997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fde21f628031431583e085d26485451d'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:06.811695 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1260/2514] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 12 09:46:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:46:06.812014 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-d6472973-3c35-4548-bcef-72f53653f997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fde21f628031431583e085d26485451d'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:06.813334 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1255/2515] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:46:06 2022] DELETE /identity/v3/users/fde21f628031431583e085d26485451d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:46:06.821296 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1efea-207c-4586-8565-64d5eb7ee9c5 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:06.823127 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-4df1efea-207c-4586-8565-64d5eb7ee9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:06.882950 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1efea-207c-4586-8565-64d5eb7ee9c5 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:06.932002 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0595cb-0f21-4b93-9a2a-de3224ee4c29 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0981a8c6d9ac413b99aae95a6cdd3be5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:06.932655 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0595cb-0f21-4b93-9a2a-de3224ee4c29 service glance] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:06.932936 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0595cb-0f21-4b93-9a2a-de3224ee4c29 service glance] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:06.933207 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0595cb-0f21-4b93-9a2a-de3224ee4c29 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:06.935045 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-cc0595cb-0f21-4b93-9a2a-de3224ee4c29 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:06.995236 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6472973-3c35-4548-bcef-72f53653f997 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:06.996737 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-d6472973-3c35-4548-bcef-72f53653f997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:07.007621 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0595cb-0f21-4b93-9a2a-de3224ee4c29 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:07.009323 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0595cb-0f21-4b93-9a2a-de3224ee4c29 service glance] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:07.022383 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1261/2516] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:46:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:46:07.082307 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6472973-3c35-4548-bcef-72f53653f997 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:07.087997 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d14281-ed67-4f9b-a820-f0053cb54132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:07.089741 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d14281-ed67-4f9b-a820-f0053cb54132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:07.090289 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d14281-ed67-4f9b-a820-f0053cb54132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:07.090569 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d14281-ed67-4f9b-a820-f0053cb54132 admin admin] PATH_INFO: `/v3/projects/170aaa04d8fe4170bf344d5667ae2814` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:07.092410 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d14281-ed67-4f9b-a820-f0053cb54132 admin admin] RBAC: Authorizing `identity:delete_project(project_id=170aaa04d8fe4170bf344d5667ae2814)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:07.098799 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d14281-ed67-4f9b-a820-f0053cb54132 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:07.174160 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-87d14281-ed67-4f9b-a820-f0053cb54132 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '170aaa04d8fe4170bf344d5667ae2814', 'request_id': 'req-87d14281-ed67-4f9b-a820-f0053cb54132'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:07.187287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-87d14281-ed67-4f9b-a820-f0053cb54132 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '170aaa04d8fe4170bf344d5667ae2814', 'request_id': 'req-87d14281-ed67-4f9b-a820-f0053cb54132'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:07.198745 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-87d14281-ed67-4f9b-a820-f0053cb54132 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '170aaa04d8fe4170bf344d5667ae2814', 'request_id': 'req-87d14281-ed67-4f9b-a820-f0053cb54132'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:07.206683 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0595cb-0f21-4b93-9a2a-de3224ee4c29 service glance] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:07.208194 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-cc0595cb-0f21-4b93-9a2a-de3224ee4c29 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:07.215538 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-87d14281-ed67-4f9b-a820-f0053cb54132 admin admin] The token cache is being invalidate because project 170aaa04d8fe4170bf344d5667ae2814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:46:07.215886 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-87d14281-ed67-4f9b-a820-f0053cb54132 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:07.216525 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-87d14281-ed67-4f9b-a820-f0053cb54132 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:07.218168 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1256/2517] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:46:06 2022] DELETE /identity/v3/projects/170aaa04d8fe4170bf344d5667ae2814 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:46:07.223141 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d14281-ed67-4f9b-a820-f0053cb54132 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:07.224009 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-87d14281-ed67-4f9b-a820-f0053cb54132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:07.224146 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0595cb-0f21-4b93-9a2a-de3224ee4c29 service glance] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:07.283071 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d4d1e-e069-4439-9289-a34be8445ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:07.284565 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d4d1e-e069-4439-9289-a34be8445ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:07.284848 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d4d1e-e069-4439-9289-a34be8445ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:07.285121 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d4d1e-e069-4439-9289-a34be8445ecc admin admin] PATH_INFO: `/v3/users/b2013d3e84864823b890ff7d43d4a2bf` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:07.286365 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d4d1e-e069-4439-9289-a34be8445ecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2013d3e84864823b890ff7d43d4a2bf)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:07.288331 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d4d1e-e069-4439-9289-a34be8445ecc admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:07.296854 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d14281-ed67-4f9b-a820-f0053cb54132 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:07.306094 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf31c8c-a2c7-4deb-9641-d50c49f99154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:07.307076 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf31c8c-a2c7-4deb-9641-d50c49f99154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:07.307358 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf31c8c-a2c7-4deb-9641-d50c49f99154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:07.307631 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf31c8c-a2c7-4deb-9641-d50c49f99154 admin admin] PATH_INFO: `/v3/users/ad5e112210324141b014a49f338470b7` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:07.309172 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf31c8c-a2c7-4deb-9641-d50c49f99154 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad5e112210324141b014a49f338470b7)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:07.311270 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf31c8c-a2c7-4deb-9641-d50c49f99154 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:07.353426 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-6d8d4d1e-e069-4439-9289-a34be8445ecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2013d3e84864823b890ff7d43d4a2bf'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:07.359828 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-aaf31c8c-a2c7-4deb-9641-d50c49f99154 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad5e112210324141b014a49f338470b7'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:07.366402 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-6d8d4d1e-e069-4439-9289-a34be8445ecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2013d3e84864823b890ff7d43d4a2bf'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:07.367593 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-6d8d4d1e-e069-4439-9289-a34be8445ecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2013d3e84864823b890ff7d43d4a2bf'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:07.372954 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-aaf31c8c-a2c7-4deb-9641-d50c49f99154 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad5e112210324141b014a49f338470b7'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:07.373612 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-aaf31c8c-a2c7-4deb-9641-d50c49f99154 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad5e112210324141b014a49f338470b7'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:07.379596 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-6d8d4d1e-e069-4439-9289-a34be8445ecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2013d3e84864823b890ff7d43d4a2bf'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:07.382877 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-aaf31c8c-a2c7-4deb-9641-d50c49f99154 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad5e112210324141b014a49f338470b7'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:07.388275 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-6d8d4d1e-e069-4439-9289-a34be8445ecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2013d3e84864823b890ff7d43d4a2bf'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:07.391072 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-aaf31c8c-a2c7-4deb-9641-d50c49f99154 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad5e112210324141b014a49f338470b7'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:07.396959 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1262/2518] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:46:07 2022] DELETE /identity/v3/users/b2013d3e84864823b890ff7d43d4a2bf => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:46:07.397878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1257/2519] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:46:07 2022] DELETE /identity/v3/users/ad5e112210324141b014a49f338470b7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:46:07.403541 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b6f03-7ad1-4004-b98a-510b5b4d33a5 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:07.404166 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b6f03-7ad1-4004-b98a-510b5b4d33a5 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:07.404646 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b6f03-7ad1-4004-b98a-510b5b4d33a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:07.442328 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-852b6f03-7ad1-4004-b98a-510b5b4d33a5 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:46:07.443215 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-852b6f03-7ad1-4004-b98a-510b5b4d33a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:07.523955 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1263/2520] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:46:07.533661 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf31c8c-a2c7-4deb-9641-d50c49f99154 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:07.535205 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-aaf31c8c-a2c7-4deb-9641-d50c49f99154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:07.588278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b6f03-7ad1-4004-b98a-510b5b4d33a5 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:07.591417 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-852b6f03-7ad1-4004-b98a-510b5b4d33a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:07.605357 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b6f03-7ad1-4004-b98a-510b5b4d33a5 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:07.610911 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8df8b4-0a2e-4644-b7c6-d87de722d63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:07.611783 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8df8b4-0a2e-4644-b7c6-d87de722d63b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:07.612587 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8df8b4-0a2e-4644-b7c6-d87de722d63b admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:07.612861 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8df8b4-0a2e-4644-b7c6-d87de722d63b admin admin] PATH_INFO: `/v3/projects/06c18e1915ff41efaf481513fe6f496c` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:07.614302 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8df8b4-0a2e-4644-b7c6-d87de722d63b admin admin] RBAC: Authorizing `identity:delete_project(project_id=06c18e1915ff41efaf481513fe6f496c)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:07.616926 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8df8b4-0a2e-4644-b7c6-d87de722d63b admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:07.647815 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf31c8c-a2c7-4deb-9641-d50c49f99154 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:07.652229 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6612b-dc38-4f39-89d2-c14f9c0d3eb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:07.652993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6612b-dc38-4f39-89d2-c14f9c0d3eb5 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:07.653279 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6612b-dc38-4f39-89d2-c14f9c0d3eb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:07.653563 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6612b-dc38-4f39-89d2-c14f9c0d3eb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:07.663572 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c6612b-dc38-4f39-89d2-c14f9c0d3eb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:07.665782 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c6612b-dc38-4f39-89d2-c14f9c0d3eb5 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:07.670128 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4d8df8b4-0a2e-4644-b7c6-d87de722d63b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06c18e1915ff41efaf481513fe6f496c', 'request_id': 'req-4d8df8b4-0a2e-4644-b7c6-d87de722d63b'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:07.678803 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4d8df8b4-0a2e-4644-b7c6-d87de722d63b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06c18e1915ff41efaf481513fe6f496c', 'request_id': 'req-4d8df8b4-0a2e-4644-b7c6-d87de722d63b'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:07.679278 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1258/2521] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:46:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 09:46:07.689551 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4d8df8b4-0a2e-4644-b7c6-d87de722d63b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06c18e1915ff41efaf481513fe6f496c', 'request_id': 'req-4d8df8b4-0a2e-4644-b7c6-d87de722d63b'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:07.703537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4d8df8b4-0a2e-4644-b7c6-d87de722d63b admin admin] The token cache is being invalidate because project 06c18e1915ff41efaf481513fe6f496c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:46:07.703819 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4d8df8b4-0a2e-4644-b7c6-d87de722d63b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:07.704986 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4d8df8b4-0a2e-4644-b7c6-d87de722d63b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:07.706667 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1264/2522] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:46:07 2022] DELETE /identity/v3/projects/06c18e1915ff41efaf481513fe6f496c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:46:08.050628 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6612b-dc38-4f39-89d2-c14f9c0d3eb5 service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:08.052135 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-77c6612b-dc38-4f39-89d2-c14f9c0d3eb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:08.066039 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6612b-dc38-4f39-89d2-c14f9c0d3eb5 service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:08.122825 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a539a-bf1b-4277-9532-61d709c567ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:08.123690 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a539a-bf1b-4277-9532-61d709c567ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:08.123963 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a539a-bf1b-4277-9532-61d709c567ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:08.124234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a539a-bf1b-4277-9532-61d709c567ba admin admin] PATH_INFO: `/v3/projects/fdf8fd68dc204ced92a64f35ff547353` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:08.125421 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a539a-bf1b-4277-9532-61d709c567ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdf8fd68dc204ced92a64f35ff547353)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:08.127493 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a539a-bf1b-4277-9532-61d709c567ba admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:08.174362 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e91a539a-bf1b-4277-9532-61d709c567ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdf8fd68dc204ced92a64f35ff547353', 'request_id': 'req-e91a539a-bf1b-4277-9532-61d709c567ba'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:08.180200 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e91a539a-bf1b-4277-9532-61d709c567ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdf8fd68dc204ced92a64f35ff547353', 'request_id': 'req-e91a539a-bf1b-4277-9532-61d709c567ba'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:08.187390 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e91a539a-bf1b-4277-9532-61d709c567ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdf8fd68dc204ced92a64f35ff547353', 'request_id': 'req-e91a539a-bf1b-4277-9532-61d709c567ba'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:08.198939 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e91a539a-bf1b-4277-9532-61d709c567ba admin admin] The token cache is being invalidate because project fdf8fd68dc204ced92a64f35ff547353 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:46:08.199151 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e91a539a-bf1b-4277-9532-61d709c567ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:08.199944 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e91a539a-bf1b-4277-9532-61d709c567ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:08.201554 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1259/2523] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:46:08 2022] DELETE /identity/v3/projects/fdf8fd68dc204ced92a64f35ff547353 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:46:08.205644 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8df8b4-0a2e-4644-b7c6-d87de722d63b admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:08.207332 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-4d8df8b4-0a2e-4644-b7c6-d87de722d63b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:08.220966 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8df8b4-0a2e-4644-b7c6-d87de722d63b admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:08.278942 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98245b-de38-496e-90a9-eae85b0e821a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:08.280034 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98245b-de38-496e-90a9-eae85b0e821a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:08.280376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98245b-de38-496e-90a9-eae85b0e821a admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:08.280655 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98245b-de38-496e-90a9-eae85b0e821a admin admin] PATH_INFO: `/v3/users/32ed64b99e2c47aa9641e02d6145f152` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:08.281966 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98245b-de38-496e-90a9-eae85b0e821a admin admin] RBAC: Authorizing `identity:delete_user(user_id=32ed64b99e2c47aa9641e02d6145f152)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:08.283946 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98245b-de38-496e-90a9-eae85b0e821a admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:08.330406 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-1f98245b-de38-496e-90a9-eae85b0e821a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32ed64b99e2c47aa9641e02d6145f152'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:08.341847 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-1f98245b-de38-496e-90a9-eae85b0e821a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32ed64b99e2c47aa9641e02d6145f152'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:08.342542 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-1f98245b-de38-496e-90a9-eae85b0e821a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32ed64b99e2c47aa9641e02d6145f152'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:08.349333 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-1f98245b-de38-496e-90a9-eae85b0e821a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32ed64b99e2c47aa9641e02d6145f152'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:08.355973 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-1f98245b-de38-496e-90a9-eae85b0e821a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32ed64b99e2c47aa9641e02d6145f152'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:08.361752 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1265/2524] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:46:08 2022] DELETE /identity/v3/users/32ed64b99e2c47aa9641e02d6145f152 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:46:08.643335 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a539a-bf1b-4277-9532-61d709c567ba admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:08.644773 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-e91a539a-bf1b-4277-9532-61d709c567ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:08.657173 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a539a-bf1b-4277-9532-61d709c567ba admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:08.713556 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4af92-0ba4-4fc4-9155-2edc7a1208e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:08.714377 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4af92-0ba4-4fc4-9155-2edc7a1208e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:08.714680 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4af92-0ba4-4fc4-9155-2edc7a1208e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:08.714932 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4af92-0ba4-4fc4-9155-2edc7a1208e4 admin admin] PATH_INFO: `/v3/projects/073f8ddfbd5549678e50adaca20fa9c0` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:08.716178 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4af92-0ba4-4fc4-9155-2edc7a1208e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=073f8ddfbd5549678e50adaca20fa9c0)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:08.718119 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4af92-0ba4-4fc4-9155-2edc7a1208e4 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:08.774521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-88a4af92-0ba4-4fc4-9155-2edc7a1208e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '073f8ddfbd5549678e50adaca20fa9c0', 'request_id': 'req-88a4af92-0ba4-4fc4-9155-2edc7a1208e4'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:08.779927 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-88a4af92-0ba4-4fc4-9155-2edc7a1208e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '073f8ddfbd5549678e50adaca20fa9c0', 'request_id': 'req-88a4af92-0ba4-4fc4-9155-2edc7a1208e4'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:08.788187 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-88a4af92-0ba4-4fc4-9155-2edc7a1208e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '073f8ddfbd5549678e50adaca20fa9c0', 'request_id': 'req-88a4af92-0ba4-4fc4-9155-2edc7a1208e4'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:08.800741 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-88a4af92-0ba4-4fc4-9155-2edc7a1208e4 admin admin] The token cache is being invalidate because project 073f8ddfbd5549678e50adaca20fa9c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:46:08.801028 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-88a4af92-0ba4-4fc4-9155-2edc7a1208e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:08.801661 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-88a4af92-0ba4-4fc4-9155-2edc7a1208e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:08.803214 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1260/2525] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:46:08 2022] DELETE /identity/v3/projects/073f8ddfbd5549678e50adaca20fa9c0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:46:08.807152 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98245b-de38-496e-90a9-eae85b0e821a admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:08.808553 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-1f98245b-de38-496e-90a9-eae85b0e821a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:08.821285 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98245b-de38-496e-90a9-eae85b0e821a admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:08.883654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc1b05-897d-498b-b5a2-650f15820310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:08.884532 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc1b05-897d-498b-b5a2-650f15820310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:08.884814 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc1b05-897d-498b-b5a2-650f15820310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:08.885089 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc1b05-897d-498b-b5a2-650f15820310 admin admin] PATH_INFO: `/v3/users/53202ba5df5a46708f49e0790996dc18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:08.886570 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc1b05-897d-498b-b5a2-650f15820310 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53202ba5df5a46708f49e0790996dc18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:08.888474 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc1b05-897d-498b-b5a2-650f15820310 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:08.936244 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e4dc1b05-897d-498b-b5a2-650f15820310 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53202ba5df5a46708f49e0790996dc18'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:08.947358 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e4dc1b05-897d-498b-b5a2-650f15820310 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53202ba5df5a46708f49e0790996dc18'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:08.948016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e4dc1b05-897d-498b-b5a2-650f15820310 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53202ba5df5a46708f49e0790996dc18'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:08.955064 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e4dc1b05-897d-498b-b5a2-650f15820310 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53202ba5df5a46708f49e0790996dc18'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:08.962444 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e4dc1b05-897d-498b-b5a2-650f15820310 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53202ba5df5a46708f49e0790996dc18'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:08.968348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1266/2526] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:46:08 2022] DELETE /identity/v3/users/53202ba5df5a46708f49e0790996dc18 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:46:09.376722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4af92-0ba4-4fc4-9155-2edc7a1208e4 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:09.378718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-88a4af92-0ba4-4fc4-9155-2edc7a1208e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:09.391369 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4af92-0ba4-4fc4-9155-2edc7a1208e4 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:09.448615 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8192ef-6db4-47a1-bfd6-0e78d749d42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:09.449491 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8192ef-6db4-47a1-bfd6-0e78d749d42a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:09.449774 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8192ef-6db4-47a1-bfd6-0e78d749d42a admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:09.450078 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8192ef-6db4-47a1-bfd6-0e78d749d42a admin admin] PATH_INFO: `/v3/projects/6b2b1acfdc944d3fa0e421e941b4e6df` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:09.451311 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8192ef-6db4-47a1-bfd6-0e78d749d42a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b2b1acfdc944d3fa0e421e941b4e6df)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:09.453205 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8192ef-6db4-47a1-bfd6-0e78d749d42a admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:09.501531 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-6b8192ef-6db4-47a1-bfd6-0e78d749d42a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b2b1acfdc944d3fa0e421e941b4e6df', 'request_id': 'req-6b8192ef-6db4-47a1-bfd6-0e78d749d42a'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:09.507397 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-6b8192ef-6db4-47a1-bfd6-0e78d749d42a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b2b1acfdc944d3fa0e421e941b4e6df', 'request_id': 'req-6b8192ef-6db4-47a1-bfd6-0e78d749d42a'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:09.515154 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-6b8192ef-6db4-47a1-bfd6-0e78d749d42a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b2b1acfdc944d3fa0e421e941b4e6df', 'request_id': 'req-6b8192ef-6db4-47a1-bfd6-0e78d749d42a'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:09.525867 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-6b8192ef-6db4-47a1-bfd6-0e78d749d42a admin admin] The token cache is being invalidate because project 6b2b1acfdc944d3fa0e421e941b4e6df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:46:09.526187 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-6b8192ef-6db4-47a1-bfd6-0e78d749d42a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:09.526803 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-6b8192ef-6db4-47a1-bfd6-0e78d749d42a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:09.528320 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1261/2527] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:46:09 2022] DELETE /identity/v3/projects/6b2b1acfdc944d3fa0e421e941b4e6df => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:46:09.533078 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213db3e-a1b4-4efb-9ad5-40a1b2b37dd2 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:09.533369 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213db3e-a1b4-4efb-9ad5-40a1b2b37dd2 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:09.533647 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213db3e-a1b4-4efb-9ad5-40a1b2b37dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:09.570195 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-b213db3e-a1b4-4efb-9ad5-40a1b2b37dd2 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:46:09.571368 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-b213db3e-a1b4-4efb-9ad5-40a1b2b37dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:09.627283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1267/2528] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:46:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:46:09.635013 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b48a5d-d86c-4658-98ef-94ebd4040dcf None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:09.635305 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b48a5d-d86c-4658-98ef-94ebd4040dcf None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:09.635584 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b48a5d-d86c-4658-98ef-94ebd4040dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:09.654418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-98b48a5d-d86c-4658-98ef-94ebd4040dcf None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:46:09.655601 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-98b48a5d-d86c-4658-98ef-94ebd4040dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:09.664510 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1262/2529] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:46:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:46:09.668847 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213db3e-a1b4-4efb-9ad5-40a1b2b37dd2 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:09.669423 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f010f82-3d88-4b0f-9df8-9b84f74f5ac4 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:09.669709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f010f82-3d88-4b0f-9df8-9b84f74f5ac4 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:09.670008 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f010f82-3d88-4b0f-9df8-9b84f74f5ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:09.678303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213db3e-a1b4-4efb-9ad5-40a1b2b37dd2 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:09.682801 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07783d9c-a5e0-4e7a-86e6-401b0e2bd894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:09.683449 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07783d9c-a5e0-4e7a-86e6-401b0e2bd894 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:09.683724 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07783d9c-a5e0-4e7a-86e6-401b0e2bd894 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:09.683994 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07783d9c-a5e0-4e7a-86e6-401b0e2bd894 admin admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:09.684731 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07783d9c-a5e0-4e7a-86e6-401b0e2bd894 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:46:09.685032 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07783d9c-a5e0-4e7a-86e6-401b0e2bd894 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:09.686650 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07783d9c-a5e0-4e7a-86e6-401b0e2bd894 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:09.686944 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-7f010f82-3d88-4b0f-9df8-9b84f74f5ac4 None None] MFA Rules not processed for user `bd41f419750140268f4d4b77456065c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:46:09.688117 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-7f010f82-3d88-4b0f-9df8-9b84f74f5ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:09.697890 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1268/2530] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:46:09.702213 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07783d9c-a5e0-4e7a-86e6-401b0e2bd894 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:09.711917 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07783d9c-a5e0-4e7a-86e6-401b0e2bd894 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:09.716474 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5558cf9-eafa-440d-956a-76cd704b2344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:09.717086 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5558cf9-eafa-440d-956a-76cd704b2344 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:09.717364 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5558cf9-eafa-440d-956a-76cd704b2344 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:09.717631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5558cf9-eafa-440d-956a-76cd704b2344 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:09.718329 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5558cf9-eafa-440d-956a-76cd704b2344 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:09.720217 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5558cf9-eafa-440d-956a-76cd704b2344 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:09.742971 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1263/2531] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 12 09:46:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:46:09.746587 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1269/2532] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:46:09 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:46:09.751126 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f010f82-3d88-4b0f-9df8-9b84f74f5ac4 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:09.760495 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5558cf9-eafa-440d-956a-76cd704b2344 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:09.762416 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-a5558cf9-eafa-440d-956a-76cd704b2344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:09.765131 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f010f82-3d88-4b0f-9df8-9b84f74f5ac4 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:09.819663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167c814-e96a-4c81-b2d6-e80a1211cb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:09.820326 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167c814-e96a-4c81-b2d6-e80a1211cb65 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:09.820663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167c814-e96a-4c81-b2d6-e80a1211cb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:09.820960 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167c814-e96a-4c81-b2d6-e80a1211cb65 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:09.821639 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167c814-e96a-4c81-b2d6-e80a1211cb65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:09.823588 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167c814-e96a-4c81-b2d6-e80a1211cb65 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:09.828482 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5558cf9-eafa-440d-956a-76cd704b2344 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:09.833589 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebbbb9-b7cf-4661-a96a-c1106d68e111 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7693a31911346f9bb2c01efcd8e16e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:09.834265 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebbbb9-b7cf-4661-a96a-c1106d68e111 service swift] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:09.834607 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebbbb9-b7cf-4661-a96a-c1106d68e111 service swift] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:09.834936 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebbbb9-b7cf-4661-a96a-c1106d68e111 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:09.845778 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1264/2533] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:46:09 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:46:09.846803 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167c814-e96a-4c81-b2d6-e80a1211cb65 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:09.855946 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167c814-e96a-4c81-b2d6-e80a1211cb65 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:09.860510 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733d05f-bbab-448c-81d6-7519e64e5bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:09.861141 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733d05f-bbab-448c-81d6-7519e64e5bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:09.861416 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733d05f-bbab-448c-81d6-7519e64e5bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:09.861683 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733d05f-bbab-448c-81d6-7519e64e5bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:09.862956 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733d05f-bbab-448c-81d6-7519e64e5bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:09.864798 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733d05f-bbab-448c-81d6-7519e64e5bc6 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:09.874044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1265/2534] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:46:09.877924 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733d05f-bbab-448c-81d6-7519e64e5bc6 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:09.888176 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733d05f-bbab-448c-81d6-7519e64e5bc6 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:09.891859 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebbbb9-b7cf-4661-a96a-c1106d68e111 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:09.892813 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672872d-59fd-4249-8b6a-1bbc9e05e0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:09.893488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672872d-59fd-4249-8b6a-1bbc9e05e0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:09.893601 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebbbb9-b7cf-4661-a96a-c1106d68e111 service swift] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:09.893770 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672872d-59fd-4249-8b6a-1bbc9e05e0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:09.894079 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672872d-59fd-4249-8b6a-1bbc9e05e0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:09.894789 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672872d-59fd-4249-8b6a-1bbc9e05e0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:09.896342 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672872d-59fd-4249-8b6a-1bbc9e05e0a2 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:09.901715 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1270/2535] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 12 09:46:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 09:46:09.907530 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1266/2536] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:46:09.911859 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebbbb9-b7cf-4661-a96a-c1106d68e111 service swift] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:09.922422 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebbbb9-b7cf-4661-a96a-c1106d68e111 service swift] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:09.927738 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a14ad8-d636-4df7-a3e5-b073a89d660d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:09.928683 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a14ad8-d636-4df7-a3e5-b073a89d660d admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:09.928891 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a14ad8-d636-4df7-a3e5-b073a89d660d admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:09.929193 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a14ad8-d636-4df7-a3e5-b073a89d660d admin admin] PATH_INFO: `/v3/projects/f905d25356874ac88be7ed35a624e230/users/8427a2000ab943f6a6fa72d068efe2ac/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:09.945499 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a14ad8-d636-4df7-a3e5-b073a89d660d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f905d25356874ac88be7ed35a624e230, user_id=8427a2000ab943f6a6fa72d068efe2ac, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:09.948340 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a14ad8-d636-4df7-a3e5-b073a89d660d admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:09.966407 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1271/2537] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:46:09 2022] PUT /identity/v3/projects/f905d25356874ac88be7ed35a624e230/users/8427a2000ab943f6a6fa72d068efe2ac/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:46:09.976375 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c4894-f818-49f2-baed-f89e52f095d4 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:09.976889 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c4894-f818-49f2-baed-f89e52f095d4 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:09.977393 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c4894-f818-49f2-baed-f89e52f095d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:10.002419 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-257c4894-f818-49f2-baed-f89e52f095d4 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:46:10.004367 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-257c4894-f818-49f2-baed-f89e52f095d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:10.068286 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1267/2538] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:46:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:46:10.078652 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a14ad8-d636-4df7-a3e5-b073a89d660d admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:10.083212 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-47a14ad8-d636-4df7-a3e5-b073a89d660d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:10.150805 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a14ad8-d636-4df7-a3e5-b073a89d660d admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:10.155650 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63593ec-273d-4e12-a3cc-d541fc8d153a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:10.156934 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63593ec-273d-4e12-a3cc-d541fc8d153a service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:10.157547 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63593ec-273d-4e12-a3cc-d541fc8d153a service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:10.158076 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63593ec-273d-4e12-a3cc-d541fc8d153a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:10.168351 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63593ec-273d-4e12-a3cc-d541fc8d153a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:10.169927 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63593ec-273d-4e12-a3cc-d541fc8d153a service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:10.180345 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1272/2539] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:46:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:46:10.904952 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9398d2c-c54c-42dc-91ee-9352202bc4d9 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:10.905939 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9398d2c-c54c-42dc-91ee-9352202bc4d9 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:10.906218 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9398d2c-c54c-42dc-91ee-9352202bc4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:10.941318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-e9398d2c-c54c-42dc-91ee-9352202bc4d9 None None] MFA Rules not processed for user `8427a2000ab943f6a6fa72d068efe2ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:46:10.942558 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-e9398d2c-c54c-42dc-91ee-9352202bc4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:11.023988 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1268/2540] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:46:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:46:11.035120 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63593ec-273d-4e12-a3cc-d541fc8d153a service neutron] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:11.036779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-e63593ec-273d-4e12-a3cc-d541fc8d153a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:11.120766 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63593ec-273d-4e12-a3cc-d541fc8d153a service neutron] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:11.124586 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953281a-30b4-48e1-9807-33e2abac19bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:11.125440 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953281a-30b4-48e1-9807-33e2abac19bd service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:11.125720 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953281a-30b4-48e1-9807-33e2abac19bd service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:11.126025 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953281a-30b4-48e1-9807-33e2abac19bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:11.135616 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e953281a-30b4-48e1-9807-33e2abac19bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:11.137506 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e953281a-30b4-48e1-9807-33e2abac19bd service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:11.147056 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1273/2541] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:46:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:46:12.502658 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f4564-cf36-417c-ad53-2f8465b351e7 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:12.503821 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f4564-cf36-417c-ad53-2f8465b351e7 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:12.504062 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f4564-cf36-417c-ad53-2f8465b351e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:12.522826 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-764f4564-cf36-417c-ad53-2f8465b351e7 None None] MFA Rules not processed for user `8427a2000ab943f6a6fa72d068efe2ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:46:12.524022 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-764f4564-cf36-417c-ad53-2f8465b351e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:12.531255 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1269/2542] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:46:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:46:12.829513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953281a-30b4-48e1-9807-33e2abac19bd service cinder] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:12.830953 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-e953281a-30b4-48e1-9807-33e2abac19bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:12.844455 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953281a-30b4-48e1-9807-33e2abac19bd service cinder] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:12.849776 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f3fe8-c57f-4718-8250-4e9ebe938267 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:12.850468 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f3fe8-c57f-4718-8250-4e9ebe938267 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:12.850749 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f3fe8-c57f-4718-8250-4e9ebe938267 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:12.851147 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f3fe8-c57f-4718-8250-4e9ebe938267 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:12.859710 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-df1f3fe8-c57f-4718-8250-4e9ebe938267 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:12.870851 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f3fe8-c57f-4718-8250-4e9ebe938267 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:12.872361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f3fe8-c57f-4718-8250-4e9ebe938267 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:12.885050 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1274/2543] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:46:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:46:21.194102 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f4564-cf36-417c-ad53-2f8465b351e7 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:21.195407 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-764f4564-cf36-417c-ad53-2f8465b351e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:21.266100 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f4564-cf36-417c-ad53-2f8465b351e7 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:21.272225 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97c778-3bea-4a1b-8090-071395b6a86f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:21.272870 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97c778-3bea-4a1b-8090-071395b6a86f service nova] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:21.273150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97c778-3bea-4a1b-8090-071395b6a86f service nova] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:21.273421 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97c778-3bea-4a1b-8090-071395b6a86f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:21.275233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-ed97c778-3bea-4a1b-8090-071395b6a86f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:21.330286 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97c778-3bea-4a1b-8090-071395b6a86f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:21.332430 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97c778-3bea-4a1b-8090-071395b6a86f service nova] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:21.341246 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1270/2544] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:46:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:46:39.746072 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f56dc-9023-427a-895f-3882fe0baf51 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:39.746614 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f56dc-9023-427a-895f-3882fe0baf51 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:39.746713 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f56dc-9023-427a-895f-3882fe0baf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:39.765566 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-d25f56dc-9023-427a-895f-3882fe0baf51 None None] MFA Rules not processed for user `bd41f419750140268f4d4b77456065c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:46:39.766777 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-d25f56dc-9023-427a-895f-3882fe0baf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:39.820503 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1275/2545] 10.222.0.60 () {58 vars in 967 bytes} [Thu May 12 09:46:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:46:39.833186 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97c778-3bea-4a1b-8090-071395b6a86f service nova] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:39.897797 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97c778-3bea-4a1b-8090-071395b6a86f service nova] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:39.902810 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f5275-d891-462f-aadc-afd76a774d64 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7693a31911346f9bb2c01efcd8e16e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:39.903492 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f5275-d891-462f-aadc-afd76a774d64 service swift] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:39.903775 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f5275-d891-462f-aadc-afd76a774d64 service swift] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:39.904048 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f5275-d891-462f-aadc-afd76a774d64 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:39.912204 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f5275-d891-462f-aadc-afd76a774d64 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:39.913770 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f5275-d891-462f-aadc-afd76a774d64 service swift] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:39.921525 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1271/2546] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 12 09:46:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 09:46:42.290353 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd23119-a861-4b53-839f-7b7fb5d768b5 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:42.290917 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd23119-a861-4b53-839f-7b7fb5d768b5 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:42.290917 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd23119-a861-4b53-839f-7b7fb5d768b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:42.312461 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-8cd23119-a861-4b53-839f-7b7fb5d768b5 None None] MFA Rules not processed for user `8427a2000ab943f6a6fa72d068efe2ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:46:42.313819 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-8cd23119-a861-4b53-839f-7b7fb5d768b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:42.322919 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1276/2547] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:46:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:46:47.372589 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f5275-d891-462f-aadc-afd76a774d64 service swift] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:47.382414 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f5275-d891-462f-aadc-afd76a774d64 service swift] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:47.386003 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea278d-5b3d-42a6-aa33-28d0d46600b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:47.386691 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea278d-5b3d-42a6-aa33-28d0d46600b8 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:47.386972 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea278d-5b3d-42a6-aa33-28d0d46600b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:47.387588 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea278d-5b3d-42a6-aa33-28d0d46600b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:47.389344 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-8dea278d-5b3d-42a6-aa33-28d0d46600b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:47.401422 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea278d-5b3d-42a6-aa33-28d0d46600b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:47.402848 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea278d-5b3d-42a6-aa33-28d0d46600b8 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:47.412709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1272/2548] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:46:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 09:46:51.260501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd23119-a861-4b53-839f-7b7fb5d768b5 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:51.262799 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-8cd23119-a861-4b53-839f-7b7fb5d768b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:51.284187 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd23119-a861-4b53-839f-7b7fb5d768b5 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:51.291879 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12231704-eaed-4fb1-b3fa-a48a8a3129f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:51.292870 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12231704-eaed-4fb1-b3fa-a48a8a3129f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:51.293264 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12231704-eaed-4fb1-b3fa-a48a8a3129f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:51.293609 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12231704-eaed-4fb1-b3fa-a48a8a3129f1 admin admin] PATH_INFO: `/v3/users/6c8297034cfa40438000e7d94419a429` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:51.294932 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12231704-eaed-4fb1-b3fa-a48a8a3129f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c8297034cfa40438000e7d94419a429)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:51.297144 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12231704-eaed-4fb1-b3fa-a48a8a3129f1 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:51.363496 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-12231704-eaed-4fb1-b3fa-a48a8a3129f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c8297034cfa40438000e7d94419a429'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:51.384811 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-12231704-eaed-4fb1-b3fa-a48a8a3129f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c8297034cfa40438000e7d94419a429'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:51.385580 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-12231704-eaed-4fb1-b3fa-a48a8a3129f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c8297034cfa40438000e7d94419a429'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:51.398663 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-12231704-eaed-4fb1-b3fa-a48a8a3129f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c8297034cfa40438000e7d94419a429'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:51.410576 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-12231704-eaed-4fb1-b3fa-a48a8a3129f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c8297034cfa40438000e7d94419a429'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:51.422331 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1277/2549] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:46:51 2022] DELETE /identity/v3/users/6c8297034cfa40438000e7d94419a429 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:46:51.598582 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea278d-5b3d-42a6-aa33-28d0d46600b8 service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:51.608763 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea278d-5b3d-42a6-aa33-28d0d46600b8 service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:51.666515 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c19c2-0c36-4f51-822a-cd32a201e3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:51.667294 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c19c2-0c36-4f51-822a-cd32a201e3f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:51.667572 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c19c2-0c36-4f51-822a-cd32a201e3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:51.667847 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c19c2-0c36-4f51-822a-cd32a201e3f1 admin admin] PATH_INFO: `/v3/projects/b079fd0b329c4f1a856f71e0c8f98dde` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:51.669021 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c19c2-0c36-4f51-822a-cd32a201e3f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b079fd0b329c4f1a856f71e0c8f98dde)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:51.670965 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c19c2-0c36-4f51-822a-cd32a201e3f1 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:51.716244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-261c19c2-0c36-4f51-822a-cd32a201e3f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b079fd0b329c4f1a856f71e0c8f98dde', 'request_id': 'req-261c19c2-0c36-4f51-822a-cd32a201e3f1'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:51.721959 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-261c19c2-0c36-4f51-822a-cd32a201e3f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b079fd0b329c4f1a856f71e0c8f98dde', 'request_id': 'req-261c19c2-0c36-4f51-822a-cd32a201e3f1'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:51.729018 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-261c19c2-0c36-4f51-822a-cd32a201e3f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b079fd0b329c4f1a856f71e0c8f98dde', 'request_id': 'req-261c19c2-0c36-4f51-822a-cd32a201e3f1'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:51.740631 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-261c19c2-0c36-4f51-822a-cd32a201e3f1 admin admin] The token cache is being invalidate because project b079fd0b329c4f1a856f71e0c8f98dde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:46:51.740916 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-261c19c2-0c36-4f51-822a-cd32a201e3f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:51.741535 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-261c19c2-0c36-4f51-822a-cd32a201e3f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:46:51.743129 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1273/2550] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:46:51 2022] DELETE /identity/v3/projects/b079fd0b329c4f1a856f71e0c8f98dde => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:46:51.748397 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756cb6a-970f-4544-bd02-e98a5a8a197c None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:51.748706 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756cb6a-970f-4544-bd02-e98a5a8a197c None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:51.749007 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756cb6a-970f-4544-bd02-e98a5a8a197c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:51.778548 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-e756cb6a-970f-4544-bd02-e98a5a8a197c None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:46:51.779727 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-e756cb6a-970f-4544-bd02-e98a5a8a197c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:51.835846 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1278/2551] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:46:51.843515 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb464e-2b79-4e13-bf75-00dd8b4bc1f7 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:51.843799 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb464e-2b79-4e13-bf75-00dd8b4bc1f7 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:51.844072 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb464e-2b79-4e13-bf75-00dd8b4bc1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:51.864069 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-aebb464e-2b79-4e13-bf75-00dd8b4bc1f7 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:46:51.865269 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-aebb464e-2b79-4e13-bf75-00dd8b4bc1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:51.874383 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1274/2552] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:46:51.879098 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756cb6a-970f-4544-bd02-e98a5a8a197c None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:51.889301 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756cb6a-970f-4544-bd02-e98a5a8a197c None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:51.893921 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d6357-0b9f-4111-9130-f0bd078cc5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:51.894565 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d6357-0b9f-4111-9130-f0bd078cc5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:51.894845 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d6357-0b9f-4111-9130-f0bd078cc5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:51.895120 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d6357-0b9f-4111-9130-f0bd078cc5c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:51.895838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d6357-0b9f-4111-9130-f0bd078cc5c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:46:51.896146 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d6357-0b9f-4111-9130-f0bd078cc5c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:51.897733 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d6357-0b9f-4111-9130-f0bd078cc5c6 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:51.909848 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1279/2553] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:46:51.914229 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb464e-2b79-4e13-bf75-00dd8b4bc1f7 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:51.923689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb464e-2b79-4e13-bf75-00dd8b4bc1f7 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:51.928836 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b5ef0-66b3-4724-8fb0-da041d769713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:51.929466 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b5ef0-66b3-4724-8fb0-da041d769713 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:51.929743 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b5ef0-66b3-4724-8fb0-da041d769713 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:51.930053 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b5ef0-66b3-4724-8fb0-da041d769713 admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:51.930748 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b5ef0-66b3-4724-8fb0-da041d769713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:51.932635 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b5ef0-66b3-4724-8fb0-da041d769713 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:51.956913 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1275/2554] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:46:51 2022] POST /identity/v3/projects => generated 367 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:46:51.960916 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d6357-0b9f-4111-9130-f0bd078cc5c6 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:51.970746 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d6357-0b9f-4111-9130-f0bd078cc5c6 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:52.025114 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefc589-d681-4dee-91be-95e9c015b93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:52.025776 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefc589-d681-4dee-91be-95e9c015b93f admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:52.026088 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefc589-d681-4dee-91be-95e9c015b93f admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:52.026367 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefc589-d681-4dee-91be-95e9c015b93f admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:52.027045 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cefc589-d681-4dee-91be-95e9c015b93f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:52.028948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cefc589-d681-4dee-91be-95e9c015b93f admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:52.048506 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1280/2555] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:46:51 2022] POST /identity/v3/users => generated 284 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:46:52.052829 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b5ef0-66b3-4724-8fb0-da041d769713 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:52.063016 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b5ef0-66b3-4724-8fb0-da041d769713 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:52.067712 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095eaf6b-3eaa-42bd-9398-64f48de326a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:52.068368 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095eaf6b-3eaa-42bd-9398-64f48de326a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:52.068653 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095eaf6b-3eaa-42bd-9398-64f48de326a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:52.068927 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095eaf6b-3eaa-42bd-9398-64f48de326a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:52.069645 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095eaf6b-3eaa-42bd-9398-64f48de326a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:52.071279 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095eaf6b-3eaa-42bd-9398-64f48de326a1 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:52.083028 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1276/2556] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:46:52.086842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefc589-d681-4dee-91be-95e9c015b93f admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:52.097397 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefc589-d681-4dee-91be-95e9c015b93f admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:52.104217 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c79af-fbaa-449e-85eb-309dd02cb648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:52.104886 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c79af-fbaa-449e-85eb-309dd02cb648 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:52.105170 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c79af-fbaa-449e-85eb-309dd02cb648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:52.105451 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c79af-fbaa-449e-85eb-309dd02cb648 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:52.106209 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c79af-fbaa-449e-85eb-309dd02cb648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:52.107846 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c79af-fbaa-449e-85eb-309dd02cb648 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:52.117870 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1281/2557] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:46:52.122415 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095eaf6b-3eaa-42bd-9398-64f48de326a1 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:52.132422 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095eaf6b-3eaa-42bd-9398-64f48de326a1 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:52.137496 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de293f9c-fa7c-4455-8252-bbd93faba93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:52.138415 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de293f9c-fa7c-4455-8252-bbd93faba93f admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:52.138702 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de293f9c-fa7c-4455-8252-bbd93faba93f admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:52.138980 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de293f9c-fa7c-4455-8252-bbd93faba93f admin admin] PATH_INFO: `/v3/projects/cd9be6b713584bf8987d9c2eef1028c5/users/d80fba152144487991e29036ff126726/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:52.153583 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de293f9c-fa7c-4455-8252-bbd93faba93f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd9be6b713584bf8987d9c2eef1028c5, user_id=d80fba152144487991e29036ff126726, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:52.156249 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de293f9c-fa7c-4455-8252-bbd93faba93f admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:52.169877 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1277/2558] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:46:52 2022] PUT /identity/v3/projects/cd9be6b713584bf8987d9c2eef1028c5/users/d80fba152144487991e29036ff126726/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:46:52.179999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d7fd4-45a8-4d21-87f7-401b0df7e7b5 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:52.180222 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d7fd4-45a8-4d21-87f7-401b0df7e7b5 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:52.180495 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d7fd4-45a8-4d21-87f7-401b0df7e7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:52.207002 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-022d7fd4-45a8-4d21-87f7-401b0df7e7b5 None None] MFA Rules not processed for user `d80fba152144487991e29036ff126726`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:46:52.208230 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-022d7fd4-45a8-4d21-87f7-401b0df7e7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:52.270351 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1282/2559] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:46:52 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:46:52.280953 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de293f9c-fa7c-4455-8252-bbd93faba93f admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:46:52.282659 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-de293f9c-fa7c-4455-8252-bbd93faba93f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:46:52.338695 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de293f9c-fa7c-4455-8252-bbd93faba93f admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:46:52.342356 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbc71b-70e6-42a6-8359-bbb893af6e90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:46:52.343010 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbc71b-70e6-42a6-8359-bbb893af6e90 service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:46:52.343289 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbc71b-70e6-42a6-8359-bbb893af6e90 service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:46:52.343563 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbc71b-70e6-42a6-8359-bbb893af6e90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:46:52.352243 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cbc71b-70e6-42a6-8359-bbb893af6e90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:46:52.353666 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cbc71b-70e6-42a6-8359-bbb893af6e90 service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:46:52.362843 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1278/2560] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:46:52 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:47:04.825046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d7fd4-45a8-4d21-87f7-401b0df7e7b5 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:04.884798 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d7fd4-45a8-4d21-87f7-401b0df7e7b5 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:04.889528 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be70947-0cc7-4b67-9f96-719c67e8e2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:04.890429 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be70947-0cc7-4b67-9f96-719c67e8e2f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:04.890718 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be70947-0cc7-4b67-9f96-719c67e8e2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:04.891021 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be70947-0cc7-4b67-9f96-719c67e8e2f9 admin admin] PATH_INFO: `/v3/users/d80fba152144487991e29036ff126726` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:04.892225 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be70947-0cc7-4b67-9f96-719c67e8e2f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d80fba152144487991e29036ff126726)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:04.894171 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be70947-0cc7-4b67-9f96-719c67e8e2f9 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:04.938928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-0be70947-0cc7-4b67-9f96-719c67e8e2f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd80fba152144487991e29036ff126726'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:04.950662 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-0be70947-0cc7-4b67-9f96-719c67e8e2f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd80fba152144487991e29036ff126726'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:04.951314 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-0be70947-0cc7-4b67-9f96-719c67e8e2f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd80fba152144487991e29036ff126726'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:04.958283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-0be70947-0cc7-4b67-9f96-719c67e8e2f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd80fba152144487991e29036ff126726'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:04.965211 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-0be70947-0cc7-4b67-9f96-719c67e8e2f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd80fba152144487991e29036ff126726'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:04.970976 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1283/2561] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:47:04 2022] DELETE /identity/v3/users/d80fba152144487991e29036ff126726 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:47:04.975523 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a143789-6e60-437c-ba2c-1a096384c309 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:04.976022 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a143789-6e60-437c-ba2c-1a096384c309 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:04.976138 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a143789-6e60-437c-ba2c-1a096384c309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:04.993268 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-2a143789-6e60-437c-ba2c-1a096384c309 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:47:04.994504 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-2a143789-6e60-437c-ba2c-1a096384c309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:05.057269 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1279/2562] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:47:05.068465 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be70947-0cc7-4b67-9f96-719c67e8e2f9 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:05.069920 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-0be70947-0cc7-4b67-9f96-719c67e8e2f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:05.073323 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab261a-5750-47c1-b173-f5d8ed160e94 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:05.073615 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab261a-5750-47c1-b173-f5d8ed160e94 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:05.073917 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab261a-5750-47c1-b173-f5d8ed160e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:05.091387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-0dab261a-5750-47c1-b173-f5d8ed160e94 None None] MFA Rules not processed for user `bd41f419750140268f4d4b77456065c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:47:05.092591 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-0dab261a-5750-47c1-b173-f5d8ed160e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:05.126695 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be70947-0cc7-4b67-9f96-719c67e8e2f9 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:05.131314 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f068824-a149-43b5-821d-31c6cf5de617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:05.131865 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f068824-a149-43b5-821d-31c6cf5de617 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:05.132157 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f068824-a149-43b5-821d-31c6cf5de617 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:05.132429 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f068824-a149-43b5-821d-31c6cf5de617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:05.142106 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f068824-a149-43b5-821d-31c6cf5de617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:05.143534 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f068824-a149-43b5-821d-31c6cf5de617 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:05.153073 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1280/2563] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 12 09:47:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:47:05.153595 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1284/2564] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:47:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:47:05.176527 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab261a-5750-47c1-b173-f5d8ed160e94 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:05.177954 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-0dab261a-5750-47c1-b173-f5d8ed160e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:05.250413 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab261a-5750-47c1-b173-f5d8ed160e94 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:05.256006 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db00f7-079b-4075-a7ab-0d1af4c2c479 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7693a31911346f9bb2c01efcd8e16e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:05.256672 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db00f7-079b-4075-a7ab-0d1af4c2c479 service swift] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:05.256960 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db00f7-079b-4075-a7ab-0d1af4c2c479 service swift] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:05.257229 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db00f7-079b-4075-a7ab-0d1af4c2c479 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:05.265873 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db00f7-079b-4075-a7ab-0d1af4c2c479 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:05.267482 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db00f7-079b-4075-a7ab-0d1af4c2c479 service swift] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:05.275895 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1281/2565] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 12 09:47:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 09:47:05.462929 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f068824-a149-43b5-821d-31c6cf5de617 service neutron] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:05.466074 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-5f068824-a149-43b5-821d-31c6cf5de617 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:05.483977 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f068824-a149-43b5-821d-31c6cf5de617 service neutron] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:05.498977 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abab9c-f9f8-4e9b-ab5e-1384863009e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:05.500015 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abab9c-f9f8-4e9b-ab5e-1384863009e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:05.500485 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abab9c-f9f8-4e9b-ab5e-1384863009e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:05.500980 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abab9c-f9f8-4e9b-ab5e-1384863009e8 admin admin] PATH_INFO: `/v3/projects/cd9be6b713584bf8987d9c2eef1028c5` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:05.502308 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abab9c-f9f8-4e9b-ab5e-1384863009e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd9be6b713584bf8987d9c2eef1028c5)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:05.504446 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abab9c-f9f8-4e9b-ab5e-1384863009e8 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:05.561067 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-77abab9c-f9f8-4e9b-ab5e-1384863009e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd9be6b713584bf8987d9c2eef1028c5', 'request_id': 'req-77abab9c-f9f8-4e9b-ab5e-1384863009e8'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:05.567363 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-77abab9c-f9f8-4e9b-ab5e-1384863009e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd9be6b713584bf8987d9c2eef1028c5', 'request_id': 'req-77abab9c-f9f8-4e9b-ab5e-1384863009e8'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:05.578645 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-77abab9c-f9f8-4e9b-ab5e-1384863009e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd9be6b713584bf8987d9c2eef1028c5', 'request_id': 'req-77abab9c-f9f8-4e9b-ab5e-1384863009e8'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:05.593129 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-77abab9c-f9f8-4e9b-ab5e-1384863009e8 admin admin] The token cache is being invalidate because project cd9be6b713584bf8987d9c2eef1028c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:47:05.593983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-77abab9c-f9f8-4e9b-ab5e-1384863009e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:05.594994 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-77abab9c-f9f8-4e9b-ab5e-1384863009e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:05.598314 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1285/2566] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:47:05 2022] DELETE /identity/v3/projects/cd9be6b713584bf8987d9c2eef1028c5 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:47:05.603809 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17186f-7e65-4c33-af84-a44b950ea889 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:05.604384 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17186f-7e65-4c33-af84-a44b950ea889 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:05.604867 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17186f-7e65-4c33-af84-a44b950ea889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:05.627179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-9f17186f-7e65-4c33-af84-a44b950ea889 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:47:05.628693 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-9f17186f-7e65-4c33-af84-a44b950ea889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:05.706577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1282/2567] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:47:05.710678 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6ce28-423b-47be-bee2-4f169b290c73 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:05.710973 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6ce28-423b-47be-bee2-4f169b290c73 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:05.711436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6ce28-423b-47be-bee2-4f169b290c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:05.745882 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-03a6ce28-423b-47be-bee2-4f169b290c73 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:47:05.747451 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-03a6ce28-423b-47be-bee2-4f169b290c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:05.757792 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1286/2568] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:47:05.762020 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17186f-7e65-4c33-af84-a44b950ea889 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:05.773532 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17186f-7e65-4c33-af84-a44b950ea889 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:05.781575 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595bb8d-62c7-4b9a-86e3-6650034fcdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:05.782323 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595bb8d-62c7-4b9a-86e3-6650034fcdba admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:05.782587 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595bb8d-62c7-4b9a-86e3-6650034fcdba admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:05.782872 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595bb8d-62c7-4b9a-86e3-6650034fcdba admin admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:05.783668 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595bb8d-62c7-4b9a-86e3-6650034fcdba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:47:05.784576 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595bb8d-62c7-4b9a-86e3-6650034fcdba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:05.786170 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595bb8d-62c7-4b9a-86e3-6650034fcdba admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:05.798575 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1283/2569] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:47:05.802948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6ce28-423b-47be-bee2-4f169b290c73 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:05.813937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6ce28-423b-47be-bee2-4f169b290c73 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:05.819144 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34289f9-8931-4857-a8f2-cad4c237ef13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:05.819915 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34289f9-8931-4857-a8f2-cad4c237ef13 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:05.820290 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34289f9-8931-4857-a8f2-cad4c237ef13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:05.820686 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34289f9-8931-4857-a8f2-cad4c237ef13 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:05.821408 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34289f9-8931-4857-a8f2-cad4c237ef13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:05.823384 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34289f9-8931-4857-a8f2-cad4c237ef13 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:05.854130 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1287/2570] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:47:05 2022] POST /identity/v3/projects => generated 403 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:47:05.858639 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595bb8d-62c7-4b9a-86e3-6650034fcdba admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:05.871382 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595bb8d-62c7-4b9a-86e3-6650034fcdba admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:05.935203 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc3c6e-fe1b-4fc5-adef-76269f2cf3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:05.936005 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc3c6e-fe1b-4fc5-adef-76269f2cf3c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:05.936356 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc3c6e-fe1b-4fc5-adef-76269f2cf3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:05.936705 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc3c6e-fe1b-4fc5-adef-76269f2cf3c7 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:05.937513 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc3c6e-fe1b-4fc5-adef-76269f2cf3c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:05.940807 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc3c6e-fe1b-4fc5-adef-76269f2cf3c7 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:05.967911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1284/2571] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:47:05 2022] POST /identity/v3/users => generated 302 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:47:05.969360 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34289f9-8931-4857-a8f2-cad4c237ef13 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:05.979969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34289f9-8931-4857-a8f2-cad4c237ef13 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:05.986499 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d140b66-1f21-4ed7-8ebe-13d66c4b7e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:05.987567 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d140b66-1f21-4ed7-8ebe-13d66c4b7e87 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:05.988047 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d140b66-1f21-4ed7-8ebe-13d66c4b7e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:05.988541 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d140b66-1f21-4ed7-8ebe-13d66c4b7e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:05.989281 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d140b66-1f21-4ed7-8ebe-13d66c4b7e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:05.990909 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d140b66-1f21-4ed7-8ebe-13d66c4b7e87 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:06.004366 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1288/2572] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:47:06.006705 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc3c6e-fe1b-4fc5-adef-76269f2cf3c7 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:06.017347 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc3c6e-fe1b-4fc5-adef-76269f2cf3c7 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:06.022341 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae87d4-6f03-4105-b2dc-79604a38f278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:06.023136 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae87d4-6f03-4105-b2dc-79604a38f278 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:06.023516 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae87d4-6f03-4105-b2dc-79604a38f278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:06.023895 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae87d4-6f03-4105-b2dc-79604a38f278 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:06.024737 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae87d4-6f03-4105-b2dc-79604a38f278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:06.026665 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae87d4-6f03-4105-b2dc-79604a38f278 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:06.040418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1285/2573] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 09:47:06.044625 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d140b66-1f21-4ed7-8ebe-13d66c4b7e87 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:06.057001 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d140b66-1f21-4ed7-8ebe-13d66c4b7e87 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:06.062134 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfa467-9694-447f-9b22-8fe06c256445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:06.063095 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfa467-9694-447f-9b22-8fe06c256445 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:06.063475 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfa467-9694-447f-9b22-8fe06c256445 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:06.063815 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfa467-9694-447f-9b22-8fe06c256445 admin admin] PATH_INFO: `/v3/projects/244d04aa701148b6a61bdece8b412b52/users/ec8bbf44d0d342c8bf20ef5d3e99a067/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:06.080192 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bfa467-9694-447f-9b22-8fe06c256445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=244d04aa701148b6a61bdece8b412b52, user_id=ec8bbf44d0d342c8bf20ef5d3e99a067, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:06.083726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bfa467-9694-447f-9b22-8fe06c256445 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:06.105642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1289/2574] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:47:06 2022] PUT /identity/v3/projects/244d04aa701148b6a61bdece8b412b52/users/ec8bbf44d0d342c8bf20ef5d3e99a067/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:47:06.110657 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08534d-a064-4bdb-8d9c-ce59392b6a28 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:06.110954 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08534d-a064-4bdb-8d9c-ce59392b6a28 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:06.111236 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08534d-a064-4bdb-8d9c-ce59392b6a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:06.131989 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-dc08534d-a064-4bdb-8d9c-ce59392b6a28 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:47:06.133242 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-dc08534d-a064-4bdb-8d9c-ce59392b6a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:06.196324 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1286/2575] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:47:06.206232 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfa467-9694-447f-9b22-8fe06c256445 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:06.208026 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-51bfa467-9694-447f-9b22-8fe06c256445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:06.271531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfa467-9694-447f-9b22-8fe06c256445 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:06.275585 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99828d-8ec4-4390-b0f8-af59a780b46a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:06.276362 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99828d-8ec4-4390-b0f8-af59a780b46a service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:06.276748 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99828d-8ec4-4390-b0f8-af59a780b46a service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:06.277096 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99828d-8ec4-4390-b0f8-af59a780b46a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:06.287784 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99828d-8ec4-4390-b0f8-af59a780b46a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:06.289245 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99828d-8ec4-4390-b0f8-af59a780b46a service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:06.300718 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1290/2576] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:47:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 09:47:07.009448 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedbf59-8606-43ad-9469-1b5c8698b13f None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:07.010479 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedbf59-8606-43ad-9469-1b5c8698b13f None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:07.010937 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedbf59-8606-43ad-9469-1b5c8698b13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:07.057271 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-beedbf59-8606-43ad-9469-1b5c8698b13f None None] MFA Rules not processed for user `ec8bbf44d0d342c8bf20ef5d3e99a067`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:47:07.064780 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-beedbf59-8606-43ad-9469-1b5c8698b13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:07.168449 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1287/2577] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:47:07 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:47:07.172875 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99828d-8ec4-4390-b0f8-af59a780b46a service neutron] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:07.184938 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99828d-8ec4-4390-b0f8-af59a780b46a service neutron] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:07.190121 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19680d1e-0d49-4082-a689-955846186392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:07.190783 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19680d1e-0d49-4082-a689-955846186392 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:07.191063 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19680d1e-0d49-4082-a689-955846186392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:07.191339 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19680d1e-0d49-4082-a689-955846186392 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:07.192041 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19680d1e-0d49-4082-a689-955846186392 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:07.193970 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19680d1e-0d49-4082-a689-955846186392 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:07.250968 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1291/2578] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:47:07 2022] POST /identity/v3/projects => generated 403 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:47:07.251477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedbf59-8606-43ad-9469-1b5c8698b13f None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:07.266922 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedbf59-8606-43ad-9469-1b5c8698b13f None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:07.335809 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7eaee1-5074-42f1-ada4-e28eff2f58fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:07.336532 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7eaee1-5074-42f1-ada4-e28eff2f58fa admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:07.338168 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7eaee1-5074-42f1-ada4-e28eff2f58fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:07.338528 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7eaee1-5074-42f1-ada4-e28eff2f58fa admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:07.339367 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7eaee1-5074-42f1-ada4-e28eff2f58fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:07.341428 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7eaee1-5074-42f1-ada4-e28eff2f58fa admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:07.369577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1288/2579] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:47:07 2022] POST /identity/v3/users => generated 308 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:47:07.374752 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19680d1e-0d49-4082-a689-955846186392 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:07.386843 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19680d1e-0d49-4082-a689-955846186392 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:07.393159 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136969e-37a4-421c-8ddd-ebd603654145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:07.394090 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136969e-37a4-421c-8ddd-ebd603654145 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:07.394542 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136969e-37a4-421c-8ddd-ebd603654145 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:07.394923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136969e-37a4-421c-8ddd-ebd603654145 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:07.395780 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136969e-37a4-421c-8ddd-ebd603654145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:07.397385 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136969e-37a4-421c-8ddd-ebd603654145 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:07.416985 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1292/2580] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:47:07.417840 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7eaee1-5074-42f1-ada4-e28eff2f58fa admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:07.430201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7eaee1-5074-42f1-ada4-e28eff2f58fa admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:07.435729 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9decf717-0999-45c3-bb68-2ca04ef26965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:07.436625 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decf717-0999-45c3-bb68-2ca04ef26965 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:07.436917 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decf717-0999-45c3-bb68-2ca04ef26965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:07.437189 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decf717-0999-45c3-bb68-2ca04ef26965 admin admin] PATH_INFO: `/v3/projects/1ae37d3ecc354242ac362e343503bd24/users/e2b9cc9ede034a7696590581771513a7/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:07.453413 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9decf717-0999-45c3-bb68-2ca04ef26965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ae37d3ecc354242ac362e343503bd24, user_id=e2b9cc9ede034a7696590581771513a7, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:07.456166 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9decf717-0999-45c3-bb68-2ca04ef26965 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:07.473111 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1289/2581] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:47:07 2022] PUT /identity/v3/projects/1ae37d3ecc354242ac362e343503bd24/users/e2b9cc9ede034a7696590581771513a7/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:47:07.478448 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136969e-37a4-421c-8ddd-ebd603654145 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:07.492490 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136969e-37a4-421c-8ddd-ebd603654145 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:07.563473 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115032fe-97ed-43a0-9926-1220c39ce2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:07.564144 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115032fe-97ed-43a0-9926-1220c39ce2de admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:07.564438 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115032fe-97ed-43a0-9926-1220c39ce2de admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:07.564703 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115032fe-97ed-43a0-9926-1220c39ce2de admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:07.565492 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115032fe-97ed-43a0-9926-1220c39ce2de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:07.567127 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115032fe-97ed-43a0-9926-1220c39ce2de admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:07.577948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1293/2582] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:47:07.582533 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9decf717-0999-45c3-bb68-2ca04ef26965 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:07.593307 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9decf717-0999-45c3-bb68-2ca04ef26965 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:07.599166 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c329e25-dac3-4cce-9e27-1ca82d2c52a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:07.600222 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c329e25-dac3-4cce-9e27-1ca82d2c52a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:07.600523 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c329e25-dac3-4cce-9e27-1ca82d2c52a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:07.601498 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c329e25-dac3-4cce-9e27-1ca82d2c52a7 admin admin] PATH_INFO: `/v3/projects/1ae37d3ecc354242ac362e343503bd24/users/e2b9cc9ede034a7696590581771513a7/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:07.603550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c329e25-dac3-4cce-9e27-1ca82d2c52a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ae37d3ecc354242ac362e343503bd24, user_id=e2b9cc9ede034a7696590581771513a7, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:07.606294 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c329e25-dac3-4cce-9e27-1ca82d2c52a7 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:07.618789 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1290/2583] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:47:07 2022] PUT /identity/v3/projects/1ae37d3ecc354242ac362e343503bd24/users/e2b9cc9ede034a7696590581771513a7/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:47:08.382335 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dea04d-c63a-482a-890c-139bb753912f None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:08.383313 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dea04d-c63a-482a-890c-139bb753912f None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:08.383806 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dea04d-c63a-482a-890c-139bb753912f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:08.417656 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-64dea04d-c63a-482a-890c-139bb753912f None None] MFA Rules not processed for user `e2b9cc9ede034a7696590581771513a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:47:08.419338 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-64dea04d-c63a-482a-890c-139bb753912f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:08.520253 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1294/2584] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:47:08 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:47:09.765300 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c329e25-dac3-4cce-9e27-1ca82d2c52a7 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:09.844402 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c329e25-dac3-4cce-9e27-1ca82d2c52a7 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:09.851865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64652a7f-3fa2-4820-9b1c-df029790c733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:09.853351 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64652a7f-3fa2-4820-9b1c-df029790c733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:09.854567 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64652a7f-3fa2-4820-9b1c-df029790c733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:09.855000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64652a7f-3fa2-4820-9b1c-df029790c733 admin admin] PATH_INFO: `/v3/users/ec8bbf44d0d342c8bf20ef5d3e99a067` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:09.856782 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64652a7f-3fa2-4820-9b1c-df029790c733 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec8bbf44d0d342c8bf20ef5d3e99a067)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:09.862488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64652a7f-3fa2-4820-9b1c-df029790c733 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:09.920627 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-64652a7f-3fa2-4820-9b1c-df029790c733 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec8bbf44d0d342c8bf20ef5d3e99a067'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:09.935288 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-64652a7f-3fa2-4820-9b1c-df029790c733 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec8bbf44d0d342c8bf20ef5d3e99a067'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:09.936136 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-64652a7f-3fa2-4820-9b1c-df029790c733 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec8bbf44d0d342c8bf20ef5d3e99a067'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:09.947523 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-64652a7f-3fa2-4820-9b1c-df029790c733 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec8bbf44d0d342c8bf20ef5d3e99a067'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:09.956517 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-64652a7f-3fa2-4820-9b1c-df029790c733 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec8bbf44d0d342c8bf20ef5d3e99a067'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:09.968370 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1291/2585] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:47:09 2022] DELETE /identity/v3/users/ec8bbf44d0d342c8bf20ef5d3e99a067 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:47:10.178251 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dea04d-c63a-482a-890c-139bb753912f None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:10.227423 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dea04d-c63a-482a-890c-139bb753912f None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:10.298557 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a82272-da39-40f5-929f-eab04fc25af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:10.299894 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a82272-da39-40f5-929f-eab04fc25af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:10.300178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a82272-da39-40f5-929f-eab04fc25af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:10.300455 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a82272-da39-40f5-929f-eab04fc25af1 admin admin] PATH_INFO: `/v3/projects/244d04aa701148b6a61bdece8b412b52` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:10.301727 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a82272-da39-40f5-929f-eab04fc25af1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=244d04aa701148b6a61bdece8b412b52)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:10.303676 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a82272-da39-40f5-929f-eab04fc25af1 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:10.358351 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-96a82272-da39-40f5-929f-eab04fc25af1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '244d04aa701148b6a61bdece8b412b52', 'request_id': 'req-96a82272-da39-40f5-929f-eab04fc25af1'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:10.367988 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-96a82272-da39-40f5-929f-eab04fc25af1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '244d04aa701148b6a61bdece8b412b52', 'request_id': 'req-96a82272-da39-40f5-929f-eab04fc25af1'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:10.380181 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-96a82272-da39-40f5-929f-eab04fc25af1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '244d04aa701148b6a61bdece8b412b52', 'request_id': 'req-96a82272-da39-40f5-929f-eab04fc25af1'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:10.391981 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-96a82272-da39-40f5-929f-eab04fc25af1 admin admin] The token cache is being invalidate because project 244d04aa701148b6a61bdece8b412b52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:47:10.392419 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-96a82272-da39-40f5-929f-eab04fc25af1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:10.393653 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-96a82272-da39-40f5-929f-eab04fc25af1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:10.398405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1295/2586] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:47:10 2022] DELETE /identity/v3/projects/244d04aa701148b6a61bdece8b412b52 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:47:10.399796 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64652a7f-3fa2-4820-9b1c-df029790c733 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:10.401836 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-64652a7f-3fa2-4820-9b1c-df029790c733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:10.419458 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64652a7f-3fa2-4820-9b1c-df029790c733 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:10.491856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12399d-424f-4e8a-9db4-8941aab61a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:10.492774 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12399d-424f-4e8a-9db4-8941aab61a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:10.493057 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12399d-424f-4e8a-9db4-8941aab61a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:10.493331 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12399d-424f-4e8a-9db4-8941aab61a7d admin admin] PATH_INFO: `/v3/users/e2b9cc9ede034a7696590581771513a7` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:10.497609 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12399d-424f-4e8a-9db4-8941aab61a7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2b9cc9ede034a7696590581771513a7)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:10.499616 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12399d-424f-4e8a-9db4-8941aab61a7d admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:10.552866 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-3d12399d-424f-4e8a-9db4-8941aab61a7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2b9cc9ede034a7696590581771513a7'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:10.571757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-3d12399d-424f-4e8a-9db4-8941aab61a7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2b9cc9ede034a7696590581771513a7'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:10.572517 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-3d12399d-424f-4e8a-9db4-8941aab61a7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2b9cc9ede034a7696590581771513a7'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:10.592792 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-3d12399d-424f-4e8a-9db4-8941aab61a7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2b9cc9ede034a7696590581771513a7'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:10.608757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-3d12399d-424f-4e8a-9db4-8941aab61a7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2b9cc9ede034a7696590581771513a7'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:10.615806 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1292/2587] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:47:10 2022] DELETE /identity/v3/users/e2b9cc9ede034a7696590581771513a7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:47:10.825387 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a82272-da39-40f5-929f-eab04fc25af1 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:10.826941 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-96a82272-da39-40f5-929f-eab04fc25af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:10.842864 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a82272-da39-40f5-929f-eab04fc25af1 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:10.922307 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a4917-320c-45ca-b156-88059846d556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:10.923308 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a4917-320c-45ca-b156-88059846d556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:10.923684 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a4917-320c-45ca-b156-88059846d556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:10.924035 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a4917-320c-45ca-b156-88059846d556 admin admin] PATH_INFO: `/v3/projects/1ae37d3ecc354242ac362e343503bd24` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:10.925975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a4917-320c-45ca-b156-88059846d556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ae37d3ecc354242ac362e343503bd24)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:10.927915 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a4917-320c-45ca-b156-88059846d556 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:10.977778 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f80a4917-320c-45ca-b156-88059846d556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ae37d3ecc354242ac362e343503bd24', 'request_id': 'req-f80a4917-320c-45ca-b156-88059846d556'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:10.984348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f80a4917-320c-45ca-b156-88059846d556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ae37d3ecc354242ac362e343503bd24', 'request_id': 'req-f80a4917-320c-45ca-b156-88059846d556'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:10.993353 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f80a4917-320c-45ca-b156-88059846d556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ae37d3ecc354242ac362e343503bd24', 'request_id': 'req-f80a4917-320c-45ca-b156-88059846d556'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:11.006450 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f80a4917-320c-45ca-b156-88059846d556 admin admin] The token cache is being invalidate because project 1ae37d3ecc354242ac362e343503bd24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:47:11.006770 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f80a4917-320c-45ca-b156-88059846d556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:11.007844 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f80a4917-320c-45ca-b156-88059846d556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:11.010337 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1296/2588] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:47:10 2022] DELETE /identity/v3/projects/1ae37d3ecc354242ac362e343503bd24 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:47:11.015751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72528004-acd9-4275-9fbf-7ddce7aee199 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:11.016286 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72528004-acd9-4275-9fbf-7ddce7aee199 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:11.016462 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72528004-acd9-4275-9fbf-7ddce7aee199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:11.037540 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-72528004-acd9-4275-9fbf-7ddce7aee199 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:47:11.039488 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-72528004-acd9-4275-9fbf-7ddce7aee199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:11.109274 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1293/2589] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:47:11.118773 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f573b-ef20-4436-aa32-94f28d27e2ab None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:11.119525 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f573b-ef20-4436-aa32-94f28d27e2ab None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:11.119820 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f573b-ef20-4436-aa32-94f28d27e2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:11.142140 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-177f573b-ef20-4436-aa32-94f28d27e2ab None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:47:11.143425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-177f573b-ef20-4436-aa32-94f28d27e2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:11.153955 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1297/2590] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:47:11.158078 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72528004-acd9-4275-9fbf-7ddce7aee199 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:11.169311 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72528004-acd9-4275-9fbf-7ddce7aee199 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:11.174505 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8bdc4-1067-46f8-84d6-e7ca3af7fe47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:11.175204 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8bdc4-1067-46f8-84d6-e7ca3af7fe47 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:11.176019 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8bdc4-1067-46f8-84d6-e7ca3af7fe47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:11.176296 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8bdc4-1067-46f8-84d6-e7ca3af7fe47 admin admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:11.177084 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8bdc4-1067-46f8-84d6-e7ca3af7fe47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:47:11.177390 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8bdc4-1067-46f8-84d6-e7ca3af7fe47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:11.179277 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8bdc4-1067-46f8-84d6-e7ca3af7fe47 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:11.193679 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1294/2591] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:47:11.198138 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f573b-ef20-4436-aa32-94f28d27e2ab None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:11.208642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f573b-ef20-4436-aa32-94f28d27e2ab None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:11.213681 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c3a2b-8d9c-4f34-a00e-5845eb1c4822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:11.214633 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c3a2b-8d9c-4f34-a00e-5845eb1c4822 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:11.215021 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c3a2b-8d9c-4f34-a00e-5845eb1c4822 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:11.215400 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c3a2b-8d9c-4f34-a00e-5845eb1c4822 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:11.216183 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c3a2b-8d9c-4f34-a00e-5845eb1c4822 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:11.218215 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c3a2b-8d9c-4f34-a00e-5845eb1c4822 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:11.250724 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1298/2592] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:47:11 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:47:11.255106 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8bdc4-1067-46f8-84d6-e7ca3af7fe47 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:11.265758 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8bdc4-1067-46f8-84d6-e7ca3af7fe47 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:11.325315 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eededb85-99e0-4070-83ed-c10d075c81a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:11.326196 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eededb85-99e0-4070-83ed-c10d075c81a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:11.326551 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eededb85-99e0-4070-83ed-c10d075c81a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:11.326900 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eededb85-99e0-4070-83ed-c10d075c81a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:11.327685 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eededb85-99e0-4070-83ed-c10d075c81a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:11.329655 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eededb85-99e0-4070-83ed-c10d075c81a4 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:11.352539 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1295/2593] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:47:11 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:47:11.356586 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c3a2b-8d9c-4f34-a00e-5845eb1c4822 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:11.370451 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c3a2b-8d9c-4f34-a00e-5845eb1c4822 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:11.375242 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359c0d8-f78f-44b8-ac25-32e31b1c327a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:11.376196 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359c0d8-f78f-44b8-ac25-32e31b1c327a admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:11.376483 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359c0d8-f78f-44b8-ac25-32e31b1c327a admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:11.376779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359c0d8-f78f-44b8-ac25-32e31b1c327a admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:11.377616 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359c0d8-f78f-44b8-ac25-32e31b1c327a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:11.379316 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359c0d8-f78f-44b8-ac25-32e31b1c327a admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:11.391076 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1299/2594] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:47:11.395101 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eededb85-99e0-4070-83ed-c10d075c81a4 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:11.405537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eededb85-99e0-4070-83ed-c10d075c81a4 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:11.411140 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2539298-a9e1-4d6d-a61c-f7877638c7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:11.411835 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2539298-a9e1-4d6d-a61c-f7877638c7a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:11.412110 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2539298-a9e1-4d6d-a61c-f7877638c7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:11.412383 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2539298-a9e1-4d6d-a61c-f7877638c7a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:11.413169 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2539298-a9e1-4d6d-a61c-f7877638c7a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:11.414868 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2539298-a9e1-4d6d-a61c-f7877638c7a2 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:11.427306 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1296/2595] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 09:47:11.431749 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359c0d8-f78f-44b8-ac25-32e31b1c327a admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:11.442923 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359c0d8-f78f-44b8-ac25-32e31b1c327a admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:11.447963 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccf14c-95fc-42b8-9866-d5ee42f70d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:11.450460 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccf14c-95fc-42b8-9866-d5ee42f70d0a admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:11.450460 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccf14c-95fc-42b8-9866-d5ee42f70d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:11.450460 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccf14c-95fc-42b8-9866-d5ee42f70d0a admin admin] PATH_INFO: `/v3/projects/2533277699fd4491a2268f69e64d06bb/users/b9350d904e6d4f81b73474e210e7cfe7/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:11.470595 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccf14c-95fc-42b8-9866-d5ee42f70d0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2533277699fd4491a2268f69e64d06bb, user_id=b9350d904e6d4f81b73474e210e7cfe7, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:11.473828 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccf14c-95fc-42b8-9866-d5ee42f70d0a admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:11.497374 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1300/2596] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:47:11 2022] PUT /identity/v3/projects/2533277699fd4491a2268f69e64d06bb/users/b9350d904e6d4f81b73474e210e7cfe7/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:47:11.508306 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb1909-8578-470a-9736-291cb6a8189e None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:11.508607 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb1909-8578-470a-9736-291cb6a8189e None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:11.508888 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb1909-8578-470a-9736-291cb6a8189e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:11.542017 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-a2bb1909-8578-470a-9736-291cb6a8189e None None] MFA Rules not processed for user `b9350d904e6d4f81b73474e210e7cfe7`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:47:11.543260 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-a2bb1909-8578-470a-9736-291cb6a8189e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:11.616709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1297/2597] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:47:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:47:11.618200 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccf14c-95fc-42b8-9866-d5ee42f70d0a admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:11.693024 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccf14c-95fc-42b8-9866-d5ee42f70d0a admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:11.703218 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413e27b-daea-40e4-bb43-204e296d7e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:11.703999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413e27b-daea-40e4-bb43-204e296d7e6e admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:11.704288 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413e27b-daea-40e4-bb43-204e296d7e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:11.704558 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413e27b-daea-40e4-bb43-204e296d7e6e admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:11.705297 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413e27b-daea-40e4-bb43-204e296d7e6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:11.707789 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413e27b-daea-40e4-bb43-204e296d7e6e admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:11.742330 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1301/2598] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:47:11 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:47:11.745563 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb1909-8578-470a-9736-291cb6a8189e None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:11.758262 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb1909-8578-470a-9736-291cb6a8189e None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:11.824752 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee9b7e-dc35-40b9-8322-a4b57e774a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:11.825555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee9b7e-dc35-40b9-8322-a4b57e774a44 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:11.825889 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee9b7e-dc35-40b9-8322-a4b57e774a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:11.826260 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee9b7e-dc35-40b9-8322-a4b57e774a44 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:11.827040 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee9b7e-dc35-40b9-8322-a4b57e774a44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:11.829152 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee9b7e-dc35-40b9-8322-a4b57e774a44 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:11.858625 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1298/2599] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:47:11 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:47:11.859994 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413e27b-daea-40e4-bb43-204e296d7e6e admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:11.871330 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413e27b-daea-40e4-bb43-204e296d7e6e admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:11.878642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f793d5-92d9-4227-ab72-8786c6c0df2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:11.879555 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f793d5-92d9-4227-ab72-8786c6c0df2c admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:11.880023 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f793d5-92d9-4227-ab72-8786c6c0df2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:11.880521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f793d5-92d9-4227-ab72-8786c6c0df2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:11.881450 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f793d5-92d9-4227-ab72-8786c6c0df2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:11.883091 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f793d5-92d9-4227-ab72-8786c6c0df2c admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:11.899900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1302/2600] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:47:11.903745 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee9b7e-dc35-40b9-8322-a4b57e774a44 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:11.916328 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee9b7e-dc35-40b9-8322-a4b57e774a44 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:11.924274 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d427f6-2bba-4b69-bc1c-13868d079c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:11.925654 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d427f6-2bba-4b69-bc1c-13868d079c88 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:11.925970 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d427f6-2bba-4b69-bc1c-13868d079c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:11.926274 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d427f6-2bba-4b69-bc1c-13868d079c88 admin admin] PATH_INFO: `/v3/projects/df2786c681234396a919a5b1a4d019dd/users/a445d145f1954670a0567563da0b0776/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:11.949005 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d427f6-2bba-4b69-bc1c-13868d079c88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df2786c681234396a919a5b1a4d019dd, user_id=a445d145f1954670a0567563da0b0776, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:11.949477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d427f6-2bba-4b69-bc1c-13868d079c88 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:11.965924 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1299/2601] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:47:11 2022] PUT /identity/v3/projects/df2786c681234396a919a5b1a4d019dd/users/a445d145f1954670a0567563da0b0776/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:47:11.970343 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f793d5-92d9-4227-ab72-8786c6c0df2c admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:11.981946 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f793d5-92d9-4227-ab72-8786c6c0df2c admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:12.051322 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd081e-9866-42de-a1b8-270397fd8810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:12.052157 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd081e-9866-42de-a1b8-270397fd8810 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:12.052498 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd081e-9866-42de-a1b8-270397fd8810 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:12.052825 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd081e-9866-42de-a1b8-270397fd8810 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:12.054447 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd081e-9866-42de-a1b8-270397fd8810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:12.057023 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd081e-9866-42de-a1b8-270397fd8810 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:12.069272 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1303/2602] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:47:12.073295 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d427f6-2bba-4b69-bc1c-13868d079c88 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:12.084621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d427f6-2bba-4b69-bc1c-13868d079c88 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:12.089452 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d24610-e2cd-4980-ac56-2af56cea2092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:12.090705 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d24610-e2cd-4980-ac56-2af56cea2092 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:12.091342 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d24610-e2cd-4980-ac56-2af56cea2092 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:12.091802 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d24610-e2cd-4980-ac56-2af56cea2092 admin admin] PATH_INFO: `/v3/projects/df2786c681234396a919a5b1a4d019dd/users/a445d145f1954670a0567563da0b0776/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:12.098487 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d24610-e2cd-4980-ac56-2af56cea2092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df2786c681234396a919a5b1a4d019dd, user_id=a445d145f1954670a0567563da0b0776, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:12.099230 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d24610-e2cd-4980-ac56-2af56cea2092 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:12.112731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1300/2603] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:47:12 2022] PUT /identity/v3/projects/df2786c681234396a919a5b1a4d019dd/users/a445d145f1954670a0567563da0b0776/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:47:12.123717 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d8c73-2a57-4e58-bf13-af82d1afff33 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:12.124003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d8c73-2a57-4e58-bf13-af82d1afff33 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:12.124312 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d8c73-2a57-4e58-bf13-af82d1afff33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:12.156083 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-ae5d8c73-2a57-4e58-bf13-af82d1afff33 None None] MFA Rules not processed for user `a445d145f1954670a0567563da0b0776`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:47:12.157458 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-ae5d8c73-2a57-4e58-bf13-af82d1afff33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:12.250823 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1304/2604] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:47:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:47:12.262950 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d24610-e2cd-4980-ac56-2af56cea2092 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:12.264922 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-46d24610-e2cd-4980-ac56-2af56cea2092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:12.366063 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d24610-e2cd-4980-ac56-2af56cea2092 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:12.370325 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058fc6e-6169-4070-b409-0436a241e2ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:12.371082 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058fc6e-6169-4070-b409-0436a241e2ce service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:12.371437 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058fc6e-6169-4070-b409-0436a241e2ce service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:12.371866 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058fc6e-6169-4070-b409-0436a241e2ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:12.381875 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058fc6e-6169-4070-b409-0436a241e2ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:12.383492 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058fc6e-6169-4070-b409-0436a241e2ce service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:12.395392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1301/2605] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:47:12 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:47:12.476207 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d8c73-2a57-4e58-bf13-af82d1afff33 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:12.486110 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d8c73-2a57-4e58-bf13-af82d1afff33 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:12.490016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e20479-9fed-40aa-b6e8-2612336f56a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:12.490712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e20479-9fed-40aa-b6e8-2612336f56a8 service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:12.490995 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e20479-9fed-40aa-b6e8-2612336f56a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:12.491274 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e20479-9fed-40aa-b6e8-2612336f56a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:12.554949 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e20479-9fed-40aa-b6e8-2612336f56a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:12.556950 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e20479-9fed-40aa-b6e8-2612336f56a8 service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:12.567144 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1305/2606] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:47:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:47:22.292445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c9f2f-7f44-412f-89d7-4e0774d2c92b None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:22.292975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c9f2f-7f44-412f-89d7-4e0774d2c92b None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:22.293095 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c9f2f-7f44-412f-89d7-4e0774d2c92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:22.310686 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-411c9f2f-7f44-412f-89d7-4e0774d2c92b None None] MFA Rules not processed for user `bd41f419750140268f4d4b77456065c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:47:22.311854 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-411c9f2f-7f44-412f-89d7-4e0774d2c92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:22.365183 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1302/2607] 10.222.0.60 () {58 vars in 967 bytes} [Thu May 12 09:47:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:47:22.378321 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e20479-9fed-40aa-b6e8-2612336f56a8 service cinder] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:22.379751 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-15e20479-9fed-40aa-b6e8-2612336f56a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:22.445173 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e20479-9fed-40aa-b6e8-2612336f56a8 service cinder] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:22.450142 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73556334-4cc3-4922-aae1-dec7a25d5dae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7693a31911346f9bb2c01efcd8e16e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:22.450765 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73556334-4cc3-4922-aae1-dec7a25d5dae service swift] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:22.451042 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73556334-4cc3-4922-aae1-dec7a25d5dae service swift] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:22.451312 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73556334-4cc3-4922-aae1-dec7a25d5dae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:22.459026 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73556334-4cc3-4922-aae1-dec7a25d5dae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:22.460638 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73556334-4cc3-4922-aae1-dec7a25d5dae service swift] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:22.468299 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1306/2608] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 12 09:47:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 09:47:24.330521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c9f2f-7f44-412f-89d7-4e0774d2c92b None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:24.332012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-411c9f2f-7f44-412f-89d7-4e0774d2c92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:24.395103 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c9f2f-7f44-412f-89d7-4e0774d2c92b None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:24.399572 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9147e-b2c3-4f34-9ffa-0208eba6efe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:24.400458 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9147e-b2c3-4f34-9ffa-0208eba6efe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:24.400742 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9147e-b2c3-4f34-9ffa-0208eba6efe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:24.401025 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9147e-b2c3-4f34-9ffa-0208eba6efe1 admin admin] PATH_INFO: `/v3/users/8427a2000ab943f6a6fa72d068efe2ac` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:24.402277 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9147e-b2c3-4f34-9ffa-0208eba6efe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8427a2000ab943f6a6fa72d068efe2ac)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:24.404219 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9147e-b2c3-4f34-9ffa-0208eba6efe1 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:24.448287 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-7fb9147e-b2c3-4f34-9ffa-0208eba6efe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8427a2000ab943f6a6fa72d068efe2ac'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:24.459813 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-7fb9147e-b2c3-4f34-9ffa-0208eba6efe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8427a2000ab943f6a6fa72d068efe2ac'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:24.460604 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-7fb9147e-b2c3-4f34-9ffa-0208eba6efe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8427a2000ab943f6a6fa72d068efe2ac'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:24.466844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-7fb9147e-b2c3-4f34-9ffa-0208eba6efe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8427a2000ab943f6a6fa72d068efe2ac'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:24.473670 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-7fb9147e-b2c3-4f34-9ffa-0208eba6efe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8427a2000ab943f6a6fa72d068efe2ac'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:24.479354 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1303/2609] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:47:24 2022] DELETE /identity/v3/users/8427a2000ab943f6a6fa72d068efe2ac => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:47:24.649632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73556334-4cc3-4922-aae1-dec7a25d5dae service swift] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:24.671272 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73556334-4cc3-4922-aae1-dec7a25d5dae service swift] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:24.728873 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6a6f3-ff81-4041-ae8a-679d5361adea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:24.729724 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6a6f3-ff81-4041-ae8a-679d5361adea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:24.730034 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6a6f3-ff81-4041-ae8a-679d5361adea admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:24.730305 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6a6f3-ff81-4041-ae8a-679d5361adea admin admin] PATH_INFO: `/v3/projects/f905d25356874ac88be7ed35a624e230` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:24.731509 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f6a6f3-ff81-4041-ae8a-679d5361adea admin admin] RBAC: Authorizing `identity:delete_project(project_id=f905d25356874ac88be7ed35a624e230)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:24.733460 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f6a6f3-ff81-4041-ae8a-679d5361adea admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:24.790088 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e5f6a6f3-ff81-4041-ae8a-679d5361adea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f905d25356874ac88be7ed35a624e230', 'request_id': 'req-e5f6a6f3-ff81-4041-ae8a-679d5361adea'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:24.795665 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e5f6a6f3-ff81-4041-ae8a-679d5361adea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f905d25356874ac88be7ed35a624e230', 'request_id': 'req-e5f6a6f3-ff81-4041-ae8a-679d5361adea'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:24.803205 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e5f6a6f3-ff81-4041-ae8a-679d5361adea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f905d25356874ac88be7ed35a624e230', 'request_id': 'req-e5f6a6f3-ff81-4041-ae8a-679d5361adea'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:24.815727 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e5f6a6f3-ff81-4041-ae8a-679d5361adea admin admin] The token cache is being invalidate because project f905d25356874ac88be7ed35a624e230 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:47:24.816013 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e5f6a6f3-ff81-4041-ae8a-679d5361adea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:24.816770 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-e5f6a6f3-ff81-4041-ae8a-679d5361adea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:24.818367 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1307/2610] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:47:24 2022] DELETE /identity/v3/projects/f905d25356874ac88be7ed35a624e230 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:47:24.823581 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46af61f-7437-4705-a9d0-de01013b658b None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:24.823948 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46af61f-7437-4705-a9d0-de01013b658b None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:24.824321 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46af61f-7437-4705-a9d0-de01013b658b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:24.844370 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-b46af61f-7437-4705-a9d0-de01013b658b None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:47:24.845544 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-b46af61f-7437-4705-a9d0-de01013b658b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:24.904835 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1304/2611] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:47:24.912318 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d4432-947d-475d-b787-4a0edd02cf46 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:24.912603 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d4432-947d-475d-b787-4a0edd02cf46 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:24.912877 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d4432-947d-475d-b787-4a0edd02cf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:24.930452 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-c76d4432-947d-475d-b787-4a0edd02cf46 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:47:24.931619 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-c76d4432-947d-475d-b787-4a0edd02cf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:24.939329 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1308/2612] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:47:24.943904 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46af61f-7437-4705-a9d0-de01013b658b None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:24.953296 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46af61f-7437-4705-a9d0-de01013b658b None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:24.959227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a545a1-590a-4bc7-845b-e649208650f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:24.959936 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a545a1-590a-4bc7-845b-e649208650f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:24.960163 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a545a1-590a-4bc7-845b-e649208650f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:24.960434 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a545a1-590a-4bc7-845b-e649208650f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:24.961168 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a545a1-590a-4bc7-845b-e649208650f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:47:24.961456 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a545a1-590a-4bc7-845b-e649208650f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:24.963095 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a545a1-590a-4bc7-845b-e649208650f3 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:24.975059 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1305/2613] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:47:24.979304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d4432-947d-475d-b787-4a0edd02cf46 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:24.989311 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d4432-947d-475d-b787-4a0edd02cf46 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:24.994224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7bbc6-db17-4304-8ebb-d2eb7335c879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:24.994903 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7bbc6-db17-4304-8ebb-d2eb7335c879 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:24.995149 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7bbc6-db17-4304-8ebb-d2eb7335c879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:24.995419 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7bbc6-db17-4304-8ebb-d2eb7335c879 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:24.996115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae7bbc6-db17-4304-8ebb-d2eb7335c879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:24.998025 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae7bbc6-db17-4304-8ebb-d2eb7335c879 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:25.023003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1309/2614] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:47:24 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:47:25.027007 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a545a1-590a-4bc7-845b-e649208650f3 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:25.037166 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a545a1-590a-4bc7-845b-e649208650f3 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:25.093669 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94405ad4-af9e-4092-be4d-61606f4c7ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:25.094374 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94405ad4-af9e-4092-be4d-61606f4c7ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:25.094661 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94405ad4-af9e-4092-be4d-61606f4c7ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:25.094932 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94405ad4-af9e-4092-be4d-61606f4c7ad0 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:25.095758 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94405ad4-af9e-4092-be4d-61606f4c7ad0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:25.098286 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94405ad4-af9e-4092-be4d-61606f4c7ad0 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:25.119634 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1306/2615] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:47:25 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:47:25.123745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7bbc6-db17-4304-8ebb-d2eb7335c879 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:25.133802 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7bbc6-db17-4304-8ebb-d2eb7335c879 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:25.138717 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247f235-e744-428f-a259-679a6fed1f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:25.139364 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247f235-e744-428f-a259-679a6fed1f07 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:25.139645 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247f235-e744-428f-a259-679a6fed1f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:25.139920 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247f235-e744-428f-a259-679a6fed1f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:25.140634 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247f235-e744-428f-a259-679a6fed1f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:25.142257 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247f235-e744-428f-a259-679a6fed1f07 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:25.152701 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1310/2616] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:47:25.156391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94405ad4-af9e-4092-be4d-61606f4c7ad0 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:25.166905 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94405ad4-af9e-4092-be4d-61606f4c7ad0 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:25.171730 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8b786-b8ac-43cb-8bb3-9fbb94e4ec26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:25.172383 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8b786-b8ac-43cb-8bb3-9fbb94e4ec26 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:25.172670 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8b786-b8ac-43cb-8bb3-9fbb94e4ec26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:25.172944 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8b786-b8ac-43cb-8bb3-9fbb94e4ec26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:25.173664 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf8b786-b8ac-43cb-8bb3-9fbb94e4ec26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:25.175317 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf8b786-b8ac-43cb-8bb3-9fbb94e4ec26 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:25.185046 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1307/2617] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:47:25.188957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247f235-e744-428f-a259-679a6fed1f07 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:25.198964 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247f235-e744-428f-a259-679a6fed1f07 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:25.203631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3c207-cf4f-47b1-a680-cb2f18813651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:25.204501 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3c207-cf4f-47b1-a680-cb2f18813651 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:25.204785 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3c207-cf4f-47b1-a680-cb2f18813651 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:25.205062 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3c207-cf4f-47b1-a680-cb2f18813651 admin admin] PATH_INFO: `/v3/projects/748ebbff1ab440d3ba00d94064065525/users/cc1b0f6fec494b51bd1199e4c9f65139/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:25.219656 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3c207-cf4f-47b1-a680-cb2f18813651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=748ebbff1ab440d3ba00d94064065525, user_id=cc1b0f6fec494b51bd1199e4c9f65139, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:25.222888 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3c207-cf4f-47b1-a680-cb2f18813651 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:25.235291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1311/2618] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:47:25 2022] PUT /identity/v3/projects/748ebbff1ab440d3ba00d94064065525/users/cc1b0f6fec494b51bd1199e4c9f65139/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:47:25.245796 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628cf9e-12a3-4f8d-b76a-b920c9cb37ec None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:25.246134 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628cf9e-12a3-4f8d-b76a-b920c9cb37ec None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:25.246443 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628cf9e-12a3-4f8d-b76a-b920c9cb37ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:25.272420 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-d628cf9e-12a3-4f8d-b76a-b920c9cb37ec None None] MFA Rules not processed for user `cc1b0f6fec494b51bd1199e4c9f65139`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:47:25.273645 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-d628cf9e-12a3-4f8d-b76a-b920c9cb37ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:25.334633 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1308/2619] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:47:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:47:25.347246 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3c207-cf4f-47b1-a680-cb2f18813651 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:25.348939 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-75f3c207-cf4f-47b1-a680-cb2f18813651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:25.405018 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3c207-cf4f-47b1-a680-cb2f18813651 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:25.408704 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fe12e-c068-444c-88f4-40b6930c63de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:25.409273 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fe12e-c068-444c-88f4-40b6930c63de service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:25.409552 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fe12e-c068-444c-88f4-40b6930c63de service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:25.409821 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fe12e-c068-444c-88f4-40b6930c63de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:25.417833 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574fe12e-c068-444c-88f4-40b6930c63de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:25.419280 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574fe12e-c068-444c-88f4-40b6930c63de service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:25.427782 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1312/2620] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:47:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:47:27.935648 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628cf9e-12a3-4f8d-b76a-b920c9cb37ec None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:27.994255 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628cf9e-12a3-4f8d-b76a-b920c9cb37ec None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:27.998723 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560a789-d69f-4bdf-83c3-9b06caf7b9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:27.999581 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560a789-d69f-4bdf-83c3-9b06caf7b9e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:27.999857 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560a789-d69f-4bdf-83c3-9b06caf7b9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:28.000124 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560a789-d69f-4bdf-83c3-9b06caf7b9e0 admin admin] PATH_INFO: `/v3/users/cc1b0f6fec494b51bd1199e4c9f65139` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:28.001282 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560a789-d69f-4bdf-83c3-9b06caf7b9e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc1b0f6fec494b51bd1199e4c9f65139)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:28.003714 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560a789-d69f-4bdf-83c3-9b06caf7b9e0 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:28.046970 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e560a789-d69f-4bdf-83c3-9b06caf7b9e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc1b0f6fec494b51bd1199e4c9f65139'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:28.058765 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e560a789-d69f-4bdf-83c3-9b06caf7b9e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc1b0f6fec494b51bd1199e4c9f65139'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:28.059426 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e560a789-d69f-4bdf-83c3-9b06caf7b9e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc1b0f6fec494b51bd1199e4c9f65139'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:28.066876 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e560a789-d69f-4bdf-83c3-9b06caf7b9e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc1b0f6fec494b51bd1199e4c9f65139'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:28.073579 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e560a789-d69f-4bdf-83c3-9b06caf7b9e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc1b0f6fec494b51bd1199e4c9f65139'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:28.079231 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1309/2621] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:47:27 2022] DELETE /identity/v3/users/cc1b0f6fec494b51bd1199e4c9f65139 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:47:28.083773 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda75065-62af-4395-8a7d-012dbefcaf28 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:28.084260 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda75065-62af-4395-8a7d-012dbefcaf28 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:28.084376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda75065-62af-4395-8a7d-012dbefcaf28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:28.101259 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-dda75065-62af-4395-8a7d-012dbefcaf28 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:47:28.102310 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-dda75065-62af-4395-8a7d-012dbefcaf28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:28.159469 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1313/2622] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:47:28.169006 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560a789-d69f-4bdf-83c3-9b06caf7b9e0 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:28.170393 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-e560a789-d69f-4bdf-83c3-9b06caf7b9e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:28.224789 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560a789-d69f-4bdf-83c3-9b06caf7b9e0 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:28.228626 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98178737-d81b-4da9-8dda-29d59e481aeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:28.229276 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98178737-d81b-4da9-8dda-29d59e481aeb service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:28.229559 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98178737-d81b-4da9-8dda-29d59e481aeb service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:28.229832 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98178737-d81b-4da9-8dda-29d59e481aeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:28.239377 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98178737-d81b-4da9-8dda-29d59e481aeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:28.240796 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98178737-d81b-4da9-8dda-29d59e481aeb service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:28.250049 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1310/2623] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:47:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:47:28.507546 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda75065-62af-4395-8a7d-012dbefcaf28 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:28.509158 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-dda75065-62af-4395-8a7d-012dbefcaf28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:28.532527 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda75065-62af-4395-8a7d-012dbefcaf28 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:28.537648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dac82e-1fde-443f-8f17-75fd0b0b4b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:28.538555 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dac82e-1fde-443f-8f17-75fd0b0b4b38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:28.538836 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dac82e-1fde-443f-8f17-75fd0b0b4b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:28.539106 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dac82e-1fde-443f-8f17-75fd0b0b4b38 admin admin] PATH_INFO: `/v3/projects/748ebbff1ab440d3ba00d94064065525` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:28.540294 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dac82e-1fde-443f-8f17-75fd0b0b4b38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=748ebbff1ab440d3ba00d94064065525)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:28.542236 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dac82e-1fde-443f-8f17-75fd0b0b4b38 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:28.588632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-a3dac82e-1fde-443f-8f17-75fd0b0b4b38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '748ebbff1ab440d3ba00d94064065525', 'request_id': 'req-a3dac82e-1fde-443f-8f17-75fd0b0b4b38'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:28.594177 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-a3dac82e-1fde-443f-8f17-75fd0b0b4b38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '748ebbff1ab440d3ba00d94064065525', 'request_id': 'req-a3dac82e-1fde-443f-8f17-75fd0b0b4b38'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:28.601727 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-a3dac82e-1fde-443f-8f17-75fd0b0b4b38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '748ebbff1ab440d3ba00d94064065525', 'request_id': 'req-a3dac82e-1fde-443f-8f17-75fd0b0b4b38'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:28.613813 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-a3dac82e-1fde-443f-8f17-75fd0b0b4b38 admin admin] The token cache is being invalidate because project 748ebbff1ab440d3ba00d94064065525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:47:28.614172 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-a3dac82e-1fde-443f-8f17-75fd0b0b4b38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:28.614811 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-a3dac82e-1fde-443f-8f17-75fd0b0b4b38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:28.616396 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1314/2624] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:47:28 2022] DELETE /identity/v3/projects/748ebbff1ab440d3ba00d94064065525 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:47:28.621592 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8e9d5-3c05-420f-a0b0-502627f26468 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:28.621989 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8e9d5-3c05-420f-a0b0-502627f26468 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:28.622391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8e9d5-3c05-420f-a0b0-502627f26468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:28.641837 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-5ae8e9d5-3c05-420f-a0b0-502627f26468 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:47:28.643873 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-5ae8e9d5-3c05-420f-a0b0-502627f26468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:28.703242 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1311/2625] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:47:28.711781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea23a2c-768e-4d9c-970a-91ba9d25e0ed None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:28.712070 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea23a2c-768e-4d9c-970a-91ba9d25e0ed None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:28.712372 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea23a2c-768e-4d9c-970a-91ba9d25e0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:28.731733 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-bea23a2c-768e-4d9c-970a-91ba9d25e0ed None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:47:28.732878 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-bea23a2c-768e-4d9c-970a-91ba9d25e0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:28.745856 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1315/2626] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:47:28.749888 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8e9d5-3c05-420f-a0b0-502627f26468 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:28.761044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8e9d5-3c05-420f-a0b0-502627f26468 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:28.766136 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623c387-3304-4c27-a639-78c5376c533f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:28.766845 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623c387-3304-4c27-a639-78c5376c533f admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:28.767124 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623c387-3304-4c27-a639-78c5376c533f admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:28.767446 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623c387-3304-4c27-a639-78c5376c533f admin admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:28.768735 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623c387-3304-4c27-a639-78c5376c533f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:47:28.769039 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623c387-3304-4c27-a639-78c5376c533f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:28.770877 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623c387-3304-4c27-a639-78c5376c533f admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:28.784347 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1312/2627] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:47:28.788425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea23a2c-768e-4d9c-970a-91ba9d25e0ed None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:28.797804 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea23a2c-768e-4d9c-970a-91ba9d25e0ed None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:28.808580 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d539b1-95bd-4c52-ad88-5c1adfd8da6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:28.809539 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d539b1-95bd-4c52-ad88-5c1adfd8da6f admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:28.809833 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d539b1-95bd-4c52-ad88-5c1adfd8da6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:28.810177 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d539b1-95bd-4c52-ad88-5c1adfd8da6f admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:28.811114 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d539b1-95bd-4c52-ad88-5c1adfd8da6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:28.813323 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d539b1-95bd-4c52-ad88-5c1adfd8da6f admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:28.839306 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1316/2628] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:47:28 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:47:28.843557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623c387-3304-4c27-a639-78c5376c533f admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:28.853183 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623c387-3304-4c27-a639-78c5376c533f admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:28.908062 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab8080-61c2-418f-a0bf-8e30eb622229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:28.908739 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab8080-61c2-418f-a0bf-8e30eb622229 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:28.909023 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab8080-61c2-418f-a0bf-8e30eb622229 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:28.909298 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab8080-61c2-418f-a0bf-8e30eb622229 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:28.910027 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab8080-61c2-418f-a0bf-8e30eb622229 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:28.911933 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab8080-61c2-418f-a0bf-8e30eb622229 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:28.931038 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1313/2629] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:47:28 2022] POST /identity/v3/users => generated 286 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:47:28.935298 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d539b1-95bd-4c52-ad88-5c1adfd8da6f admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:28.946230 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d539b1-95bd-4c52-ad88-5c1adfd8da6f admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:28.950783 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403ffa2-e52c-48db-a550-d1d4b8929935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:28.951429 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403ffa2-e52c-48db-a550-d1d4b8929935 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:28.951712 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403ffa2-e52c-48db-a550-d1d4b8929935 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:28.951986 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403ffa2-e52c-48db-a550-d1d4b8929935 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:28.952709 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6403ffa2-e52c-48db-a550-d1d4b8929935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:28.954332 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6403ffa2-e52c-48db-a550-d1d4b8929935 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:28.964335 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1317/2630] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:47:28.968240 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab8080-61c2-418f-a0bf-8e30eb622229 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:28.977878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab8080-61c2-418f-a0bf-8e30eb622229 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:28.982416 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b0f4d-1654-44c4-825e-3e62a0de070d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:28.983058 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b0f4d-1654-44c4-825e-3e62a0de070d admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:28.983336 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b0f4d-1654-44c4-825e-3e62a0de070d admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:28.983606 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b0f4d-1654-44c4-825e-3e62a0de070d admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:28.984315 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b0f4d-1654-44c4-825e-3e62a0de070d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:28.985877 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b0f4d-1654-44c4-825e-3e62a0de070d admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:28.995904 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1314/2631] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:47:28.999782 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403ffa2-e52c-48db-a550-d1d4b8929935 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:29.009975 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403ffa2-e52c-48db-a550-d1d4b8929935 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:29.014799 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385919e-f77c-40f4-bfaa-5613d566e5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:29.015659 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385919e-f77c-40f4-bfaa-5613d566e5aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:29.015942 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385919e-f77c-40f4-bfaa-5613d566e5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:29.016219 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385919e-f77c-40f4-bfaa-5613d566e5aa admin admin] PATH_INFO: `/v3/projects/9f65cd74ac574aba960f9adc4e943d76/users/b25a54ef78204c96b606c0783db61f84/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:29.030187 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385919e-f77c-40f4-bfaa-5613d566e5aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f65cd74ac574aba960f9adc4e943d76, user_id=b25a54ef78204c96b606c0783db61f84, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:29.032791 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385919e-f77c-40f4-bfaa-5613d566e5aa admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:29.044957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1318/2632] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:47:28 2022] PUT /identity/v3/projects/9f65cd74ac574aba960f9adc4e943d76/users/b25a54ef78204c96b606c0783db61f84/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:47:29.055497 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee19178-d7fa-4eba-b41a-9d70387e65d3 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:29.055789 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee19178-d7fa-4eba-b41a-9d70387e65d3 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:29.056066 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee19178-d7fa-4eba-b41a-9d70387e65d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:29.083156 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-bee19178-d7fa-4eba-b41a-9d70387e65d3 None None] MFA Rules not processed for user `b25a54ef78204c96b606c0783db61f84`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:47:29.084331 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-bee19178-d7fa-4eba-b41a-9d70387e65d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:29.146030 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1315/2633] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:47:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:47:29.157322 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385919e-f77c-40f4-bfaa-5613d566e5aa admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:29.159663 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-a385919e-f77c-40f4-bfaa-5613d566e5aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:29.214601 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385919e-f77c-40f4-bfaa-5613d566e5aa admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:29.218360 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9472bf-9367-4a0c-affc-2bab97452f14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:29.218998 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9472bf-9367-4a0c-affc-2bab97452f14 service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:29.219278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9472bf-9367-4a0c-affc-2bab97452f14 service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:29.219554 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9472bf-9367-4a0c-affc-2bab97452f14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:29.228337 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9472bf-9367-4a0c-affc-2bab97452f14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:29.229797 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9472bf-9367-4a0c-affc-2bab97452f14 service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:29.239194 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1319/2634] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:47:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:47:29.263909 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee19178-d7fa-4eba-b41a-9d70387e65d3 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:29.322893 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee19178-d7fa-4eba-b41a-9d70387e65d3 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:29.327393 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6907c-5ec8-46b8-bddd-66d242ae9a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:29.328249 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6907c-5ec8-46b8-bddd-66d242ae9a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:29.328526 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6907c-5ec8-46b8-bddd-66d242ae9a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:29.328794 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6907c-5ec8-46b8-bddd-66d242ae9a14 admin admin] PATH_INFO: `/v3/users/b25a54ef78204c96b606c0783db61f84` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:29.330018 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6907c-5ec8-46b8-bddd-66d242ae9a14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b25a54ef78204c96b606c0783db61f84)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:29.331939 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6907c-5ec8-46b8-bddd-66d242ae9a14 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:29.376099 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e1c6907c-5ec8-46b8-bddd-66d242ae9a14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b25a54ef78204c96b606c0783db61f84'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:29.387175 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e1c6907c-5ec8-46b8-bddd-66d242ae9a14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b25a54ef78204c96b606c0783db61f84'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:29.388096 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e1c6907c-5ec8-46b8-bddd-66d242ae9a14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b25a54ef78204c96b606c0783db61f84'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:29.394718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e1c6907c-5ec8-46b8-bddd-66d242ae9a14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b25a54ef78204c96b606c0783db61f84'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:29.401336 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e1c6907c-5ec8-46b8-bddd-66d242ae9a14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b25a54ef78204c96b606c0783db61f84'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:29.407049 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1316/2635] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:47:29 2022] DELETE /identity/v3/users/b25a54ef78204c96b606c0783db61f84 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:47:29.412204 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdb5ba-87cc-4527-8bfa-179788afebac None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:29.412491 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdb5ba-87cc-4527-8bfa-179788afebac None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:29.412765 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdb5ba-87cc-4527-8bfa-179788afebac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:29.429747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-8dbdb5ba-87cc-4527-8bfa-179788afebac None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:47:29.430973 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-8dbdb5ba-87cc-4527-8bfa-179788afebac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:29.487089 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1320/2636] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:47:29.496696 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6907c-5ec8-46b8-bddd-66d242ae9a14 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:29.498146 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-e1c6907c-5ec8-46b8-bddd-66d242ae9a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:29.553462 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6907c-5ec8-46b8-bddd-66d242ae9a14 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:29.557106 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d5115-82c7-4dca-bc54-c934028c7d51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:29.557747 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d5115-82c7-4dca-bc54-c934028c7d51 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:29.558062 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d5115-82c7-4dca-bc54-c934028c7d51 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:29.558340 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d5115-82c7-4dca-bc54-c934028c7d51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:29.567335 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d5115-82c7-4dca-bc54-c934028c7d51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:29.568745 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d5115-82c7-4dca-bc54-c934028c7d51 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:29.577813 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1317/2637] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:47:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:47:29.849882 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdb5ba-87cc-4527-8bfa-179788afebac None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:29.852256 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-8dbdb5ba-87cc-4527-8bfa-179788afebac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:29.870841 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdb5ba-87cc-4527-8bfa-179788afebac None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:29.876621 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dccdc5-1340-4cc9-bda2-540bb349e6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:29.883352 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dccdc5-1340-4cc9-bda2-540bb349e6d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:29.883659 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dccdc5-1340-4cc9-bda2-540bb349e6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:29.883938 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dccdc5-1340-4cc9-bda2-540bb349e6d0 admin admin] PATH_INFO: `/v3/projects/9f65cd74ac574aba960f9adc4e943d76` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:29.885301 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dccdc5-1340-4cc9-bda2-540bb349e6d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f65cd74ac574aba960f9adc4e943d76)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:29.887284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dccdc5-1340-4cc9-bda2-540bb349e6d0 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:29.934322 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-11dccdc5-1340-4cc9-bda2-540bb349e6d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f65cd74ac574aba960f9adc4e943d76', 'request_id': 'req-11dccdc5-1340-4cc9-bda2-540bb349e6d0'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:29.940416 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-11dccdc5-1340-4cc9-bda2-540bb349e6d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f65cd74ac574aba960f9adc4e943d76', 'request_id': 'req-11dccdc5-1340-4cc9-bda2-540bb349e6d0'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:29.948683 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-11dccdc5-1340-4cc9-bda2-540bb349e6d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f65cd74ac574aba960f9adc4e943d76', 'request_id': 'req-11dccdc5-1340-4cc9-bda2-540bb349e6d0'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:29.960363 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-11dccdc5-1340-4cc9-bda2-540bb349e6d0 admin admin] The token cache is being invalidate because project 9f65cd74ac574aba960f9adc4e943d76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:47:29.960647 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-11dccdc5-1340-4cc9-bda2-540bb349e6d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:29.961270 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-11dccdc5-1340-4cc9-bda2-540bb349e6d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:29.962864 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1321/2638] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:47:29 2022] DELETE /identity/v3/projects/9f65cd74ac574aba960f9adc4e943d76 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:47:57.161154 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d5115-82c7-4dca-bc54-c934028c7d51 service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:57.162552 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-941d5115-82c7-4dca-bc54-c934028c7d51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:57.256002 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d5115-82c7-4dca-bc54-c934028c7d51 service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:57.312852 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf38f4d-5451-4675-aad6-31456391c5dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525f4699878f461e82f7f06ef60c176a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:57.313588 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf38f4d-5451-4675-aad6-31456391c5dc service placement] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:57.313874 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf38f4d-5451-4675-aad6-31456391c5dc service placement] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:57.314189 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf38f4d-5451-4675-aad6-31456391c5dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:57.315983 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-aaf38f4d-5451-4675-aad6-31456391c5dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:57.326844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf38f4d-5451-4675-aad6-31456391c5dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:57.328397 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf38f4d-5451-4675-aad6-31456391c5dc service placement] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:57.337941 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1318/2639] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:47:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:47:57.875654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dccdc5-1340-4cc9-bda2-540bb349e6d0 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:57.877106 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-11dccdc5-1340-4cc9-bda2-540bb349e6d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:57.950649 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dccdc5-1340-4cc9-bda2-540bb349e6d0 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:57.955229 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b407c3-ac51-403f-87f1-a815fccc3af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:57.956087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b407c3-ac51-403f-87f1-a815fccc3af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:57.956361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b407c3-ac51-403f-87f1-a815fccc3af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:57.956631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b407c3-ac51-403f-87f1-a815fccc3af7 admin admin] PATH_INFO: `/v3/users/b9350d904e6d4f81b73474e210e7cfe7` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:57.957808 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b407c3-ac51-403f-87f1-a815fccc3af7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9350d904e6d4f81b73474e210e7cfe7)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:57.959744 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b407c3-ac51-403f-87f1-a815fccc3af7 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:58.003483 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-83b407c3-ac51-403f-87f1-a815fccc3af7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9350d904e6d4f81b73474e210e7cfe7'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:58.015138 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-83b407c3-ac51-403f-87f1-a815fccc3af7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9350d904e6d4f81b73474e210e7cfe7'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:58.015784 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-83b407c3-ac51-403f-87f1-a815fccc3af7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9350d904e6d4f81b73474e210e7cfe7'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:58.022505 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-83b407c3-ac51-403f-87f1-a815fccc3af7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9350d904e6d4f81b73474e210e7cfe7'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:58.029165 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-83b407c3-ac51-403f-87f1-a815fccc3af7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9350d904e6d4f81b73474e210e7cfe7'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:58.034874 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1322/2640] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:47:57 2022] DELETE /identity/v3/users/b9350d904e6d4f81b73474e210e7cfe7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:47:58.039903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df1f68-b7e2-4d81-9ff9-9c324de40c6a None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:58.040218 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df1f68-b7e2-4d81-9ff9-9c324de40c6a None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:58.040492 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df1f68-b7e2-4d81-9ff9-9c324de40c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:58.058197 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-76df1f68-b7e2-4d81-9ff9-9c324de40c6a None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:47:58.059380 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-76df1f68-b7e2-4d81-9ff9-9c324de40c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:58.115472 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1319/2641] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:47:58.125140 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b407c3-ac51-403f-87f1-a815fccc3af7 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:58.126648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-83b407c3-ac51-403f-87f1-a815fccc3af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:58.181734 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b407c3-ac51-403f-87f1-a815fccc3af7 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:58.185301 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee19bf-48fe-49ce-98a8-34a4317b3659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:58.185976 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee19bf-48fe-49ce-98a8-34a4317b3659 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:58.186259 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee19bf-48fe-49ce-98a8-34a4317b3659 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:58.186531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee19bf-48fe-49ce-98a8-34a4317b3659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:58.195189 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee19bf-48fe-49ce-98a8-34a4317b3659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:58.196592 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee19bf-48fe-49ce-98a8-34a4317b3659 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:58.205798 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1323/2642] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:47:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:47:58.456641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df1f68-b7e2-4d81-9ff9-9c324de40c6a None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:58.457992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-76df1f68-b7e2-4d81-9ff9-9c324de40c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:58.469360 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df1f68-b7e2-4d81-9ff9-9c324de40c6a None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:58.474004 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc3d32-a600-4a79-90b7-c29fc190a105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:58.475555 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc3d32-a600-4a79-90b7-c29fc190a105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:58.475848 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc3d32-a600-4a79-90b7-c29fc190a105 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:58.476120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc3d32-a600-4a79-90b7-c29fc190a105 admin admin] PATH_INFO: `/v3/projects/2533277699fd4491a2268f69e64d06bb` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:58.477475 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fc3d32-a600-4a79-90b7-c29fc190a105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2533277699fd4491a2268f69e64d06bb)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:58.479444 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fc3d32-a600-4a79-90b7-c29fc190a105 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:58.531672 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-37fc3d32-a600-4a79-90b7-c29fc190a105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2533277699fd4491a2268f69e64d06bb', 'request_id': 'req-37fc3d32-a600-4a79-90b7-c29fc190a105'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:58.537284 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-37fc3d32-a600-4a79-90b7-c29fc190a105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2533277699fd4491a2268f69e64d06bb', 'request_id': 'req-37fc3d32-a600-4a79-90b7-c29fc190a105'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:58.545819 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-37fc3d32-a600-4a79-90b7-c29fc190a105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2533277699fd4491a2268f69e64d06bb', 'request_id': 'req-37fc3d32-a600-4a79-90b7-c29fc190a105'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:58.557159 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-37fc3d32-a600-4a79-90b7-c29fc190a105 admin admin] The token cache is being invalidate because project 2533277699fd4491a2268f69e64d06bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:47:58.557433 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-37fc3d32-a600-4a79-90b7-c29fc190a105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:58.558092 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-37fc3d32-a600-4a79-90b7-c29fc190a105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:58.559657 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1320/2643] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:47:58 2022] DELETE /identity/v3/projects/2533277699fd4491a2268f69e64d06bb => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:47:58.563595 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee19bf-48fe-49ce-98a8-34a4317b3659 service neutron] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:58.573553 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee19bf-48fe-49ce-98a8-34a4317b3659 service neutron] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:58.627646 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97242ad-b47b-4518-8baa-a439a35027e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:58.628505 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97242ad-b47b-4518-8baa-a439a35027e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:58.628782 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97242ad-b47b-4518-8baa-a439a35027e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:58.629606 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97242ad-b47b-4518-8baa-a439a35027e4 admin admin] PATH_INFO: `/v3/users/a445d145f1954670a0567563da0b0776` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:58.630833 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97242ad-b47b-4518-8baa-a439a35027e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a445d145f1954670a0567563da0b0776)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:58.632725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97242ad-b47b-4518-8baa-a439a35027e4 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:58.675132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-c97242ad-b47b-4518-8baa-a439a35027e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a445d145f1954670a0567563da0b0776'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:58.686694 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-c97242ad-b47b-4518-8baa-a439a35027e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a445d145f1954670a0567563da0b0776'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:58.687314 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-c97242ad-b47b-4518-8baa-a439a35027e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a445d145f1954670a0567563da0b0776'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:58.694672 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-c97242ad-b47b-4518-8baa-a439a35027e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a445d145f1954670a0567563da0b0776'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:58.701443 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-c97242ad-b47b-4518-8baa-a439a35027e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a445d145f1954670a0567563da0b0776'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:58.707294 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1324/2644] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:47:58 2022] DELETE /identity/v3/users/a445d145f1954670a0567563da0b0776 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:47:58.975334 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc3d32-a600-4a79-90b7-c29fc190a105 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:58.976869 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-37fc3d32-a600-4a79-90b7-c29fc190a105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:58.993820 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc3d32-a600-4a79-90b7-c29fc190a105 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:59.047004 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b713fd-4392-4e2d-b6ae-e595a4648d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:59.047854 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b713fd-4392-4e2d-b6ae-e595a4648d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:59.048128 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b713fd-4392-4e2d-b6ae-e595a4648d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:59.048393 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b713fd-4392-4e2d-b6ae-e595a4648d1d admin admin] PATH_INFO: `/v3/projects/df2786c681234396a919a5b1a4d019dd` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:59.049551 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b713fd-4392-4e2d-b6ae-e595a4648d1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=df2786c681234396a919a5b1a4d019dd)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:59.052029 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b713fd-4392-4e2d-b6ae-e595a4648d1d admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:59.096617 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-c7b713fd-4392-4e2d-b6ae-e595a4648d1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df2786c681234396a919a5b1a4d019dd', 'request_id': 'req-c7b713fd-4392-4e2d-b6ae-e595a4648d1d'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:59.104100 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-c7b713fd-4392-4e2d-b6ae-e595a4648d1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df2786c681234396a919a5b1a4d019dd', 'request_id': 'req-c7b713fd-4392-4e2d-b6ae-e595a4648d1d'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:59.109756 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-c7b713fd-4392-4e2d-b6ae-e595a4648d1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df2786c681234396a919a5b1a4d019dd', 'request_id': 'req-c7b713fd-4392-4e2d-b6ae-e595a4648d1d'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:59.120619 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-c7b713fd-4392-4e2d-b6ae-e595a4648d1d admin admin] The token cache is being invalidate because project df2786c681234396a919a5b1a4d019dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:47:59.120906 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-c7b713fd-4392-4e2d-b6ae-e595a4648d1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:59.121523 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-c7b713fd-4392-4e2d-b6ae-e595a4648d1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:47:59.123409 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1321/2645] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:47:58 2022] DELETE /identity/v3/projects/df2786c681234396a919a5b1a4d019dd => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:47:59.128129 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af42538-c55a-4b0b-af88-9d7ed431fbc9 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:59.128591 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af42538-c55a-4b0b-af88-9d7ed431fbc9 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:59.128689 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af42538-c55a-4b0b-af88-9d7ed431fbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:59.147063 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-7af42538-c55a-4b0b-af88-9d7ed431fbc9 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:47:59.148236 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-7af42538-c55a-4b0b-af88-9d7ed431fbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:59.204521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1325/2646] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:47:59.212886 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ca5be-90a9-4789-9ad7-5df0925bc560 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:59.213189 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ca5be-90a9-4789-9ad7-5df0925bc560 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:59.213461 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ca5be-90a9-4789-9ad7-5df0925bc560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:59.231791 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-a42ca5be-90a9-4789-9ad7-5df0925bc560 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:47:59.233001 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-a42ca5be-90a9-4789-9ad7-5df0925bc560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:59.240825 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1322/2647] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:47:59.245014 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af42538-c55a-4b0b-af88-9d7ed431fbc9 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:59.254762 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af42538-c55a-4b0b-af88-9d7ed431fbc9 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:59.259354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231bcae-34cb-4fdb-9c81-2066569fb242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:59.260001 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231bcae-34cb-4fdb-9c81-2066569fb242 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:59.260287 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231bcae-34cb-4fdb-9c81-2066569fb242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:59.260561 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231bcae-34cb-4fdb-9c81-2066569fb242 admin admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:59.261309 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231bcae-34cb-4fdb-9c81-2066569fb242 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:47:59.261616 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231bcae-34cb-4fdb-9c81-2066569fb242 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:59.263239 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231bcae-34cb-4fdb-9c81-2066569fb242 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:59.275071 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1326/2648] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:47:59.279246 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ca5be-90a9-4789-9ad7-5df0925bc560 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:59.288772 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ca5be-90a9-4789-9ad7-5df0925bc560 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:59.293346 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b60cf-d04f-4cd8-a610-ed22641029d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:59.294010 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b60cf-d04f-4cd8-a610-ed22641029d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:59.294312 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b60cf-d04f-4cd8-a610-ed22641029d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:59.294588 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b60cf-d04f-4cd8-a610-ed22641029d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:59.295263 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b60cf-d04f-4cd8-a610-ed22641029d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:59.297130 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b60cf-d04f-4cd8-a610-ed22641029d4 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:59.322656 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1323/2649] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:47:59 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:47:59.326731 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231bcae-34cb-4fdb-9c81-2066569fb242 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:59.337071 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231bcae-34cb-4fdb-9c81-2066569fb242 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:59.389828 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa7dd3-e169-460e-9fa7-77b725e982f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:59.390508 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa7dd3-e169-460e-9fa7-77b725e982f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:59.390785 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa7dd3-e169-460e-9fa7-77b725e982f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:59.391056 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa7dd3-e169-460e-9fa7-77b725e982f7 admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:59.391725 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa7dd3-e169-460e-9fa7-77b725e982f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:59.393611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa7dd3-e169-460e-9fa7-77b725e982f7 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:59.412546 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1327/2650] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:47:59 2022] POST /identity/v3/users => generated 287 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:47:59.416917 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b60cf-d04f-4cd8-a610-ed22641029d4 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:59.426911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b60cf-d04f-4cd8-a610-ed22641029d4 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:59.431419 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf6a28-b8dd-42a7-84db-559177063b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:59.432073 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf6a28-b8dd-42a7-84db-559177063b08 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:59.432356 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf6a28-b8dd-42a7-84db-559177063b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:59.432631 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf6a28-b8dd-42a7-84db-559177063b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:59.433346 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf6a28-b8dd-42a7-84db-559177063b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:59.435062 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf6a28-b8dd-42a7-84db-559177063b08 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:59.444962 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1324/2651] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:47:59.448627 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa7dd3-e169-460e-9fa7-77b725e982f7 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:59.458614 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa7dd3-e169-460e-9fa7-77b725e982f7 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:59.463179 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe251e3-12f1-4817-95fd-8acb88ec887b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:59.463816 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe251e3-12f1-4817-95fd-8acb88ec887b admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:59.464096 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe251e3-12f1-4817-95fd-8acb88ec887b admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:59.464363 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe251e3-12f1-4817-95fd-8acb88ec887b admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:59.465079 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe251e3-12f1-4817-95fd-8acb88ec887b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:59.466691 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe251e3-12f1-4817-95fd-8acb88ec887b admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:59.476611 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1328/2652] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:47:59.480397 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf6a28-b8dd-42a7-84db-559177063b08 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:59.490148 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf6a28-b8dd-42a7-84db-559177063b08 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:59.494677 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34064de1-a7df-45dc-aeaf-d0bae06780e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:59.495535 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34064de1-a7df-45dc-aeaf-d0bae06780e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:59.495817 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34064de1-a7df-45dc-aeaf-d0bae06780e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:59.496091 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34064de1-a7df-45dc-aeaf-d0bae06780e7 admin admin] PATH_INFO: `/v3/projects/b2d496decf6b4edcae3d034c667ffec8/users/df4c08fbef1e418c87384da91270dc71/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:59.510758 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34064de1-a7df-45dc-aeaf-d0bae06780e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2d496decf6b4edcae3d034c667ffec8, user_id=df4c08fbef1e418c87384da91270dc71, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:59.513662 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34064de1-a7df-45dc-aeaf-d0bae06780e7 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:59.526427 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1325/2653] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:47:59 2022] PUT /identity/v3/projects/b2d496decf6b4edcae3d034c667ffec8/users/df4c08fbef1e418c87384da91270dc71/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:47:59.537108 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de378c03-1b5a-43ee-be99-c8a620957e94 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:59.537402 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de378c03-1b5a-43ee-be99-c8a620957e94 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:59.537679 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de378c03-1b5a-43ee-be99-c8a620957e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:59.563104 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-de378c03-1b5a-43ee-be99-c8a620957e94 None None] MFA Rules not processed for user `df4c08fbef1e418c87384da91270dc71`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:47:59.564290 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-de378c03-1b5a-43ee-be99-c8a620957e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:47:59.625068 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1329/2654] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:47:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:47:59.629876 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34064de1-a7df-45dc-aeaf-d0bae06780e7 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:59.688795 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34064de1-a7df-45dc-aeaf-d0bae06780e7 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:59.694100 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab41d4-128f-4f90-967a-e203501f405a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:59.694751 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab41d4-128f-4f90-967a-e203501f405a admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:59.695035 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab41d4-128f-4f90-967a-e203501f405a admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:59.695308 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab41d4-128f-4f90-967a-e203501f405a admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:59.695995 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab41d4-128f-4f90-967a-e203501f405a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:59.697861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab41d4-128f-4f90-967a-e203501f405a admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:59.721812 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1326/2655] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:47:59 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:47:59.725741 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de378c03-1b5a-43ee-be99-c8a620957e94 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:59.736238 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de378c03-1b5a-43ee-be99-c8a620957e94 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:59.790176 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6544d-ae9e-48ed-bdd3-09ac50ca5521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:59.790759 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6544d-ae9e-48ed-bdd3-09ac50ca5521 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:59.791036 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6544d-ae9e-48ed-bdd3-09ac50ca5521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:59.791308 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6544d-ae9e-48ed-bdd3-09ac50ca5521 admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:59.792016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6544d-ae9e-48ed-bdd3-09ac50ca5521 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:59.793969 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6544d-ae9e-48ed-bdd3-09ac50ca5521 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:59.811848 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1330/2656] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:47:59 2022] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:47:59.815829 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab41d4-128f-4f90-967a-e203501f405a admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:59.826592 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab41d4-128f-4f90-967a-e203501f405a admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:59.831221 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06beabbe-37b2-4d40-9e0a-c7eafc5974a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:59.831874 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06beabbe-37b2-4d40-9e0a-c7eafc5974a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:59.832693 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06beabbe-37b2-4d40-9e0a-c7eafc5974a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:59.832973 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06beabbe-37b2-4d40-9e0a-c7eafc5974a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:59.833692 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06beabbe-37b2-4d40-9e0a-c7eafc5974a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:59.835313 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06beabbe-37b2-4d40-9e0a-c7eafc5974a2 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:59.845799 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1327/2657] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 09:47:59.849696 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6544d-ae9e-48ed-bdd3-09ac50ca5521 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:59.859312 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6544d-ae9e-48ed-bdd3-09ac50ca5521 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:59.864380 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f7923-bf94-46a0-b150-80826a1bc565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:59.865237 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f7923-bf94-46a0-b150-80826a1bc565 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:59.865513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f7923-bf94-46a0-b150-80826a1bc565 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:59.865783 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f7923-bf94-46a0-b150-80826a1bc565 admin admin] PATH_INFO: `/v3/projects/380444cb3c854c08a709d21b919d0481/users/15c45bf9c0c34658bc0bde7fc7b64169/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:59.880280 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f7923-bf94-46a0-b150-80826a1bc565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=380444cb3c854c08a709d21b919d0481, user_id=15c45bf9c0c34658bc0bde7fc7b64169, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:59.882933 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f7923-bf94-46a0-b150-80826a1bc565 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:59.895794 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1331/2658] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:47:59 2022] PUT /identity/v3/projects/380444cb3c854c08a709d21b919d0481/users/15c45bf9c0c34658bc0bde7fc7b64169/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:47:59.899650 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06beabbe-37b2-4d40-9e0a-c7eafc5974a2 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:47:59.909312 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06beabbe-37b2-4d40-9e0a-c7eafc5974a2 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:47:59.975526 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c60bf1-693a-4d04-b0ba-2488b8fc6cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:47:59.976189 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c60bf1-693a-4d04-b0ba-2488b8fc6cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:47:59.976469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c60bf1-693a-4d04-b0ba-2488b8fc6cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:47:59.976738 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c60bf1-693a-4d04-b0ba-2488b8fc6cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:47:59.977786 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c60bf1-693a-4d04-b0ba-2488b8fc6cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:47:59.979390 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c60bf1-693a-4d04-b0ba-2488b8fc6cf0 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:47:59.989107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1328/2659] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:47:59.993323 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f7923-bf94-46a0-b150-80826a1bc565 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:00.003433 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f7923-bf94-46a0-b150-80826a1bc565 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:00.008800 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac043b60-dc7d-476c-87f8-fc94ecd34a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:00.009669 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac043b60-dc7d-476c-87f8-fc94ecd34a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:00.009982 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac043b60-dc7d-476c-87f8-fc94ecd34a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:00.010257 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac043b60-dc7d-476c-87f8-fc94ecd34a16 admin admin] PATH_INFO: `/v3/projects/380444cb3c854c08a709d21b919d0481/users/15c45bf9c0c34658bc0bde7fc7b64169/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:00.012220 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac043b60-dc7d-476c-87f8-fc94ecd34a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=380444cb3c854c08a709d21b919d0481, user_id=15c45bf9c0c34658bc0bde7fc7b64169, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:00.015144 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac043b60-dc7d-476c-87f8-fc94ecd34a16 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:00.025667 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1332/2660] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:47:59 2022] PUT /identity/v3/projects/380444cb3c854c08a709d21b919d0481/users/15c45bf9c0c34658bc0bde7fc7b64169/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:48:00.036259 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5568c-2617-4159-8c0b-bf009f1914c5 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:00.036545 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5568c-2617-4159-8c0b-bf009f1914c5 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:00.036817 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5568c-2617-4159-8c0b-bf009f1914c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:00.061948 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-5cc5568c-2617-4159-8c0b-bf009f1914c5 None None] MFA Rules not processed for user `15c45bf9c0c34658bc0bde7fc7b64169`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:48:00.063049 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-5cc5568c-2617-4159-8c0b-bf009f1914c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:00.128117 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1329/2661] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:48:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:48:00.139638 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac043b60-dc7d-476c-87f8-fc94ecd34a16 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:00.141424 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-ac043b60-dc7d-476c-87f8-fc94ecd34a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:00.202274 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac043b60-dc7d-476c-87f8-fc94ecd34a16 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:00.205988 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89184805-99f5-4250-90f6-3c0b103a5980 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:00.206633 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89184805-99f5-4250-90f6-3c0b103a5980 service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:00.206917 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89184805-99f5-4250-90f6-3c0b103a5980 service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:00.207211 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89184805-99f5-4250-90f6-3c0b103a5980 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:00.216215 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89184805-99f5-4250-90f6-3c0b103a5980 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:00.217630 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89184805-99f5-4250-90f6-3c0b103a5980 service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:00.227533 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1333/2662] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:48:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:48:00.574669 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5568c-2617-4159-8c0b-bf009f1914c5 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:00.634227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5568c-2617-4159-8c0b-bf009f1914c5 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:00.638950 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92e331-a89f-440b-8dbe-0608c415e460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:00.639808 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92e331-a89f-440b-8dbe-0608c415e460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:00.640087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92e331-a89f-440b-8dbe-0608c415e460 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:00.640360 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92e331-a89f-440b-8dbe-0608c415e460 admin admin] PATH_INFO: `/v3/users/df4c08fbef1e418c87384da91270dc71` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:00.641528 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b92e331-a89f-440b-8dbe-0608c415e460 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df4c08fbef1e418c87384da91270dc71)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:00.643470 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b92e331-a89f-440b-8dbe-0608c415e460 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:00.684726 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-9b92e331-a89f-440b-8dbe-0608c415e460 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df4c08fbef1e418c87384da91270dc71'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:00.696433 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-9b92e331-a89f-440b-8dbe-0608c415e460 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df4c08fbef1e418c87384da91270dc71'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:00.697077 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-9b92e331-a89f-440b-8dbe-0608c415e460 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df4c08fbef1e418c87384da91270dc71'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:00.703694 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-9b92e331-a89f-440b-8dbe-0608c415e460 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df4c08fbef1e418c87384da91270dc71'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:00.710192 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-9b92e331-a89f-440b-8dbe-0608c415e460 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df4c08fbef1e418c87384da91270dc71'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:00.715771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1330/2663] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:48:00 2022] DELETE /identity/v3/users/df4c08fbef1e418c87384da91270dc71 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:48:00.720155 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0710d4-42de-4c36-a46a-fb5dcac6b4e1 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:00.720442 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0710d4-42de-4c36-a46a-fb5dcac6b4e1 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:00.720718 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0710d4-42de-4c36-a46a-fb5dcac6b4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:00.736998 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-8c0710d4-42de-4c36-a46a-fb5dcac6b4e1 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:48:00.738726 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-8c0710d4-42de-4c36-a46a-fb5dcac6b4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:00.793982 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1334/2664] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:48:00.804150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92e331-a89f-440b-8dbe-0608c415e460 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:00.805511 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-9b92e331-a89f-440b-8dbe-0608c415e460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:00.860099 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92e331-a89f-440b-8dbe-0608c415e460 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:00.864112 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56fd70-cc84-4336-842d-124b30587170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:00.864749 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56fd70-cc84-4336-842d-124b30587170 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:00.865024 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56fd70-cc84-4336-842d-124b30587170 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:00.865291 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56fd70-cc84-4336-842d-124b30587170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:00.874418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56fd70-cc84-4336-842d-124b30587170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:00.875863 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56fd70-cc84-4336-842d-124b30587170 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:00.885700 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1331/2665] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:48:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:48:01.146822 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0710d4-42de-4c36-a46a-fb5dcac6b4e1 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:01.148259 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-8c0710d4-42de-4c36-a46a-fb5dcac6b4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:01.160774 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0710d4-42de-4c36-a46a-fb5dcac6b4e1 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:01.165393 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcadb9f-d441-4fef-9b28-72ccb477a230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:01.166298 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcadb9f-d441-4fef-9b28-72ccb477a230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:01.166579 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcadb9f-d441-4fef-9b28-72ccb477a230 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:01.166857 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcadb9f-d441-4fef-9b28-72ccb477a230 admin admin] PATH_INFO: `/v3/projects/b2d496decf6b4edcae3d034c667ffec8` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:01.168045 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcadb9f-d441-4fef-9b28-72ccb477a230 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2d496decf6b4edcae3d034c667ffec8)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:01.169976 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcadb9f-d441-4fef-9b28-72ccb477a230 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:01.216588 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-0fcadb9f-d441-4fef-9b28-72ccb477a230 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2d496decf6b4edcae3d034c667ffec8', 'request_id': 'req-0fcadb9f-d441-4fef-9b28-72ccb477a230'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:01.221677 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-0fcadb9f-d441-4fef-9b28-72ccb477a230 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2d496decf6b4edcae3d034c667ffec8', 'request_id': 'req-0fcadb9f-d441-4fef-9b28-72ccb477a230'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:01.229932 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-0fcadb9f-d441-4fef-9b28-72ccb477a230 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2d496decf6b4edcae3d034c667ffec8', 'request_id': 'req-0fcadb9f-d441-4fef-9b28-72ccb477a230'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:01.241446 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-0fcadb9f-d441-4fef-9b28-72ccb477a230 admin admin] The token cache is being invalidate because project b2d496decf6b4edcae3d034c667ffec8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:48:01.241732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-0fcadb9f-d441-4fef-9b28-72ccb477a230 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:01.242430 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-0fcadb9f-d441-4fef-9b28-72ccb477a230 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:01.244139 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1335/2666] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:48:01 2022] DELETE /identity/v3/projects/b2d496decf6b4edcae3d034c667ffec8 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:48:01.247768 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56fd70-cc84-4336-842d-124b30587170 service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:01.257083 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56fd70-cc84-4336-842d-124b30587170 service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:01.314519 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243737d-62aa-4223-9b96-bd92817b0dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:01.315395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243737d-62aa-4223-9b96-bd92817b0dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:01.315678 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243737d-62aa-4223-9b96-bd92817b0dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:01.315955 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243737d-62aa-4223-9b96-bd92817b0dd7 admin admin] PATH_INFO: `/v3/users/15c45bf9c0c34658bc0bde7fc7b64169` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:01.317147 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243737d-62aa-4223-9b96-bd92817b0dd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15c45bf9c0c34658bc0bde7fc7b64169)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:01.319153 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243737d-62aa-4223-9b96-bd92817b0dd7 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:01.365144 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-5243737d-62aa-4223-9b96-bd92817b0dd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15c45bf9c0c34658bc0bde7fc7b64169'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:01.376657 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-5243737d-62aa-4223-9b96-bd92817b0dd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15c45bf9c0c34658bc0bde7fc7b64169'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:01.377332 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-5243737d-62aa-4223-9b96-bd92817b0dd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15c45bf9c0c34658bc0bde7fc7b64169'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:01.384734 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-5243737d-62aa-4223-9b96-bd92817b0dd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15c45bf9c0c34658bc0bde7fc7b64169'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:01.392385 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-5243737d-62aa-4223-9b96-bd92817b0dd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15c45bf9c0c34658bc0bde7fc7b64169'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:01.398715 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1332/2667] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:48:01 2022] DELETE /identity/v3/users/15c45bf9c0c34658bc0bde7fc7b64169 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:48:01.663738 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcadb9f-d441-4fef-9b28-72ccb477a230 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:01.665168 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-0fcadb9f-d441-4fef-9b28-72ccb477a230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:01.678212 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcadb9f-d441-4fef-9b28-72ccb477a230 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:01.734578 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d2117-9add-45d6-bdde-525463fc2c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:01.735442 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d2117-9add-45d6-bdde-525463fc2c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:01.735727 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d2117-9add-45d6-bdde-525463fc2c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:01.736034 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d2117-9add-45d6-bdde-525463fc2c01 admin admin] PATH_INFO: `/v3/projects/380444cb3c854c08a709d21b919d0481` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:01.737259 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d2117-9add-45d6-bdde-525463fc2c01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=380444cb3c854c08a709d21b919d0481)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:01.739799 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d2117-9add-45d6-bdde-525463fc2c01 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:01.782723 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-b91d2117-9add-45d6-bdde-525463fc2c01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '380444cb3c854c08a709d21b919d0481', 'request_id': 'req-b91d2117-9add-45d6-bdde-525463fc2c01'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:01.788463 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-b91d2117-9add-45d6-bdde-525463fc2c01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '380444cb3c854c08a709d21b919d0481', 'request_id': 'req-b91d2117-9add-45d6-bdde-525463fc2c01'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:01.795497 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-b91d2117-9add-45d6-bdde-525463fc2c01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '380444cb3c854c08a709d21b919d0481', 'request_id': 'req-b91d2117-9add-45d6-bdde-525463fc2c01'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:01.806621 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-b91d2117-9add-45d6-bdde-525463fc2c01 admin admin] The token cache is being invalidate because project 380444cb3c854c08a709d21b919d0481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:48:01.806900 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-b91d2117-9add-45d6-bdde-525463fc2c01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:01.807513 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-b91d2117-9add-45d6-bdde-525463fc2c01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:01.809061 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1336/2668] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:48:01 2022] DELETE /identity/v3/projects/380444cb3c854c08a709d21b919d0481 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:48:01.814070 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aaaf25-d1e7-47c5-90da-cab69ec7b7fd None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:01.814557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aaaf25-d1e7-47c5-90da-cab69ec7b7fd None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:01.814761 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aaaf25-d1e7-47c5-90da-cab69ec7b7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:01.832387 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-51aaaf25-d1e7-47c5-90da-cab69ec7b7fd None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:48:01.833596 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-51aaaf25-d1e7-47c5-90da-cab69ec7b7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:01.889825 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1333/2669] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:48:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:48:01.897310 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d43dd-dea9-4237-aa5b-8cac78d712fc None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:01.897597 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d43dd-dea9-4237-aa5b-8cac78d712fc None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:01.897873 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d43dd-dea9-4237-aa5b-8cac78d712fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:01.916078 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-495d43dd-dea9-4237-aa5b-8cac78d712fc None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:48:01.917193 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-495d43dd-dea9-4237-aa5b-8cac78d712fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:01.925136 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1337/2670] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:48:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:48:01.929802 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aaaf25-d1e7-47c5-90da-cab69ec7b7fd None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:01.939665 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aaaf25-d1e7-47c5-90da-cab69ec7b7fd None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:01.945125 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246ee34-7f17-46f6-93ff-01312adbf006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:01.945849 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246ee34-7f17-46f6-93ff-01312adbf006 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:01.946256 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246ee34-7f17-46f6-93ff-01312adbf006 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:01.946558 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246ee34-7f17-46f6-93ff-01312adbf006 admin admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:01.947462 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246ee34-7f17-46f6-93ff-01312adbf006 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:48:01.947994 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246ee34-7f17-46f6-93ff-01312adbf006 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:01.958240 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246ee34-7f17-46f6-93ff-01312adbf006 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:01.970206 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1334/2671] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:48:01.975286 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d43dd-dea9-4237-aa5b-8cac78d712fc None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:01.985001 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d43dd-dea9-4237-aa5b-8cac78d712fc None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:01.990409 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf964c9-231f-4d57-8b0e-407fa4f4e419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:01.991059 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf964c9-231f-4d57-8b0e-407fa4f4e419 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:01.991344 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf964c9-231f-4d57-8b0e-407fa4f4e419 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:01.991619 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf964c9-231f-4d57-8b0e-407fa4f4e419 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:01.992309 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf964c9-231f-4d57-8b0e-407fa4f4e419 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:01.994241 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf964c9-231f-4d57-8b0e-407fa4f4e419 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:02.023344 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1338/2672] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:48:01 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:48:02.024550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246ee34-7f17-46f6-93ff-01312adbf006 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:02.035417 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246ee34-7f17-46f6-93ff-01312adbf006 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:02.091670 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11da585-afb4-4778-b04f-124076bc2486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:02.092344 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11da585-afb4-4778-b04f-124076bc2486 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:02.092628 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11da585-afb4-4778-b04f-124076bc2486 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:02.092906 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11da585-afb4-4778-b04f-124076bc2486 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:02.093587 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11da585-afb4-4778-b04f-124076bc2486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:02.095584 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11da585-afb4-4778-b04f-124076bc2486 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:02.120997 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1335/2673] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:48:02 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:48:02.122153 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf964c9-231f-4d57-8b0e-407fa4f4e419 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:02.133027 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf964c9-231f-4d57-8b0e-407fa4f4e419 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:02.137810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716d298-3c51-432a-8d1c-4eb82478bf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:02.139031 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716d298-3c51-432a-8d1c-4eb82478bf9c admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:02.139314 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716d298-3c51-432a-8d1c-4eb82478bf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:02.139589 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716d298-3c51-432a-8d1c-4eb82478bf9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:02.140346 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716d298-3c51-432a-8d1c-4eb82478bf9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:02.141949 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716d298-3c51-432a-8d1c-4eb82478bf9c admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:02.152603 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1339/2674] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:48:02.156398 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11da585-afb4-4778-b04f-124076bc2486 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:02.166447 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11da585-afb4-4778-b04f-124076bc2486 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:02.171052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c7b2d-81b1-409c-9357-b45a8155f52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:02.171708 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c7b2d-81b1-409c-9357-b45a8155f52f admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:02.171996 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c7b2d-81b1-409c-9357-b45a8155f52f admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:02.172276 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c7b2d-81b1-409c-9357-b45a8155f52f admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:02.172996 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c7b2d-81b1-409c-9357-b45a8155f52f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:02.174621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c7b2d-81b1-409c-9357-b45a8155f52f admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:02.184713 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1336/2675] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:48:02.188606 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716d298-3c51-432a-8d1c-4eb82478bf9c admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:02.198811 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716d298-3c51-432a-8d1c-4eb82478bf9c admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:02.203439 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8526a-4a43-49c3-9ed7-50e7fa5c7540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:02.204389 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8526a-4a43-49c3-9ed7-50e7fa5c7540 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:02.204673 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8526a-4a43-49c3-9ed7-50e7fa5c7540 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:02.204949 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8526a-4a43-49c3-9ed7-50e7fa5c7540 admin admin] PATH_INFO: `/v3/projects/566550ffe906466d872b8c2734c71030/users/d103304650a147df8c1ce33c98eeff81/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:02.219476 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8526a-4a43-49c3-9ed7-50e7fa5c7540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=566550ffe906466d872b8c2734c71030, user_id=d103304650a147df8c1ce33c98eeff81, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:02.222116 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8526a-4a43-49c3-9ed7-50e7fa5c7540 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:02.235073 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1340/2676] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:48:02 2022] PUT /identity/v3/projects/566550ffe906466d872b8c2734c71030/users/d103304650a147df8c1ce33c98eeff81/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:48:02.249402 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83cdd0-1568-41e9-b6df-82bf06f05f24 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:02.249722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83cdd0-1568-41e9-b6df-82bf06f05f24 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:02.250647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83cdd0-1568-41e9-b6df-82bf06f05f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:02.278536 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-db83cdd0-1568-41e9-b6df-82bf06f05f24 None None] MFA Rules not processed for user `d103304650a147df8c1ce33c98eeff81`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:48:02.279749 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-db83cdd0-1568-41e9-b6df-82bf06f05f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:02.343333 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1337/2677] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:48:02 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:48:02.348531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8526a-4a43-49c3-9ed7-50e7fa5c7540 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:02.415689 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8526a-4a43-49c3-9ed7-50e7fa5c7540 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:02.420756 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b27070-bd67-4aee-a9f9-d74242225fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:02.421326 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b27070-bd67-4aee-a9f9-d74242225fc5 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:02.421603 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b27070-bd67-4aee-a9f9-d74242225fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:02.421869 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b27070-bd67-4aee-a9f9-d74242225fc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:02.422610 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b27070-bd67-4aee-a9f9-d74242225fc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:02.424493 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b27070-bd67-4aee-a9f9-d74242225fc5 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:02.448100 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1341/2678] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:48:02 2022] POST /identity/v3/projects => generated 369 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:48:02.452177 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83cdd0-1568-41e9-b6df-82bf06f05f24 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:02.463785 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83cdd0-1568-41e9-b6df-82bf06f05f24 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:02.518080 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56ac05-6b47-470b-aef1-ec47fb4903b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:02.518753 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56ac05-6b47-470b-aef1-ec47fb4903b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:02.519034 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56ac05-6b47-470b-aef1-ec47fb4903b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:02.519307 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56ac05-6b47-470b-aef1-ec47fb4903b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:02.520610 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56ac05-6b47-470b-aef1-ec47fb4903b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:02.522515 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56ac05-6b47-470b-aef1-ec47fb4903b8 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:02.544225 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1338/2679] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:48:02 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:48:02.547548 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b27070-bd67-4aee-a9f9-d74242225fc5 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:02.558527 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b27070-bd67-4aee-a9f9-d74242225fc5 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:02.563196 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f40716-cb5d-4162-a986-d05a1eb9ced9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:02.563893 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f40716-cb5d-4162-a986-d05a1eb9ced9 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:02.564083 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f40716-cb5d-4162-a986-d05a1eb9ced9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:02.564358 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f40716-cb5d-4162-a986-d05a1eb9ced9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:02.565077 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f40716-cb5d-4162-a986-d05a1eb9ced9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:02.566740 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f40716-cb5d-4162-a986-d05a1eb9ced9 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:02.577470 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1342/2680] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:48:02.581432 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56ac05-6b47-470b-aef1-ec47fb4903b8 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:02.591368 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56ac05-6b47-470b-aef1-ec47fb4903b8 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:02.596056 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f36cde-43e1-482b-903a-9deecdba2cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:02.596925 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f36cde-43e1-482b-903a-9deecdba2cd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:02.597212 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f36cde-43e1-482b-903a-9deecdba2cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:02.598089 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f36cde-43e1-482b-903a-9deecdba2cd6 admin admin] PATH_INFO: `/v3/projects/b985ccbf8e404076896d2a5087d014fa/users/3826665f6b824b46b2c86a0cc7ffc578/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:02.612817 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f36cde-43e1-482b-903a-9deecdba2cd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b985ccbf8e404076896d2a5087d014fa, user_id=3826665f6b824b46b2c86a0cc7ffc578, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:02.616092 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f36cde-43e1-482b-903a-9deecdba2cd6 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:02.628914 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1339/2681] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:48:02 2022] PUT /identity/v3/projects/b985ccbf8e404076896d2a5087d014fa/users/3826665f6b824b46b2c86a0cc7ffc578/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:48:02.632936 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f40716-cb5d-4162-a986-d05a1eb9ced9 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:02.643072 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f40716-cb5d-4162-a986-d05a1eb9ced9 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:02.698721 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b51264-75c3-418d-b2b2-f7b6682c7ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:02.699313 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b51264-75c3-418d-b2b2-f7b6682c7ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:02.699597 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b51264-75c3-418d-b2b2-f7b6682c7ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:02.699872 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b51264-75c3-418d-b2b2-f7b6682c7ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:02.700631 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b51264-75c3-418d-b2b2-f7b6682c7ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:02.702290 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b51264-75c3-418d-b2b2-f7b6682c7ec4 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:02.716350 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1343/2682] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:48:02.717618 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f36cde-43e1-482b-903a-9deecdba2cd6 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:02.728678 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f36cde-43e1-482b-903a-9deecdba2cd6 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:02.734044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4827a3-e297-4eb5-890d-6c32a8ac7fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:02.737880 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4827a3-e297-4eb5-890d-6c32a8ac7fb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:02.738192 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4827a3-e297-4eb5-890d-6c32a8ac7fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:02.739089 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4827a3-e297-4eb5-890d-6c32a8ac7fb9 admin admin] PATH_INFO: `/v3/projects/b985ccbf8e404076896d2a5087d014fa/users/3826665f6b824b46b2c86a0cc7ffc578/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:02.741054 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4827a3-e297-4eb5-890d-6c32a8ac7fb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b985ccbf8e404076896d2a5087d014fa, user_id=3826665f6b824b46b2c86a0cc7ffc578, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:02.743801 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4827a3-e297-4eb5-890d-6c32a8ac7fb9 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:02.754202 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1340/2683] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:48:02 2022] PUT /identity/v3/projects/b985ccbf8e404076896d2a5087d014fa/users/3826665f6b824b46b2c86a0cc7ffc578/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:48:02.765226 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125a83b-2f2a-401a-9b45-e5c1c67ce9bd None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:02.765511 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125a83b-2f2a-401a-9b45-e5c1c67ce9bd None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:02.765786 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125a83b-2f2a-401a-9b45-e5c1c67ce9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:02.792368 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-9125a83b-2f2a-401a-9b45-e5c1c67ce9bd None None] MFA Rules not processed for user `3826665f6b824b46b2c86a0cc7ffc578`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:48:02.793626 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-9125a83b-2f2a-401a-9b45-e5c1c67ce9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:02.861374 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1344/2684] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:48:02 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:48:02.871989 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4827a3-e297-4eb5-890d-6c32a8ac7fb9 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:02.873735 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-ea4827a3-e297-4eb5-890d-6c32a8ac7fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:02.930301 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4827a3-e297-4eb5-890d-6c32a8ac7fb9 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:02.933868 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b22ac2-ae1f-4fd8-bfba-1c2962b40257 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:02.934536 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b22ac2-ae1f-4fd8-bfba-1c2962b40257 service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:02.934815 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b22ac2-ae1f-4fd8-bfba-1c2962b40257 service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:02.935083 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b22ac2-ae1f-4fd8-bfba-1c2962b40257 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:02.943968 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b22ac2-ae1f-4fd8-bfba-1c2962b40257 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:02.945368 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b22ac2-ae1f-4fd8-bfba-1c2962b40257 service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:02.954476 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1341/2685] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:48:02 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:48:04.212334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125a83b-2f2a-401a-9b45-e5c1c67ce9bd None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:04.271458 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125a83b-2f2a-401a-9b45-e5c1c67ce9bd None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:04.275826 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e15e79-610a-4a11-b2d6-2950980ac1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:04.276674 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e15e79-610a-4a11-b2d6-2950980ac1c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:04.276950 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e15e79-610a-4a11-b2d6-2950980ac1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:04.277217 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e15e79-610a-4a11-b2d6-2950980ac1c7 admin admin] PATH_INFO: `/v3/users/d103304650a147df8c1ce33c98eeff81` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:04.278441 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e15e79-610a-4a11-b2d6-2950980ac1c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d103304650a147df8c1ce33c98eeff81)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:04.280337 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e15e79-610a-4a11-b2d6-2950980ac1c7 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:04.325129 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d5e15e79-610a-4a11-b2d6-2950980ac1c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd103304650a147df8c1ce33c98eeff81'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:04.336981 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d5e15e79-610a-4a11-b2d6-2950980ac1c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd103304650a147df8c1ce33c98eeff81'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:04.337635 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d5e15e79-610a-4a11-b2d6-2950980ac1c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd103304650a147df8c1ce33c98eeff81'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:04.344624 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d5e15e79-610a-4a11-b2d6-2950980ac1c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd103304650a147df8c1ce33c98eeff81'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:04.351816 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d5e15e79-610a-4a11-b2d6-2950980ac1c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd103304650a147df8c1ce33c98eeff81'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:04.357493 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1345/2686] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:48:04 2022] DELETE /identity/v3/users/d103304650a147df8c1ce33c98eeff81 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:48:04.362084 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183db78-8ff9-4d98-a218-fd276783cbbc None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:04.362566 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183db78-8ff9-4d98-a218-fd276783cbbc None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:04.362843 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183db78-8ff9-4d98-a218-fd276783cbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:04.380446 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-1183db78-8ff9-4d98-a218-fd276783cbbc None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:48:04.381628 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-1183db78-8ff9-4d98-a218-fd276783cbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:04.441283 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1342/2687] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:48:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:48:04.451034 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e15e79-610a-4a11-b2d6-2950980ac1c7 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:04.452439 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-d5e15e79-610a-4a11-b2d6-2950980ac1c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:04.509429 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e15e79-610a-4a11-b2d6-2950980ac1c7 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:04.513067 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07cd19-84d0-4f39-a1f2-b50c8d20560d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:04.513995 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07cd19-84d0-4f39-a1f2-b50c8d20560d service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:04.514278 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07cd19-84d0-4f39-a1f2-b50c8d20560d service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:04.514549 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07cd19-84d0-4f39-a1f2-b50c8d20560d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:04.524023 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07cd19-84d0-4f39-a1f2-b50c8d20560d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:04.525395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07cd19-84d0-4f39-a1f2-b50c8d20560d service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:04.534605 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1346/2688] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:48:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:48:04.789027 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183db78-8ff9-4d98-a218-fd276783cbbc None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:04.791020 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-1183db78-8ff9-4d98-a218-fd276783cbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:04.817873 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183db78-8ff9-4d98-a218-fd276783cbbc None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:04.822846 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51afbdf-3df9-4ac0-841f-2e5a708fe095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:04.823842 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51afbdf-3df9-4ac0-841f-2e5a708fe095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:04.824224 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51afbdf-3df9-4ac0-841f-2e5a708fe095 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:04.824714 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51afbdf-3df9-4ac0-841f-2e5a708fe095 admin admin] PATH_INFO: `/v3/projects/566550ffe906466d872b8c2734c71030` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:04.826178 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51afbdf-3df9-4ac0-841f-2e5a708fe095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=566550ffe906466d872b8c2734c71030)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:04.828423 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51afbdf-3df9-4ac0-841f-2e5a708fe095 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:04.876126 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-a51afbdf-3df9-4ac0-841f-2e5a708fe095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '566550ffe906466d872b8c2734c71030', 'request_id': 'req-a51afbdf-3df9-4ac0-841f-2e5a708fe095'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:04.881990 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-a51afbdf-3df9-4ac0-841f-2e5a708fe095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '566550ffe906466d872b8c2734c71030', 'request_id': 'req-a51afbdf-3df9-4ac0-841f-2e5a708fe095'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:04.889752 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-a51afbdf-3df9-4ac0-841f-2e5a708fe095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '566550ffe906466d872b8c2734c71030', 'request_id': 'req-a51afbdf-3df9-4ac0-841f-2e5a708fe095'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:04.901942 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-a51afbdf-3df9-4ac0-841f-2e5a708fe095 admin admin] The token cache is being invalidate because project 566550ffe906466d872b8c2734c71030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:48:04.902232 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-a51afbdf-3df9-4ac0-841f-2e5a708fe095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:04.902866 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-a51afbdf-3df9-4ac0-841f-2e5a708fe095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:04.904397 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1343/2689] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:48:04 2022] DELETE /identity/v3/projects/566550ffe906466d872b8c2734c71030 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:48:04.908301 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07cd19-84d0-4f39-a1f2-b50c8d20560d service neutron] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:04.917921 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07cd19-84d0-4f39-a1f2-b50c8d20560d service neutron] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:04.973432 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333dec8-6590-4452-8967-93e417ed9123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:04.974339 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333dec8-6590-4452-8967-93e417ed9123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:04.974632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333dec8-6590-4452-8967-93e417ed9123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:04.974902 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333dec8-6590-4452-8967-93e417ed9123 admin admin] PATH_INFO: `/v3/users/3826665f6b824b46b2c86a0cc7ffc578` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:04.976113 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333dec8-6590-4452-8967-93e417ed9123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3826665f6b824b46b2c86a0cc7ffc578)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:04.978043 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333dec8-6590-4452-8967-93e417ed9123 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:05.024363 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d333dec8-6590-4452-8967-93e417ed9123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3826665f6b824b46b2c86a0cc7ffc578'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:05.036130 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d333dec8-6590-4452-8967-93e417ed9123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3826665f6b824b46b2c86a0cc7ffc578'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:05.036751 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d333dec8-6590-4452-8967-93e417ed9123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3826665f6b824b46b2c86a0cc7ffc578'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:05.043392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d333dec8-6590-4452-8967-93e417ed9123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3826665f6b824b46b2c86a0cc7ffc578'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:05.050211 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d333dec8-6590-4452-8967-93e417ed9123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3826665f6b824b46b2c86a0cc7ffc578'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:05.056162 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1347/2690] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:48:04 2022] DELETE /identity/v3/users/3826665f6b824b46b2c86a0cc7ffc578 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:48:05.342375 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51afbdf-3df9-4ac0-841f-2e5a708fe095 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:05.343875 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-a51afbdf-3df9-4ac0-841f-2e5a708fe095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:05.361975 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51afbdf-3df9-4ac0-841f-2e5a708fe095 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:05.423911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a2978-e0bc-4ed4-909a-3df42fee5c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:05.424786 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a2978-e0bc-4ed4-909a-3df42fee5c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:05.425065 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a2978-e0bc-4ed4-909a-3df42fee5c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:05.425339 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a2978-e0bc-4ed4-909a-3df42fee5c70 admin admin] PATH_INFO: `/v3/projects/b985ccbf8e404076896d2a5087d014fa` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:05.427187 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a2978-e0bc-4ed4-909a-3df42fee5c70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b985ccbf8e404076896d2a5087d014fa)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:05.429152 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a2978-e0bc-4ed4-909a-3df42fee5c70 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:05.475294 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-559a2978-e0bc-4ed4-909a-3df42fee5c70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b985ccbf8e404076896d2a5087d014fa', 'request_id': 'req-559a2978-e0bc-4ed4-909a-3df42fee5c70'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:05.480614 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-559a2978-e0bc-4ed4-909a-3df42fee5c70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b985ccbf8e404076896d2a5087d014fa', 'request_id': 'req-559a2978-e0bc-4ed4-909a-3df42fee5c70'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:05.489743 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-559a2978-e0bc-4ed4-909a-3df42fee5c70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b985ccbf8e404076896d2a5087d014fa', 'request_id': 'req-559a2978-e0bc-4ed4-909a-3df42fee5c70'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:05.501354 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-559a2978-e0bc-4ed4-909a-3df42fee5c70 admin admin] The token cache is being invalidate because project b985ccbf8e404076896d2a5087d014fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:48:05.501766 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-559a2978-e0bc-4ed4-909a-3df42fee5c70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:05.502454 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-559a2978-e0bc-4ed4-909a-3df42fee5c70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:05.504025 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1344/2691] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:48:05 2022] DELETE /identity/v3/projects/b985ccbf8e404076896d2a5087d014fa => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:48:05.508963 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f41c7-73ed-4740-ba77-b9d1668306af None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:05.509463 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f41c7-73ed-4740-ba77-b9d1668306af None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:05.510710 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f41c7-73ed-4740-ba77-b9d1668306af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:05.529984 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-340f41c7-73ed-4740-ba77-b9d1668306af None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:48:05.531526 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-340f41c7-73ed-4740-ba77-b9d1668306af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:05.595096 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1348/2692] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:48:05.603843 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f96f0c-aae9-4383-9e49-3793dde12d3e None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:05.604143 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f96f0c-aae9-4383-9e49-3793dde12d3e None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:05.604425 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f96f0c-aae9-4383-9e49-3793dde12d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:05.624479 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-49f96f0c-aae9-4383-9e49-3793dde12d3e None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:48:05.625867 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-49f96f0c-aae9-4383-9e49-3793dde12d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:05.639174 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1345/2693] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:48:05.641316 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f41c7-73ed-4740-ba77-b9d1668306af None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:05.652781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f41c7-73ed-4740-ba77-b9d1668306af None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:05.658412 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe462a3-7ded-4af0-b40c-780934123ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:05.658698 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe462a3-7ded-4af0-b40c-780934123ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:05.658978 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe462a3-7ded-4af0-b40c-780934123ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:05.659257 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe462a3-7ded-4af0-b40c-780934123ff5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:05.660568 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe462a3-7ded-4af0-b40c-780934123ff5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:48:05.660831 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe462a3-7ded-4af0-b40c-780934123ff5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:05.662477 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe462a3-7ded-4af0-b40c-780934123ff5 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:05.677946 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1349/2694] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:48:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 09:48:05.679320 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f96f0c-aae9-4383-9e49-3793dde12d3e None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:05.690791 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f96f0c-aae9-4383-9e49-3793dde12d3e None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:05.707271 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8576765-1d02-4013-a1b6-853aa6fabb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:05.707853 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8576765-1d02-4013-a1b6-853aa6fabb6d admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:05.708158 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8576765-1d02-4013-a1b6-853aa6fabb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:05.708418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8576765-1d02-4013-a1b6-853aa6fabb6d admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:05.709499 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8576765-1d02-4013-a1b6-853aa6fabb6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:05.711358 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8576765-1d02-4013-a1b6-853aa6fabb6d admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:05.748913 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1346/2695] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:48:05 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:48:05.753146 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe462a3-7ded-4af0-b40c-780934123ff5 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:05.767327 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe462a3-7ded-4af0-b40c-780934123ff5 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:05.834040 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83537019-d04e-4b9d-a662-b46c8de903dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:05.835173 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83537019-d04e-4b9d-a662-b46c8de903dd admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:05.835551 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83537019-d04e-4b9d-a662-b46c8de903dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:05.835959 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83537019-d04e-4b9d-a662-b46c8de903dd admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:05.836766 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83537019-d04e-4b9d-a662-b46c8de903dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:05.839259 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83537019-d04e-4b9d-a662-b46c8de903dd admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:05.865255 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1350/2696] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:48:05 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:48:05.866614 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8576765-1d02-4013-a1b6-853aa6fabb6d admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:05.878981 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8576765-1d02-4013-a1b6-853aa6fabb6d admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:05.886691 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a191f70-5804-4231-a33b-31ce22f82c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:05.887382 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a191f70-5804-4231-a33b-31ce22f82c37 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:05.887902 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a191f70-5804-4231-a33b-31ce22f82c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:05.888731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a191f70-5804-4231-a33b-31ce22f82c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:05.889478 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a191f70-5804-4231-a33b-31ce22f82c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:05.891186 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a191f70-5804-4231-a33b-31ce22f82c37 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:05.902383 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1347/2697] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:48:05.906565 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83537019-d04e-4b9d-a662-b46c8de903dd admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:05.917987 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83537019-d04e-4b9d-a662-b46c8de903dd admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:05.923051 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2f56b-11f6-4f3c-b956-a4b9f0b1df66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:05.923749 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2f56b-11f6-4f3c-b956-a4b9f0b1df66 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:05.924064 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2f56b-11f6-4f3c-b956-a4b9f0b1df66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:05.924295 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2f56b-11f6-4f3c-b956-a4b9f0b1df66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:05.925026 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f2f56b-11f6-4f3c-b956-a4b9f0b1df66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:05.927321 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f2f56b-11f6-4f3c-b956-a4b9f0b1df66 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:05.937777 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1351/2698] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:48:05.942418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a191f70-5804-4231-a33b-31ce22f82c37 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:05.952196 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a191f70-5804-4231-a33b-31ce22f82c37 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:05.956756 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f694f-7eda-49aa-9df3-3a8299aa0fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:05.957687 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f694f-7eda-49aa-9df3-3a8299aa0fa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:05.958005 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f694f-7eda-49aa-9df3-3a8299aa0fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:05.958289 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f694f-7eda-49aa-9df3-3a8299aa0fa8 admin admin] PATH_INFO: `/v3/projects/c8bf1c5de57946d08022929b3fd6b3e4/users/d1c8e62ae5834f3c941ebba1a13e3148/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:05.981255 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f694f-7eda-49aa-9df3-3a8299aa0fa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8bf1c5de57946d08022929b3fd6b3e4, user_id=d1c8e62ae5834f3c941ebba1a13e3148, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:05.984031 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f694f-7eda-49aa-9df3-3a8299aa0fa8 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:06.000182 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1348/2699] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:48:05 2022] PUT /identity/v3/projects/c8bf1c5de57946d08022929b3fd6b3e4/users/d1c8e62ae5834f3c941ebba1a13e3148/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:48:06.010981 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45df98-1345-4d02-9bc1-cdcd4ec97840 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:06.011273 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45df98-1345-4d02-9bc1-cdcd4ec97840 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:06.011551 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45df98-1345-4d02-9bc1-cdcd4ec97840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:06.038693 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-ca45df98-1345-4d02-9bc1-cdcd4ec97840 None None] MFA Rules not processed for user `d1c8e62ae5834f3c941ebba1a13e3148`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:48:06.040056 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-ca45df98-1345-4d02-9bc1-cdcd4ec97840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:06.108316 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1352/2700] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:48:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:48:06.112878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f694f-7eda-49aa-9df3-3a8299aa0fa8 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:06.186901 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f694f-7eda-49aa-9df3-3a8299aa0fa8 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:06.192440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195aa68-60d2-4165-863e-6507fc188f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:06.193215 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195aa68-60d2-4165-863e-6507fc188f37 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:06.193560 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195aa68-60d2-4165-863e-6507fc188f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:06.193941 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195aa68-60d2-4165-863e-6507fc188f37 admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:06.194724 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195aa68-60d2-4165-863e-6507fc188f37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:06.196696 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195aa68-60d2-4165-863e-6507fc188f37 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:06.226761 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1349/2701] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:48:06 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:48:06.230495 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45df98-1345-4d02-9bc1-cdcd4ec97840 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:06.243371 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45df98-1345-4d02-9bc1-cdcd4ec97840 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:06.306221 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81417b22-230b-4aba-a7d5-e8a77eadade7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:06.307057 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81417b22-230b-4aba-a7d5-e8a77eadade7 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:06.307424 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81417b22-230b-4aba-a7d5-e8a77eadade7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:06.307767 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81417b22-230b-4aba-a7d5-e8a77eadade7 admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:06.308532 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81417b22-230b-4aba-a7d5-e8a77eadade7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:06.310751 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81417b22-230b-4aba-a7d5-e8a77eadade7 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:06.336062 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1353/2702] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:48:06 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:48:06.339766 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195aa68-60d2-4165-863e-6507fc188f37 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:06.353729 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195aa68-60d2-4165-863e-6507fc188f37 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:06.363529 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a2910-53ad-41b9-ac18-d2ca2deb0a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:06.364060 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a2910-53ad-41b9-ac18-d2ca2deb0a50 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:06.364350 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a2910-53ad-41b9-ac18-d2ca2deb0a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:06.364626 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a2910-53ad-41b9-ac18-d2ca2deb0a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:06.365442 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a2910-53ad-41b9-ac18-d2ca2deb0a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:06.367062 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a2910-53ad-41b9-ac18-d2ca2deb0a50 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:06.380864 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1350/2703] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 09:48:06.384912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81417b22-230b-4aba-a7d5-e8a77eadade7 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:06.397178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81417b22-230b-4aba-a7d5-e8a77eadade7 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:06.402642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791110a1-a810-4bee-8bb7-98adff25c4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:06.403419 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791110a1-a810-4bee-8bb7-98adff25c4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:06.403796 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791110a1-a810-4bee-8bb7-98adff25c4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:06.404166 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791110a1-a810-4bee-8bb7-98adff25c4e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:06.406066 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791110a1-a810-4bee-8bb7-98adff25c4e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:06.412112 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791110a1-a810-4bee-8bb7-98adff25c4e7 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:06.424768 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1354/2704] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 09:48:06.430912 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a2910-53ad-41b9-ac18-d2ca2deb0a50 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:06.442463 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a2910-53ad-41b9-ac18-d2ca2deb0a50 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:06.447344 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae674341-4a5b-4df9-9361-84285af1cc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:06.448238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae674341-4a5b-4df9-9361-84285af1cc96 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:06.448519 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae674341-4a5b-4df9-9361-84285af1cc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:06.448964 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae674341-4a5b-4df9-9361-84285af1cc96 admin admin] PATH_INFO: `/v3/projects/d1d746cf5f1a4d00a755bd2d8f0faf27/users/16a5dd43497d498a81f877848cc981cb/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:06.469520 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae674341-4a5b-4df9-9361-84285af1cc96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d746cf5f1a4d00a755bd2d8f0faf27, user_id=16a5dd43497d498a81f877848cc981cb, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:06.472202 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae674341-4a5b-4df9-9361-84285af1cc96 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:06.487515 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1351/2705] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:48:06 2022] PUT /identity/v3/projects/d1d746cf5f1a4d00a755bd2d8f0faf27/users/16a5dd43497d498a81f877848cc981cb/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:48:06.498690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852b705-7067-4456-9a08-ec02128ed723 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:06.499115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852b705-7067-4456-9a08-ec02128ed723 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:06.499506 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852b705-7067-4456-9a08-ec02128ed723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:06.531986 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-1852b705-7067-4456-9a08-ec02128ed723 None None] MFA Rules not processed for user `16a5dd43497d498a81f877848cc981cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:48:06.533196 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-1852b705-7067-4456-9a08-ec02128ed723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:06.625051 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1355/2706] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:48:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:48:06.629945 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae674341-4a5b-4df9-9361-84285af1cc96 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:06.699629 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae674341-4a5b-4df9-9361-84285af1cc96 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:06.704855 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a70ef-27fe-4053-8ad2-8710425cc18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:06.705715 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a70ef-27fe-4053-8ad2-8710425cc18b admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:06.706236 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a70ef-27fe-4053-8ad2-8710425cc18b admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:06.706447 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a70ef-27fe-4053-8ad2-8710425cc18b admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:06.707380 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a70ef-27fe-4053-8ad2-8710425cc18b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:06.709274 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a70ef-27fe-4053-8ad2-8710425cc18b admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:06.738957 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1352/2707] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:48:06 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:48:06.742642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852b705-7067-4456-9a08-ec02128ed723 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:06.757296 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852b705-7067-4456-9a08-ec02128ed723 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:06.824860 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21514a3-ed1f-4804-8b79-91f5194b7a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:06.825560 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21514a3-ed1f-4804-8b79-91f5194b7a10 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:06.825862 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21514a3-ed1f-4804-8b79-91f5194b7a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:06.826343 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21514a3-ed1f-4804-8b79-91f5194b7a10 admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:06.827092 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21514a3-ed1f-4804-8b79-91f5194b7a10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:06.829003 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21514a3-ed1f-4804-8b79-91f5194b7a10 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:06.851913 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1356/2708] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:48:06 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:48:06.853156 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a70ef-27fe-4053-8ad2-8710425cc18b admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:06.863865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a70ef-27fe-4053-8ad2-8710425cc18b admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:06.868513 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f65d48-80f1-486b-bf5d-ccf212767715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:06.869237 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f65d48-80f1-486b-bf5d-ccf212767715 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:06.869586 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f65d48-80f1-486b-bf5d-ccf212767715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:06.869977 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f65d48-80f1-486b-bf5d-ccf212767715 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:06.870697 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f65d48-80f1-486b-bf5d-ccf212767715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:06.872303 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f65d48-80f1-486b-bf5d-ccf212767715 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:06.887342 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1353/2709] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:48:06.888379 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21514a3-ed1f-4804-8b79-91f5194b7a10 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:06.898954 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21514a3-ed1f-4804-8b79-91f5194b7a10 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:06.904282 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92acbf-962f-4677-b45e-1f9cda29f6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:06.905236 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92acbf-962f-4677-b45e-1f9cda29f6ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:06.905514 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92acbf-962f-4677-b45e-1f9cda29f6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:06.905786 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92acbf-962f-4677-b45e-1f9cda29f6ce admin admin] PATH_INFO: `/v3/projects/a0ff70871a484f5080e833e9b22962bc/users/3464dca72842499097d1a750ce4ea664/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:06.920625 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92acbf-962f-4677-b45e-1f9cda29f6ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0ff70871a484f5080e833e9b22962bc, user_id=3464dca72842499097d1a750ce4ea664, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:06.923285 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92acbf-962f-4677-b45e-1f9cda29f6ce admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:06.936653 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1357/2710] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:48:06 2022] PUT /identity/v3/projects/a0ff70871a484f5080e833e9b22962bc/users/3464dca72842499097d1a750ce4ea664/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:48:06.940781 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f65d48-80f1-486b-bf5d-ccf212767715 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:06.951668 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f65d48-80f1-486b-bf5d-ccf212767715 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:07.015858 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932c32f-9167-4856-b775-42b860af45ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:07.016585 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932c32f-9167-4856-b775-42b860af45ff admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:07.016903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932c32f-9167-4856-b775-42b860af45ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:07.017182 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932c32f-9167-4856-b775-42b860af45ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:07.017909 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932c32f-9167-4856-b775-42b860af45ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:07.019580 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932c32f-9167-4856-b775-42b860af45ff admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:07.029279 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1354/2711] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:48:07.033546 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92acbf-962f-4677-b45e-1f9cda29f6ce admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:07.048855 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92acbf-962f-4677-b45e-1f9cda29f6ce admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:07.051626 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514345c7-555a-40a1-aea5-7ddf0c899a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:07.052509 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514345c7-555a-40a1-aea5-7ddf0c899a2e admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:07.052965 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514345c7-555a-40a1-aea5-7ddf0c899a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:07.053247 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514345c7-555a-40a1-aea5-7ddf0c899a2e admin admin] PATH_INFO: `/v3/projects/a0ff70871a484f5080e833e9b22962bc/users/3464dca72842499097d1a750ce4ea664/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:07.055176 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514345c7-555a-40a1-aea5-7ddf0c899a2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0ff70871a484f5080e833e9b22962bc, user_id=3464dca72842499097d1a750ce4ea664, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:07.057814 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514345c7-555a-40a1-aea5-7ddf0c899a2e admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:07.068572 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1358/2712] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:48:07 2022] PUT /identity/v3/projects/a0ff70871a484f5080e833e9b22962bc/users/3464dca72842499097d1a750ce4ea664/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:48:07.134847 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae18e9-84b1-47b3-9728-ae13a56543c8 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:07.135144 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae18e9-84b1-47b3-9728-ae13a56543c8 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:07.135516 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae18e9-84b1-47b3-9728-ae13a56543c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:07.163047 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-c5ae18e9-84b1-47b3-9728-ae13a56543c8 None None] MFA Rules not processed for user `3464dca72842499097d1a750ce4ea664`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:48:07.164275 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-c5ae18e9-84b1-47b3-9728-ae13a56543c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:07.232687 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1355/2713] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:48:07 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:48:07.245019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514345c7-555a-40a1-aea5-7ddf0c899a2e admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:07.246855 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-514345c7-555a-40a1-aea5-7ddf0c899a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:07.318385 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514345c7-555a-40a1-aea5-7ddf0c899a2e admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:07.322071 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019da72a-1160-4d5a-bb60-68516919549b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:07.322834 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019da72a-1160-4d5a-bb60-68516919549b service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:07.323115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019da72a-1160-4d5a-bb60-68516919549b service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:07.323516 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019da72a-1160-4d5a-bb60-68516919549b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:07.332641 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019da72a-1160-4d5a-bb60-68516919549b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:07.334099 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019da72a-1160-4d5a-bb60-68516919549b service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:07.343888 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1359/2714] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:48:07 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:48:07.394902 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae18e9-84b1-47b3-9728-ae13a56543c8 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:07.396352 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-c5ae18e9-84b1-47b3-9728-ae13a56543c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:07.411017 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae18e9-84b1-47b3-9728-ae13a56543c8 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:07.414556 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b44d9a-2758-423c-aeb4-ff2cd126cb60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:07.415203 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b44d9a-2758-423c-aeb4-ff2cd126cb60 service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:07.415483 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b44d9a-2758-423c-aeb4-ff2cd126cb60 service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:07.415753 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b44d9a-2758-423c-aeb4-ff2cd126cb60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:07.473886 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b44d9a-2758-423c-aeb4-ff2cd126cb60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:07.475392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b44d9a-2758-423c-aeb4-ff2cd126cb60 service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:07.485081 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1356/2715] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:48:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:48:08.337747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab160a-7c07-44f2-a6d1-c060990200d6 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:08.338272 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab160a-7c07-44f2-a6d1-c060990200d6 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:08.338375 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab160a-7c07-44f2-a6d1-c060990200d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:08.355945 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-30ab160a-7c07-44f2-a6d1-c060990200d6 None None] MFA Rules not processed for user `f739359acd844279aa56ef7d69f4c299`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:48:08.357156 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-30ab160a-7c07-44f2-a6d1-c060990200d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:08.409688 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1360/2716] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:48:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:48:10.351937 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b44d9a-2758-423c-aeb4-ff2cd126cb60 service cinder] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:10.414304 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b44d9a-2758-423c-aeb4-ff2cd126cb60 service cinder] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:10.418949 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909560e-98cd-4fe8-a9a2-0110b28ee5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:10.419827 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909560e-98cd-4fe8-a9a2-0110b28ee5b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:10.420107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909560e-98cd-4fe8-a9a2-0110b28ee5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:10.420379 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909560e-98cd-4fe8-a9a2-0110b28ee5b1 admin admin] PATH_INFO: `/v3/users/d1c8e62ae5834f3c941ebba1a13e3148` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:10.421576 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909560e-98cd-4fe8-a9a2-0110b28ee5b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1c8e62ae5834f3c941ebba1a13e3148)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:10.423796 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909560e-98cd-4fe8-a9a2-0110b28ee5b1 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:10.471100 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-c909560e-98cd-4fe8-a9a2-0110b28ee5b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1c8e62ae5834f3c941ebba1a13e3148'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:10.483012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-c909560e-98cd-4fe8-a9a2-0110b28ee5b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1c8e62ae5834f3c941ebba1a13e3148'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:10.483687 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-c909560e-98cd-4fe8-a9a2-0110b28ee5b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1c8e62ae5834f3c941ebba1a13e3148'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:10.492499 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-c909560e-98cd-4fe8-a9a2-0110b28ee5b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1c8e62ae5834f3c941ebba1a13e3148'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:10.499455 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-c909560e-98cd-4fe8-a9a2-0110b28ee5b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1c8e62ae5834f3c941ebba1a13e3148'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:10.505196 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1357/2717] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:48:10 2022] DELETE /identity/v3/users/d1c8e62ae5834f3c941ebba1a13e3148 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:48:10.509913 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44b93e-8787-4b6d-a747-1b4b5c028336 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:10.510414 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44b93e-8787-4b6d-a747-1b4b5c028336 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:10.510510 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44b93e-8787-4b6d-a747-1b4b5c028336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:10.529046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-cf44b93e-8787-4b6d-a747-1b4b5c028336 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:48:10.530285 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-cf44b93e-8787-4b6d-a747-1b4b5c028336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:10.590798 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1361/2718] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:48:10.601512 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909560e-98cd-4fe8-a9a2-0110b28ee5b1 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:10.603013 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-c909560e-98cd-4fe8-a9a2-0110b28ee5b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:10.659834 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909560e-98cd-4fe8-a9a2-0110b28ee5b1 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:10.664746 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aee562-1dd4-4c49-bd3f-042976c63bdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:10.665390 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aee562-1dd4-4c49-bd3f-042976c63bdb service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:10.665671 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aee562-1dd4-4c49-bd3f-042976c63bdb service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:10.666004 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aee562-1dd4-4c49-bd3f-042976c63bdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:10.676244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aee562-1dd4-4c49-bd3f-042976c63bdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:10.677681 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aee562-1dd4-4c49-bd3f-042976c63bdb service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:10.688468 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1358/2719] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:48:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:48:10.973053 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44b93e-8787-4b6d-a747-1b4b5c028336 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:10.975427 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-cf44b93e-8787-4b6d-a747-1b4b5c028336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:10.990840 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44b93e-8787-4b6d-a747-1b4b5c028336 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:10.996825 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d029594-1029-417c-8eb4-128275fcef04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:10.997735 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d029594-1029-417c-8eb4-128275fcef04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:10.998058 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d029594-1029-417c-8eb4-128275fcef04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:10.998339 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d029594-1029-417c-8eb4-128275fcef04 admin admin] PATH_INFO: `/v3/projects/c8bf1c5de57946d08022929b3fd6b3e4` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:10.999510 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d029594-1029-417c-8eb4-128275fcef04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8bf1c5de57946d08022929b3fd6b3e4)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:11.001434 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d029594-1029-417c-8eb4-128275fcef04 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:11.047211 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4d029594-1029-417c-8eb4-128275fcef04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8bf1c5de57946d08022929b3fd6b3e4', 'request_id': 'req-4d029594-1029-417c-8eb4-128275fcef04'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:11.053261 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4d029594-1029-417c-8eb4-128275fcef04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8bf1c5de57946d08022929b3fd6b3e4', 'request_id': 'req-4d029594-1029-417c-8eb4-128275fcef04'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:11.060998 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4d029594-1029-417c-8eb4-128275fcef04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8bf1c5de57946d08022929b3fd6b3e4', 'request_id': 'req-4d029594-1029-417c-8eb4-128275fcef04'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:11.073622 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4d029594-1029-417c-8eb4-128275fcef04 admin admin] The token cache is being invalidate because project c8bf1c5de57946d08022929b3fd6b3e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:48:11.073929 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4d029594-1029-417c-8eb4-128275fcef04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:11.074571 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-4d029594-1029-417c-8eb4-128275fcef04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:11.076103 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1362/2720] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:48:10 2022] DELETE /identity/v3/projects/c8bf1c5de57946d08022929b3fd6b3e4 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:48:11.080101 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aee562-1dd4-4c49-bd3f-042976c63bdb service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:11.090391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aee562-1dd4-4c49-bd3f-042976c63bdb service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:11.151783 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaca0f9-9cde-4956-b26d-2180d5852af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:11.152802 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaca0f9-9cde-4956-b26d-2180d5852af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:11.153091 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaca0f9-9cde-4956-b26d-2180d5852af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:11.153367 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaca0f9-9cde-4956-b26d-2180d5852af3 admin admin] PATH_INFO: `/v3/users/16a5dd43497d498a81f877848cc981cb` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:11.154583 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaca0f9-9cde-4956-b26d-2180d5852af3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16a5dd43497d498a81f877848cc981cb)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:11.156504 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaca0f9-9cde-4956-b26d-2180d5852af3 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:11.206865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-feaca0f9-9cde-4956-b26d-2180d5852af3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16a5dd43497d498a81f877848cc981cb'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:11.219656 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-feaca0f9-9cde-4956-b26d-2180d5852af3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16a5dd43497d498a81f877848cc981cb'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:11.220403 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-feaca0f9-9cde-4956-b26d-2180d5852af3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16a5dd43497d498a81f877848cc981cb'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:11.229255 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-feaca0f9-9cde-4956-b26d-2180d5852af3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16a5dd43497d498a81f877848cc981cb'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:11.236583 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-feaca0f9-9cde-4956-b26d-2180d5852af3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16a5dd43497d498a81f877848cc981cb'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:11.244083 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1359/2721] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:48:11 2022] DELETE /identity/v3/users/16a5dd43497d498a81f877848cc981cb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:48:11.542437 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d029594-1029-417c-8eb4-128275fcef04 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:11.543949 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-4d029594-1029-417c-8eb4-128275fcef04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:11.567865 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d029594-1029-417c-8eb4-128275fcef04 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:11.639045 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105f3a6-42ef-4f8c-99bd-3aadac06eeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:11.639947 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105f3a6-42ef-4f8c-99bd-3aadac06eeff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:11.640229 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105f3a6-42ef-4f8c-99bd-3aadac06eeff admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:11.640500 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105f3a6-42ef-4f8c-99bd-3aadac06eeff admin admin] PATH_INFO: `/v3/projects/d1d746cf5f1a4d00a755bd2d8f0faf27` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:11.641702 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105f3a6-42ef-4f8c-99bd-3aadac06eeff admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1d746cf5f1a4d00a755bd2d8f0faf27)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:11.643687 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105f3a6-42ef-4f8c-99bd-3aadac06eeff admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:11.696601 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-8105f3a6-42ef-4f8c-99bd-3aadac06eeff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1d746cf5f1a4d00a755bd2d8f0faf27', 'request_id': 'req-8105f3a6-42ef-4f8c-99bd-3aadac06eeff'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:11.704258 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-8105f3a6-42ef-4f8c-99bd-3aadac06eeff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1d746cf5f1a4d00a755bd2d8f0faf27', 'request_id': 'req-8105f3a6-42ef-4f8c-99bd-3aadac06eeff'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:11.713770 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-8105f3a6-42ef-4f8c-99bd-3aadac06eeff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1d746cf5f1a4d00a755bd2d8f0faf27', 'request_id': 'req-8105f3a6-42ef-4f8c-99bd-3aadac06eeff'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:11.729260 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-8105f3a6-42ef-4f8c-99bd-3aadac06eeff admin admin] The token cache is being invalidate because project d1d746cf5f1a4d00a755bd2d8f0faf27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:48:11.729553 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-8105f3a6-42ef-4f8c-99bd-3aadac06eeff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:11.730226 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-8105f3a6-42ef-4f8c-99bd-3aadac06eeff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:11.731998 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1363/2722] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:48:11 2022] DELETE /identity/v3/projects/d1d746cf5f1a4d00a755bd2d8f0faf27 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:48:11.736087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaca0f9-9cde-4956-b26d-2180d5852af3 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:11.737563 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-feaca0f9-9cde-4956-b26d-2180d5852af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:11.750391 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaca0f9-9cde-4956-b26d-2180d5852af3 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:11.810690 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce8315-471a-4c33-911c-9062036c957d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:11.811501 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce8315-471a-4c33-911c-9062036c957d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:11.811784 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce8315-471a-4c33-911c-9062036c957d admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:11.812061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce8315-471a-4c33-911c-9062036c957d admin admin] PATH_INFO: `/v3/users/3464dca72842499097d1a750ce4ea664` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:11.813247 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce8315-471a-4c33-911c-9062036c957d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3464dca72842499097d1a750ce4ea664)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:11.815194 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce8315-471a-4c33-911c-9062036c957d admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:11.860746 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-38ce8315-471a-4c33-911c-9062036c957d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3464dca72842499097d1a750ce4ea664'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:11.872800 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-38ce8315-471a-4c33-911c-9062036c957d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3464dca72842499097d1a750ce4ea664'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:11.873474 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-38ce8315-471a-4c33-911c-9062036c957d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3464dca72842499097d1a750ce4ea664'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:11.881443 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-38ce8315-471a-4c33-911c-9062036c957d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3464dca72842499097d1a750ce4ea664'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:11.889447 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-38ce8315-471a-4c33-911c-9062036c957d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3464dca72842499097d1a750ce4ea664'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:11.895339 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1360/2723] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:48:11 2022] DELETE /identity/v3/users/3464dca72842499097d1a750ce4ea664 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:48:12.164868 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105f3a6-42ef-4f8c-99bd-3aadac06eeff admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:12.166339 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-8105f3a6-42ef-4f8c-99bd-3aadac06eeff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:12.181346 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105f3a6-42ef-4f8c-99bd-3aadac06eeff admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:12.236367 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81b93f-89e5-4199-8ad5-434ea24bc7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:12.237217 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81b93f-89e5-4199-8ad5-434ea24bc7b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:12.237495 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81b93f-89e5-4199-8ad5-434ea24bc7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:12.237768 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81b93f-89e5-4199-8ad5-434ea24bc7b9 admin admin] PATH_INFO: `/v3/projects/a0ff70871a484f5080e833e9b22962bc` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:12.239514 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81b93f-89e5-4199-8ad5-434ea24bc7b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0ff70871a484f5080e833e9b22962bc)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:12.241385 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81b93f-89e5-4199-8ad5-434ea24bc7b9 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:12.284451 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-dd81b93f-89e5-4199-8ad5-434ea24bc7b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0ff70871a484f5080e833e9b22962bc', 'request_id': 'req-dd81b93f-89e5-4199-8ad5-434ea24bc7b9'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:12.290265 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-dd81b93f-89e5-4199-8ad5-434ea24bc7b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0ff70871a484f5080e833e9b22962bc', 'request_id': 'req-dd81b93f-89e5-4199-8ad5-434ea24bc7b9'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:12.297299 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-dd81b93f-89e5-4199-8ad5-434ea24bc7b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0ff70871a484f5080e833e9b22962bc', 'request_id': 'req-dd81b93f-89e5-4199-8ad5-434ea24bc7b9'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:12.309267 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-dd81b93f-89e5-4199-8ad5-434ea24bc7b9 admin admin] The token cache is being invalidate because project a0ff70871a484f5080e833e9b22962bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:48:12.309547 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-dd81b93f-89e5-4199-8ad5-434ea24bc7b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:12.310445 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-dd81b93f-89e5-4199-8ad5-434ea24bc7b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:12.311993 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1364/2724] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:48:12 2022] DELETE /identity/v3/projects/a0ff70871a484f5080e833e9b22962bc => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:48:12.317890 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62816224-fd34-49ad-b947-45c279b7bb96 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:12.318201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62816224-fd34-49ad-b947-45c279b7bb96 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:12.318473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62816224-fd34-49ad-b947-45c279b7bb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:12.336532 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-62816224-fd34-49ad-b947-45c279b7bb96 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:48:12.337758 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-62816224-fd34-49ad-b947-45c279b7bb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:12.398886 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1361/2725] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:48:12.406990 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c4eb5-a992-40b9-947d-2c5c1f1be79d None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:12.407284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c4eb5-a992-40b9-947d-2c5c1f1be79d None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:12.407565 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c4eb5-a992-40b9-947d-2c5c1f1be79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:12.426334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-303c4eb5-a992-40b9-947d-2c5c1f1be79d None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:48:12.427516 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-303c4eb5-a992-40b9-947d-2c5c1f1be79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:12.435322 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1365/2726] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:48:12.439792 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62816224-fd34-49ad-b947-45c279b7bb96 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:12.449395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62816224-fd34-49ad-b947-45c279b7bb96 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:12.454139 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e78d26-b08a-4207-a5d0-fb7d30da99e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:12.454792 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e78d26-b08a-4207-a5d0-fb7d30da99e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:12.455068 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e78d26-b08a-4207-a5d0-fb7d30da99e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:12.455336 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e78d26-b08a-4207-a5d0-fb7d30da99e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:12.456054 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e78d26-b08a-4207-a5d0-fb7d30da99e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:48:12.456358 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e78d26-b08a-4207-a5d0-fb7d30da99e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:12.458027 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e78d26-b08a-4207-a5d0-fb7d30da99e0 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:12.469332 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1362/2727] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:48:12.474568 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c4eb5-a992-40b9-947d-2c5c1f1be79d None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:12.483903 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c4eb5-a992-40b9-947d-2c5c1f1be79d None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:12.489336 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aad5e6-108d-48f6-8419-3a86d6826ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:12.490027 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aad5e6-108d-48f6-8419-3a86d6826ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:12.490313 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aad5e6-108d-48f6-8419-3a86d6826ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:12.490588 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aad5e6-108d-48f6-8419-3a86d6826ec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:12.491312 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aad5e6-108d-48f6-8419-3a86d6826ec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:12.493212 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aad5e6-108d-48f6-8419-3a86d6826ec5 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:12.518953 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1366/2728] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:48:12 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:48:12.523223 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e78d26-b08a-4207-a5d0-fb7d30da99e0 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:12.533101 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e78d26-b08a-4207-a5d0-fb7d30da99e0 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:12.588424 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d4dc6-6082-45cb-8b17-de21c03d9217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:12.589032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d4dc6-6082-45cb-8b17-de21c03d9217 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:12.589319 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d4dc6-6082-45cb-8b17-de21c03d9217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:12.589611 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d4dc6-6082-45cb-8b17-de21c03d9217 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:12.590341 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d4dc6-6082-45cb-8b17-de21c03d9217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:12.592227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d4dc6-6082-45cb-8b17-de21c03d9217 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:12.611832 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1363/2729] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:48:12 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:48:12.616612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aad5e6-108d-48f6-8419-3a86d6826ec5 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:12.627140 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aad5e6-108d-48f6-8419-3a86d6826ec5 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:12.631737 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228e34a-c673-410d-b7d1-3ac644148408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:12.632389 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228e34a-c673-410d-b7d1-3ac644148408 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:12.632670 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228e34a-c673-410d-b7d1-3ac644148408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:12.632942 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228e34a-c673-410d-b7d1-3ac644148408 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:12.633655 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228e34a-c673-410d-b7d1-3ac644148408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:12.635267 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228e34a-c673-410d-b7d1-3ac644148408 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:12.646343 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1367/2730] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:48:12.650171 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d4dc6-6082-45cb-8b17-de21c03d9217 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:12.659933 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d4dc6-6082-45cb-8b17-de21c03d9217 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:12.665227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9202d-c268-41af-bd80-0ff691e665cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:12.665876 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9202d-c268-41af-bd80-0ff691e665cc admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:12.666184 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9202d-c268-41af-bd80-0ff691e665cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:12.666457 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9202d-c268-41af-bd80-0ff691e665cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:12.667169 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9202d-c268-41af-bd80-0ff691e665cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:12.668741 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9202d-c268-41af-bd80-0ff691e665cc admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:12.680825 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1364/2731] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:48:12.684810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228e34a-c673-410d-b7d1-3ac644148408 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:12.694621 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228e34a-c673-410d-b7d1-3ac644148408 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:12.699123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05194b7a-0f1b-410e-a5d8-9f5a5150baba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:12.699988 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05194b7a-0f1b-410e-a5d8-9f5a5150baba admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:12.700266 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05194b7a-0f1b-410e-a5d8-9f5a5150baba admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:12.700537 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05194b7a-0f1b-410e-a5d8-9f5a5150baba admin admin] PATH_INFO: `/v3/projects/a55212104d024a66be6039ca367051b6/users/51b4f0b48e6f48118d6e5a79f4502bdf/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:12.715951 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05194b7a-0f1b-410e-a5d8-9f5a5150baba admin admin] RBAC: Authorizing `identity:create_grant(project_id=a55212104d024a66be6039ca367051b6, user_id=51b4f0b48e6f48118d6e5a79f4502bdf, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:12.718639 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05194b7a-0f1b-410e-a5d8-9f5a5150baba admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:12.731937 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1368/2732] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:48:12 2022] PUT /identity/v3/projects/a55212104d024a66be6039ca367051b6/users/51b4f0b48e6f48118d6e5a79f4502bdf/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:48:12.742978 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ece96a-d3ef-40c0-ae30-ffeda89e3eda None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:12.743462 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ece96a-d3ef-40c0-ae30-ffeda89e3eda None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:12.743592 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ece96a-d3ef-40c0-ae30-ffeda89e3eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:12.770062 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-92ece96a-d3ef-40c0-ae30-ffeda89e3eda None None] MFA Rules not processed for user `51b4f0b48e6f48118d6e5a79f4502bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:48:12.771255 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-92ece96a-d3ef-40c0-ae30-ffeda89e3eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:12.831369 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1365/2733] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:48:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:48:12.836306 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05194b7a-0f1b-410e-a5d8-9f5a5150baba admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:12.895285 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05194b7a-0f1b-410e-a5d8-9f5a5150baba admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:12.899843 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28445972-2a50-4b12-9e96-5486eabdea97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:12.900485 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28445972-2a50-4b12-9e96-5486eabdea97 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:12.900767 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28445972-2a50-4b12-9e96-5486eabdea97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:12.901043 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28445972-2a50-4b12-9e96-5486eabdea97 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:12.901744 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28445972-2a50-4b12-9e96-5486eabdea97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:12.903662 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28445972-2a50-4b12-9e96-5486eabdea97 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:12.928087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1369/2734] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:48:12 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:48:12.932043 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ece96a-d3ef-40c0-ae30-ffeda89e3eda None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:12.942413 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ece96a-d3ef-40c0-ae30-ffeda89e3eda None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:12.996600 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71bcc9-1b7c-48b6-8973-bde18c08de32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:12.997272 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71bcc9-1b7c-48b6-8973-bde18c08de32 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:12.997567 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71bcc9-1b7c-48b6-8973-bde18c08de32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:12.997862 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71bcc9-1b7c-48b6-8973-bde18c08de32 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:12.998632 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be71bcc9-1b7c-48b6-8973-bde18c08de32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:13.000525 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be71bcc9-1b7c-48b6-8973-bde18c08de32 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:13.020298 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1366/2735] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:48:12 2022] POST /identity/v3/users => generated 299 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:48:13.024385 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28445972-2a50-4b12-9e96-5486eabdea97 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:13.034414 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28445972-2a50-4b12-9e96-5486eabdea97 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:13.039542 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c25f5-ff76-4a41-8e65-1b2aa57a1d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:13.040189 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c25f5-ff76-4a41-8e65-1b2aa57a1d8f admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:13.040474 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c25f5-ff76-4a41-8e65-1b2aa57a1d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:13.040750 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c25f5-ff76-4a41-8e65-1b2aa57a1d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:13.041471 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c25f5-ff76-4a41-8e65-1b2aa57a1d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:13.043094 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c25f5-ff76-4a41-8e65-1b2aa57a1d8f admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:13.053776 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1370/2736] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:48:13.057696 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71bcc9-1b7c-48b6-8973-bde18c08de32 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:13.067384 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71bcc9-1b7c-48b6-8973-bde18c08de32 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:13.071929 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abad356-f6b2-4f42-ab3b-fd201badb1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:13.072791 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abad356-f6b2-4f42-ab3b-fd201badb1af admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:13.073073 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abad356-f6b2-4f42-ab3b-fd201badb1af admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:13.073345 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abad356-f6b2-4f42-ab3b-fd201badb1af admin admin] PATH_INFO: `/v3/projects/9721767fc36c4f5ca3fc6c826b877fe7/users/9c6abae4c6984612ae0fb80e0689f7fb/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:13.087205 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abad356-f6b2-4f42-ab3b-fd201badb1af admin admin] RBAC: Authorizing `identity:create_grant(project_id=9721767fc36c4f5ca3fc6c826b877fe7, user_id=9c6abae4c6984612ae0fb80e0689f7fb, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:13.089810 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abad356-f6b2-4f42-ab3b-fd201badb1af admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:13.109327 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1367/2737] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:48:13 2022] PUT /identity/v3/projects/9721767fc36c4f5ca3fc6c826b877fe7/users/9c6abae4c6984612ae0fb80e0689f7fb/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:48:13.113227 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c25f5-ff76-4a41-8e65-1b2aa57a1d8f admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:13.123642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c25f5-ff76-4a41-8e65-1b2aa57a1d8f admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:13.177721 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede66333-55b6-4881-9f5a-a4a7e6cb1883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:13.178321 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede66333-55b6-4881-9f5a-a4a7e6cb1883 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:13.178598 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede66333-55b6-4881-9f5a-a4a7e6cb1883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:13.178864 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede66333-55b6-4881-9f5a-a4a7e6cb1883 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:13.179600 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede66333-55b6-4881-9f5a-a4a7e6cb1883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:13.181143 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede66333-55b6-4881-9f5a-a4a7e6cb1883 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:13.190441 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1371/2738] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:48:13.194636 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abad356-f6b2-4f42-ab3b-fd201badb1af admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:13.204565 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abad356-f6b2-4f42-ab3b-fd201badb1af admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:13.209140 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eaff76-2892-439b-8516-44601756dc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:13.210037 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaff76-2892-439b-8516-44601756dc7b admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:13.210316 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaff76-2892-439b-8516-44601756dc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:13.210664 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaff76-2892-439b-8516-44601756dc7b admin admin] PATH_INFO: `/v3/projects/9721767fc36c4f5ca3fc6c826b877fe7/users/9c6abae4c6984612ae0fb80e0689f7fb/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:13.212606 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eaff76-2892-439b-8516-44601756dc7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9721767fc36c4f5ca3fc6c826b877fe7, user_id=9c6abae4c6984612ae0fb80e0689f7fb, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:13.215267 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eaff76-2892-439b-8516-44601756dc7b admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:13.225390 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1368/2739] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:48:13 2022] PUT /identity/v3/projects/9721767fc36c4f5ca3fc6c826b877fe7/users/9c6abae4c6984612ae0fb80e0689f7fb/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:48:13.236364 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd925d76-5a82-40d8-bb22-4783fbb4ab12 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:13.236651 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd925d76-5a82-40d8-bb22-4783fbb4ab12 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:13.236921 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd925d76-5a82-40d8-bb22-4783fbb4ab12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:13.262366 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-fd925d76-5a82-40d8-bb22-4783fbb4ab12 None None] MFA Rules not processed for user `9c6abae4c6984612ae0fb80e0689f7fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:48:13.263849 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-fd925d76-5a82-40d8-bb22-4783fbb4ab12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:13.327548 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1372/2740] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:48:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:48:13.338764 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eaff76-2892-439b-8516-44601756dc7b admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:13.340429 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-00eaff76-2892-439b-8516-44601756dc7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:13.396262 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eaff76-2892-439b-8516-44601756dc7b admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:13.399870 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6005af-8569-4607-94f1-51a25e1494a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:13.400505 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6005af-8569-4607-94f1-51a25e1494a3 service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:13.400783 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6005af-8569-4607-94f1-51a25e1494a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:13.401053 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6005af-8569-4607-94f1-51a25e1494a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:13.453104 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6005af-8569-4607-94f1-51a25e1494a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:13.454479 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6005af-8569-4607-94f1-51a25e1494a3 service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:13.462967 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1369/2741] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:48:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:48:17.580343 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd925d76-5a82-40d8-bb22-4783fbb4ab12 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:17.581972 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-fd925d76-5a82-40d8-bb22-4783fbb4ab12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:17.593700 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd925d76-5a82-40d8-bb22-4783fbb4ab12 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:17.597252 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd6248-9295-46d6-8959-a0d89680920f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:17.598456 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd6248-9295-46d6-8959-a0d89680920f service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:17.598732 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd6248-9295-46d6-8959-a0d89680920f service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:17.599002 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd6248-9295-46d6-8959-a0d89680920f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:17.608064 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd6248-9295-46d6-8959-a0d89680920f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:17.609479 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd6248-9295-46d6-8959-a0d89680920f service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:17.619640 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1373/2742] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:48:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:48:19.454203 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6005af-8569-4607-94f1-51a25e1494a3 service cinder] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:19.455671 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-8f6005af-8569-4607-94f1-51a25e1494a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:19.532823 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6005af-8569-4607-94f1-51a25e1494a3 service cinder] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:19.538973 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b4f60-99ea-4bfd-ad91-11c9faa4aa80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:19.539727 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b4f60-99ea-4bfd-ad91-11c9faa4aa80 service nova] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:19.540108 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b4f60-99ea-4bfd-ad91-11c9faa4aa80 service nova] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:19.540396 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b4f60-99ea-4bfd-ad91-11c9faa4aa80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:19.542368 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-864b4f60-99ea-4bfd-ad91-11c9faa4aa80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:19.599963 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b4f60-99ea-4bfd-ad91-11c9faa4aa80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:19.601537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b4f60-99ea-4bfd-ad91-11c9faa4aa80 service nova] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:19.610316 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1370/2743] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:48:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:48:22.470651 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd6248-9295-46d6-8959-a0d89680920f service cinder] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:22.529785 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd6248-9295-46d6-8959-a0d89680920f service cinder] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:22.534304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d0b9e-3d68-402b-8f4b-379d6182c44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:22.535213 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d0b9e-3d68-402b-8f4b-379d6182c44c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:22.535497 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d0b9e-3d68-402b-8f4b-379d6182c44c admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:22.535772 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d0b9e-3d68-402b-8f4b-379d6182c44c admin admin] PATH_INFO: `/v3/users/51b4f0b48e6f48118d6e5a79f4502bdf` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:22.536948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d0b9e-3d68-402b-8f4b-379d6182c44c admin admin] RBAC: Authorizing `identity:delete_user(user_id=51b4f0b48e6f48118d6e5a79f4502bdf)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:22.538872 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d0b9e-3d68-402b-8f4b-379d6182c44c admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:22.582531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-332d0b9e-3d68-402b-8f4b-379d6182c44c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51b4f0b48e6f48118d6e5a79f4502bdf'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:22.593530 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-332d0b9e-3d68-402b-8f4b-379d6182c44c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51b4f0b48e6f48118d6e5a79f4502bdf'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:22.594190 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-332d0b9e-3d68-402b-8f4b-379d6182c44c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51b4f0b48e6f48118d6e5a79f4502bdf'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:22.600630 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-332d0b9e-3d68-402b-8f4b-379d6182c44c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51b4f0b48e6f48118d6e5a79f4502bdf'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:22.607135 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-332d0b9e-3d68-402b-8f4b-379d6182c44c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51b4f0b48e6f48118d6e5a79f4502bdf'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:22.612780 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1374/2744] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:48:22 2022] DELETE /identity/v3/users/51b4f0b48e6f48118d6e5a79f4502bdf => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:48:22.617838 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa0947-0778-4067-8fb0-319a9d640124 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:22.618370 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa0947-0778-4067-8fb0-319a9d640124 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:22.618471 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa0947-0778-4067-8fb0-319a9d640124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:22.635952 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-30fa0947-0778-4067-8fb0-319a9d640124 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:48:22.637125 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-30fa0947-0778-4067-8fb0-319a9d640124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:22.693121 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1371/2745] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:48:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:48:22.702463 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d0b9e-3d68-402b-8f4b-379d6182c44c admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:22.703838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-332d0b9e-3d68-402b-8f4b-379d6182c44c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:22.761446 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d0b9e-3d68-402b-8f4b-379d6182c44c admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:22.765290 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851e8bf-1230-4b93-9462-ec16f9aae41d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:22.766017 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851e8bf-1230-4b93-9462-ec16f9aae41d service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:22.766304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851e8bf-1230-4b93-9462-ec16f9aae41d service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:22.766579 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851e8bf-1230-4b93-9462-ec16f9aae41d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:22.775442 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851e8bf-1230-4b93-9462-ec16f9aae41d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:22.776861 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851e8bf-1230-4b93-9462-ec16f9aae41d service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:22.786717 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1375/2746] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:48:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:48:23.038577 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa0947-0778-4067-8fb0-319a9d640124 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:23.040066 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-30fa0947-0778-4067-8fb0-319a9d640124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:23.052021 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa0947-0778-4067-8fb0-319a9d640124 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:23.057011 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1d85d-39e4-48d7-bb6c-cdcdaa1ff6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:23.058018 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1d85d-39e4-48d7-bb6c-cdcdaa1ff6dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:23.058376 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1d85d-39e4-48d7-bb6c-cdcdaa1ff6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:23.058723 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1d85d-39e4-48d7-bb6c-cdcdaa1ff6dc admin admin] PATH_INFO: `/v3/projects/a55212104d024a66be6039ca367051b6` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:23.060096 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff1d85d-39e4-48d7-bb6c-cdcdaa1ff6dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a55212104d024a66be6039ca367051b6)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:23.062060 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff1d85d-39e4-48d7-bb6c-cdcdaa1ff6dc admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:23.111824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-7ff1d85d-39e4-48d7-bb6c-cdcdaa1ff6dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a55212104d024a66be6039ca367051b6', 'request_id': 'req-7ff1d85d-39e4-48d7-bb6c-cdcdaa1ff6dc'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:23.117963 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-7ff1d85d-39e4-48d7-bb6c-cdcdaa1ff6dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a55212104d024a66be6039ca367051b6', 'request_id': 'req-7ff1d85d-39e4-48d7-bb6c-cdcdaa1ff6dc'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:23.125061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-7ff1d85d-39e4-48d7-bb6c-cdcdaa1ff6dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a55212104d024a66be6039ca367051b6', 'request_id': 'req-7ff1d85d-39e4-48d7-bb6c-cdcdaa1ff6dc'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:23.137080 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-7ff1d85d-39e4-48d7-bb6c-cdcdaa1ff6dc admin admin] The token cache is being invalidate because project a55212104d024a66be6039ca367051b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:48:23.137356 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-7ff1d85d-39e4-48d7-bb6c-cdcdaa1ff6dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:23.137991 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-7ff1d85d-39e4-48d7-bb6c-cdcdaa1ff6dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:23.139778 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1372/2747] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:48:23 2022] DELETE /identity/v3/projects/a55212104d024a66be6039ca367051b6 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:48:23.143718 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851e8bf-1230-4b93-9462-ec16f9aae41d service neutron] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:23.153123 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851e8bf-1230-4b93-9462-ec16f9aae41d service neutron] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:23.206745 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23382db6-79cf-4cb2-bd5a-2dd0afca79ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:23.207608 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23382db6-79cf-4cb2-bd5a-2dd0afca79ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:23.207891 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23382db6-79cf-4cb2-bd5a-2dd0afca79ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:23.208163 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23382db6-79cf-4cb2-bd5a-2dd0afca79ea admin admin] PATH_INFO: `/v3/users/9c6abae4c6984612ae0fb80e0689f7fb` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:23.209333 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23382db6-79cf-4cb2-bd5a-2dd0afca79ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c6abae4c6984612ae0fb80e0689f7fb)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:23.211269 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23382db6-79cf-4cb2-bd5a-2dd0afca79ea admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:23.254492 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-23382db6-79cf-4cb2-bd5a-2dd0afca79ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c6abae4c6984612ae0fb80e0689f7fb'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:23.265961 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-23382db6-79cf-4cb2-bd5a-2dd0afca79ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c6abae4c6984612ae0fb80e0689f7fb'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:23.266599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-23382db6-79cf-4cb2-bd5a-2dd0afca79ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c6abae4c6984612ae0fb80e0689f7fb'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:23.273788 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-23382db6-79cf-4cb2-bd5a-2dd0afca79ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c6abae4c6984612ae0fb80e0689f7fb'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:23.280332 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-23382db6-79cf-4cb2-bd5a-2dd0afca79ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c6abae4c6984612ae0fb80e0689f7fb'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:23.286080 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1376/2748] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:48:23 2022] DELETE /identity/v3/users/9c6abae4c6984612ae0fb80e0689f7fb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:48:23.536603 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1d85d-39e4-48d7-bb6c-cdcdaa1ff6dc admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:23.538141 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-7ff1d85d-39e4-48d7-bb6c-cdcdaa1ff6dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:23.551274 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1d85d-39e4-48d7-bb6c-cdcdaa1ff6dc admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:23.605099 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256a1ce-b8e9-4446-8032-62c241a80412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:23.605995 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256a1ce-b8e9-4446-8032-62c241a80412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:23.606275 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256a1ce-b8e9-4446-8032-62c241a80412 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:23.606543 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256a1ce-b8e9-4446-8032-62c241a80412 admin admin] PATH_INFO: `/v3/projects/9721767fc36c4f5ca3fc6c826b877fe7` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:23.607735 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256a1ce-b8e9-4446-8032-62c241a80412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9721767fc36c4f5ca3fc6c826b877fe7)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:23.609621 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256a1ce-b8e9-4446-8032-62c241a80412 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:23.654794 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-1256a1ce-b8e9-4446-8032-62c241a80412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9721767fc36c4f5ca3fc6c826b877fe7', 'request_id': 'req-1256a1ce-b8e9-4446-8032-62c241a80412'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:23.660498 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-1256a1ce-b8e9-4446-8032-62c241a80412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9721767fc36c4f5ca3fc6c826b877fe7', 'request_id': 'req-1256a1ce-b8e9-4446-8032-62c241a80412'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:23.667568 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-1256a1ce-b8e9-4446-8032-62c241a80412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9721767fc36c4f5ca3fc6c826b877fe7', 'request_id': 'req-1256a1ce-b8e9-4446-8032-62c241a80412'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:23.678950 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-1256a1ce-b8e9-4446-8032-62c241a80412 admin admin] The token cache is being invalidate because project 9721767fc36c4f5ca3fc6c826b877fe7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:48:23.679232 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-1256a1ce-b8e9-4446-8032-62c241a80412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:23.679852 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-1256a1ce-b8e9-4446-8032-62c241a80412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:48:23.681365 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1373/2749] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:48:23 2022] DELETE /identity/v3/projects/9721767fc36c4f5ca3fc6c826b877fe7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:48:23.687438 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f62e7-0fce-4b01-8992-349a3361a45c None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:23.687907 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f62e7-0fce-4b01-8992-349a3361a45c None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:23.688019 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f62e7-0fce-4b01-8992-349a3361a45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:23.705503 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-c12f62e7-0fce-4b01-8992-349a3361a45c None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:48:23.706729 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-c12f62e7-0fce-4b01-8992-349a3361a45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:23.764435 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1377/2750] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:48:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:48:23.773315 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18e6fe-2e4f-45b6-a2ad-8f8b8c9fd07a None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:23.773601 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18e6fe-2e4f-45b6-a2ad-8f8b8c9fd07a None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:23.773873 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18e6fe-2e4f-45b6-a2ad-8f8b8c9fd07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:23.791429 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-eb18e6fe-2e4f-45b6-a2ad-8f8b8c9fd07a None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:48:23.792527 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-eb18e6fe-2e4f-45b6-a2ad-8f8b8c9fd07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:23.800196 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1374/2751] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:48:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:48:23.804129 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f62e7-0fce-4b01-8992-349a3361a45c None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:23.813505 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f62e7-0fce-4b01-8992-349a3361a45c None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:23.818567 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8990bf-d1c8-4d99-9489-680ffc5ee7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:23.819208 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8990bf-d1c8-4d99-9489-680ffc5ee7fd admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:23.819489 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8990bf-d1c8-4d99-9489-680ffc5ee7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:23.819764 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8990bf-d1c8-4d99-9489-680ffc5ee7fd admin admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:23.820484 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8990bf-d1c8-4d99-9489-680ffc5ee7fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:48:23.820785 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8990bf-d1c8-4d99-9489-680ffc5ee7fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:23.822461 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8990bf-d1c8-4d99-9489-680ffc5ee7fd admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:23.834098 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1378/2752] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:48:23.838365 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18e6fe-2e4f-45b6-a2ad-8f8b8c9fd07a None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:23.847212 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18e6fe-2e4f-45b6-a2ad-8f8b8c9fd07a None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:23.851812 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914db21-08bf-4ea2-a55b-53f56e17cef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:23.852451 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914db21-08bf-4ea2-a55b-53f56e17cef3 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:23.852732 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914db21-08bf-4ea2-a55b-53f56e17cef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:23.853005 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914db21-08bf-4ea2-a55b-53f56e17cef3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:23.853691 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914db21-08bf-4ea2-a55b-53f56e17cef3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:23.855636 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914db21-08bf-4ea2-a55b-53f56e17cef3 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:23.881388 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1375/2753] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:48:23 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:48:23.885259 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8990bf-d1c8-4d99-9489-680ffc5ee7fd admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:23.895332 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8990bf-d1c8-4d99-9489-680ffc5ee7fd admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:23.948825 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c0ba3-3a0c-4556-b88c-e9d3dcb4d240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:23.949474 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c0ba3-3a0c-4556-b88c-e9d3dcb4d240 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:23.949755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c0ba3-3a0c-4556-b88c-e9d3dcb4d240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:23.950068 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c0ba3-3a0c-4556-b88c-e9d3dcb4d240 admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:23.950754 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c0ba3-3a0c-4556-b88c-e9d3dcb4d240 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:23.952648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c0ba3-3a0c-4556-b88c-e9d3dcb4d240 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:23.971101 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1379/2754] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:48:23 2022] POST /identity/v3/users => generated 290 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:48:23.975050 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914db21-08bf-4ea2-a55b-53f56e17cef3 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:23.985127 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914db21-08bf-4ea2-a55b-53f56e17cef3 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:23.990233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80db6f6-ed46-4e5e-9e21-571401a1c1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:23.990887 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80db6f6-ed46-4e5e-9e21-571401a1c1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:23.991172 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80db6f6-ed46-4e5e-9e21-571401a1c1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:23.991445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80db6f6-ed46-4e5e-9e21-571401a1c1d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:23.992162 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80db6f6-ed46-4e5e-9e21-571401a1c1d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:23.993729 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80db6f6-ed46-4e5e-9e21-571401a1c1d8 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:24.004410 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1376/2755] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:48:24.007881 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c0ba3-3a0c-4556-b88c-e9d3dcb4d240 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:24.017793 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c0ba3-3a0c-4556-b88c-e9d3dcb4d240 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:24.022427 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6981e0-6cfd-4f46-9943-915d2cdd9f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:24.023070 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6981e0-6cfd-4f46-9943-915d2cdd9f14 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:24.023354 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6981e0-6cfd-4f46-9943-915d2cdd9f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:24.023629 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6981e0-6cfd-4f46-9943-915d2cdd9f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:24.024361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6981e0-6cfd-4f46-9943-915d2cdd9f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:24.025940 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6981e0-6cfd-4f46-9943-915d2cdd9f14 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:24.035473 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1380/2756] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:48:24.039240 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80db6f6-ed46-4e5e-9e21-571401a1c1d8 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:24.048826 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80db6f6-ed46-4e5e-9e21-571401a1c1d8 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:24.053845 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38eeba-be12-4871-85dd-855bda43defc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:24.054741 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38eeba-be12-4871-85dd-855bda43defc admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:24.055020 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38eeba-be12-4871-85dd-855bda43defc admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:24.055290 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38eeba-be12-4871-85dd-855bda43defc admin admin] PATH_INFO: `/v3/projects/6e6bc2241970493783de557e3f690105/users/06be00f6a9ad465195c7606883b4160d/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:24.069821 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38eeba-be12-4871-85dd-855bda43defc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e6bc2241970493783de557e3f690105, user_id=06be00f6a9ad465195c7606883b4160d, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:24.072483 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38eeba-be12-4871-85dd-855bda43defc admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:24.085802 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1377/2757] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:48:24 2022] PUT /identity/v3/projects/6e6bc2241970493783de557e3f690105/users/06be00f6a9ad465195c7606883b4160d/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:48:24.090838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f4582-b5f1-4e08-9868-57dd68ae232c None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:24.091126 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f4582-b5f1-4e08-9868-57dd68ae232c None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:24.091397 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f4582-b5f1-4e08-9868-57dd68ae232c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:24.110178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-839f4582-b5f1-4e08-9868-57dd68ae232c None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:48:24.111850 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-839f4582-b5f1-4e08-9868-57dd68ae232c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:24.168735 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1381/2758] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:48:24.178356 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38eeba-be12-4871-85dd-855bda43defc admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:24.180020 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-ea38eeba-be12-4871-85dd-855bda43defc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:24.242877 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38eeba-be12-4871-85dd-855bda43defc admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:24.246518 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c3e30-dc77-4241-b3e7-e94d3055e6ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:24.247163 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c3e30-dc77-4241-b3e7-e94d3055e6ce service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:24.247444 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c3e30-dc77-4241-b3e7-e94d3055e6ce service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:24.247718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c3e30-dc77-4241-b3e7-e94d3055e6ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:24.256855 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c3e30-dc77-4241-b3e7-e94d3055e6ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:24.258312 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c3e30-dc77-4241-b3e7-e94d3055e6ce service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:24.267694 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1378/2759] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:48:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:48:28.235810 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d4baa-1b1e-48e4-81d5-0a6244000be5 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:28.236378 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d4baa-1b1e-48e4-81d5-0a6244000be5 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:28.236378 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d4baa-1b1e-48e4-81d5-0a6244000be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:28.270283 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-371d4baa-1b1e-48e4-81d5-0a6244000be5 None None] MFA Rules not processed for user `06be00f6a9ad465195c7606883b4160d`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:48:28.271570 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-371d4baa-1b1e-48e4-81d5-0a6244000be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:28.341205 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1382/2760] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:48:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:48:28.345820 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c3e30-dc77-4241-b3e7-e94d3055e6ce service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:28.355851 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c3e30-dc77-4241-b3e7-e94d3055e6ce service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:28.360642 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19302a-56f9-4356-8401-e6006ea0b749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:28.361305 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19302a-56f9-4356-8401-e6006ea0b749 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:28.361591 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19302a-56f9-4356-8401-e6006ea0b749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:28.361871 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19302a-56f9-4356-8401-e6006ea0b749 admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:28.362622 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19302a-56f9-4356-8401-e6006ea0b749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:28.365132 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19302a-56f9-4356-8401-e6006ea0b749 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:28.392192 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1379/2761] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:48:28 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:48:28.396324 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d4baa-1b1e-48e4-81d5-0a6244000be5 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:28.407714 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d4baa-1b1e-48e4-81d5-0a6244000be5 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:28.464715 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566191aa-3514-4ac4-a138-a5616cc34ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:28.465561 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566191aa-3514-4ac4-a138-a5616cc34ead admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:28.465972 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566191aa-3514-4ac4-a138-a5616cc34ead admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:28.466348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566191aa-3514-4ac4-a138-a5616cc34ead admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:28.467055 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566191aa-3514-4ac4-a138-a5616cc34ead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:28.469024 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566191aa-3514-4ac4-a138-a5616cc34ead admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:28.491114 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1383/2762] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:48:28 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:48:28.495012 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19302a-56f9-4356-8401-e6006ea0b749 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:28.506034 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19302a-56f9-4356-8401-e6006ea0b749 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:28.511350 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65080292-a37c-44cd-80c4-c88e4ec925d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:28.512214 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65080292-a37c-44cd-80c4-c88e4ec925d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:28.512567 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65080292-a37c-44cd-80c4-c88e4ec925d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:28.512909 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65080292-a37c-44cd-80c4-c88e4ec925d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:28.513718 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65080292-a37c-44cd-80c4-c88e4ec925d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:28.515816 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65080292-a37c-44cd-80c4-c88e4ec925d2 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:28.527190 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1380/2763] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:48:28.531392 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566191aa-3514-4ac4-a138-a5616cc34ead admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:28.542490 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566191aa-3514-4ac4-a138-a5616cc34ead admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:28.548241 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a6755-180e-4f16-9a21-346b5de1ecf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:28.549146 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a6755-180e-4f16-9a21-346b5de1ecf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:28.549431 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a6755-180e-4f16-9a21-346b5de1ecf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:28.549704 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a6755-180e-4f16-9a21-346b5de1ecf0 admin admin] PATH_INFO: `/v3/projects/9629328eaaa04625b255cc18636c449b/users/21c163dfac4d47fb8c65ff2f2136e92b/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:28.565891 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a6755-180e-4f16-9a21-346b5de1ecf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9629328eaaa04625b255cc18636c449b, user_id=21c163dfac4d47fb8c65ff2f2136e92b, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:28.569449 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a6755-180e-4f16-9a21-346b5de1ecf0 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:28.583467 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1384/2764] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:48:28 2022] PUT /identity/v3/projects/9629328eaaa04625b255cc18636c449b/users/21c163dfac4d47fb8c65ff2f2136e92b/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:48:28.587500 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65080292-a37c-44cd-80c4-c88e4ec925d2 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:28.598049 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65080292-a37c-44cd-80c4-c88e4ec925d2 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:28.651841 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291d0ee-38c1-4e3d-9f52-66e0f995d668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:28.652517 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291d0ee-38c1-4e3d-9f52-66e0f995d668 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:28.652801 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291d0ee-38c1-4e3d-9f52-66e0f995d668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:28.653079 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291d0ee-38c1-4e3d-9f52-66e0f995d668 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:28.653799 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291d0ee-38c1-4e3d-9f52-66e0f995d668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:28.655460 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291d0ee-38c1-4e3d-9f52-66e0f995d668 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:28.665595 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1381/2765] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:48:28.669620 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a6755-180e-4f16-9a21-346b5de1ecf0 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:28.679728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a6755-180e-4f16-9a21-346b5de1ecf0 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:28.684263 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93776fc8-aed4-4cdb-bfad-a38b1187cc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:28.685128 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93776fc8-aed4-4cdb-bfad-a38b1187cc90 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:28.685411 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93776fc8-aed4-4cdb-bfad-a38b1187cc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:28.685684 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93776fc8-aed4-4cdb-bfad-a38b1187cc90 admin admin] PATH_INFO: `/v3/projects/9629328eaaa04625b255cc18636c449b/users/21c163dfac4d47fb8c65ff2f2136e92b/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:28.687670 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93776fc8-aed4-4cdb-bfad-a38b1187cc90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9629328eaaa04625b255cc18636c449b, user_id=21c163dfac4d47fb8c65ff2f2136e92b, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:28.690390 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93776fc8-aed4-4cdb-bfad-a38b1187cc90 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:28.700169 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1385/2766] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:48:28 2022] PUT /identity/v3/projects/9629328eaaa04625b255cc18636c449b/users/21c163dfac4d47fb8c65ff2f2136e92b/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:48:33.513791 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c580e6-2ed4-4b39-b082-1cdaebe3f56d None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:33.515269 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c580e6-2ed4-4b39-b082-1cdaebe3f56d None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:33.516981 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c580e6-2ed4-4b39-b082-1cdaebe3f56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:33.546868 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-20c580e6-2ed4-4b39-b082-1cdaebe3f56d None None] MFA Rules not processed for user `21c163dfac4d47fb8c65ff2f2136e92b`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:48:33.548085 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-20c580e6-2ed4-4b39-b082-1cdaebe3f56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:33.624631 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1382/2767] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:48:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:48:33.640165 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93776fc8-aed4-4cdb-bfad-a38b1187cc90 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:48:33.643215 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-93776fc8-aed4-4cdb-bfad-a38b1187cc90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:33.725042 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93776fc8-aed4-4cdb-bfad-a38b1187cc90 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:48:33.732661 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3cbe8-1023-49ed-9aa3-dadf56343c3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:48:33.733322 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3cbe8-1023-49ed-9aa3-dadf56343c3b service nova] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:33.733604 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3cbe8-1023-49ed-9aa3-dadf56343c3b service nova] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:33.733877 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3cbe8-1023-49ed-9aa3-dadf56343c3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:33.793744 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3cbe8-1023-49ed-9aa3-dadf56343c3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:48:33.795574 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3cbe8-1023-49ed-9aa3-dadf56343c3b service nova] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:48:33.805137 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1386/2768] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:48:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:48:56.159053 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d0ccf-90c6-46a6-98ec-324fd40585c4 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:48:56.159617 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d0ccf-90c6-46a6-98ec-324fd40585c4 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:48:56.159617 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d0ccf-90c6-46a6-98ec-324fd40585c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:48:56.177977 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-229d0ccf-90c6-46a6-98ec-324fd40585c4 None None] MFA Rules not processed for user `06be00f6a9ad465195c7606883b4160d`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:48:56.179147 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-229d0ccf-90c6-46a6-98ec-324fd40585c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:48:56.186003 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1383/2769] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:48:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:49:01.485178 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3cbe8-1023-49ed-9aa3-dadf56343c3b service nova] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:49:01.537351 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3cbe8-1023-49ed-9aa3-dadf56343c3b service nova] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:49:01.540960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5cfea-27e4-4580-970a-8b751e1c0e9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:49:01.541583 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5cfea-27e4-4580-970a-8b751e1c0e9c service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:49:01.541862 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5cfea-27e4-4580-970a-8b751e1c0e9c service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:49:01.542170 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5cfea-27e4-4580-970a-8b751e1c0e9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:49:01.543927 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-14f5cfea-27e4-4580-970a-8b751e1c0e9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:49:01.575338 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5cfea-27e4-4580-970a-8b751e1c0e9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:49:01.576740 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5cfea-27e4-4580-970a-8b751e1c0e9c service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:49:01.601715 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1387/2770] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:49:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:49:11.199659 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d0ccf-90c6-46a6-98ec-324fd40585c4 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:49:11.209262 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d0ccf-90c6-46a6-98ec-324fd40585c4 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:49:11.212893 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4af6f-4841-467c-be33-48f05f81e0b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:49:11.213539 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4af6f-4841-467c-be33-48f05f81e0b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:49:11.213822 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4af6f-4841-467c-be33-48f05f81e0b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:49:11.214183 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4af6f-4841-467c-be33-48f05f81e0b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:49:11.215966 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-d0d4af6f-4841-467c-be33-48f05f81e0b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:49:11.229132 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4af6f-4841-467c-be33-48f05f81e0b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:49:11.230587 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4af6f-4841-467c-be33-48f05f81e0b9 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:49:11.241642 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1384/2771] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:49:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:49:12.686928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5cfea-27e4-4580-970a-8b751e1c0e9c service neutron] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:49:12.695767 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5cfea-27e4-4580-970a-8b751e1c0e9c service neutron] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:49:12.699771 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca86cae-7ed2-4a7d-bed7-91989b78c981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:49:12.700398 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca86cae-7ed2-4a7d-bed7-91989b78c981 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:49:12.700674 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca86cae-7ed2-4a7d-bed7-91989b78c981 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:49:12.700941 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca86cae-7ed2-4a7d-bed7-91989b78c981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:49:12.710569 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca86cae-7ed2-4a7d-bed7-91989b78c981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:49:12.711983 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca86cae-7ed2-4a7d-bed7-91989b78c981 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:49:12.721326 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1388/2772] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:49:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:49:53.907276 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4af6f-4841-467c-be33-48f05f81e0b9 service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:49:53.916218 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4af6f-4841-467c-be33-48f05f81e0b9 service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:49:53.919746 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e086f6f-6f60-4492-90f8-80bafdae76e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:49:53.920375 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e086f6f-6f60-4492-90f8-80bafdae76e8 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:49:53.920658 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e086f6f-6f60-4492-90f8-80bafdae76e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:49:53.920931 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e086f6f-6f60-4492-90f8-80bafdae76e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:49:53.922671 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-6e086f6f-6f60-4492-90f8-80bafdae76e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:49:53.931944 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e086f6f-6f60-4492-90f8-80bafdae76e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:49:53.933372 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e086f6f-6f60-4492-90f8-80bafdae76e8 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:49:53.942036 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1385/2773] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:49:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:50:04.850698 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ed987-3722-44a3-a151-381be2d21cb5 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:50:04.851234 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ed987-3722-44a3-a151-381be2d21cb5 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:50:04.851334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ed987-3722-44a3-a151-381be2d21cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:50:04.907020 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-6d2ed987-3722-44a3-a151-381be2d21cb5 None None] MFA Rules not processed for user `bd41f419750140268f4d4b77456065c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:50:04.908259 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-6d2ed987-3722-44a3-a151-381be2d21cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:50:04.970073 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1389/2774] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 12 09:50:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:50:05.016094 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e086f6f-6f60-4492-90f8-80bafdae76e8 service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:50:05.017495 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-6e086f6f-6f60-4492-90f8-80bafdae76e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:50:05.113354 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e086f6f-6f60-4492-90f8-80bafdae76e8 service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:50:05.118316 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9769bfe-a448-4e35-abe2-313317e56876 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7693a31911346f9bb2c01efcd8e16e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:50:05.118960 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9769bfe-a448-4e35-abe2-313317e56876 service swift] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:50:05.119238 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9769bfe-a448-4e35-abe2-313317e56876 service swift] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:50:05.119507 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9769bfe-a448-4e35-abe2-313317e56876 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:50:05.127257 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9769bfe-a448-4e35-abe2-313317e56876 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:50:05.129354 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9769bfe-a448-4e35-abe2-313317e56876 service swift] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:50:05.137364 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1386/2775] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 12 09:50:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 09:50:19.831832 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3010546-1972-4eab-a09d-fae913efa489 None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:50:19.832424 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3010546-1972-4eab-a09d-fae913efa489 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:50:19.832424 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3010546-1972-4eab-a09d-fae913efa489 None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:50:19.833951 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1390/2776] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 12 09:50:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:50:19.840000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b3267-0d59-4f87-8773-571247f02b09 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:50:19.840487 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b3267-0d59-4f87-8773-571247f02b09 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:50:19.840884 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b3267-0d59-4f87-8773-571247f02b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:50:19.859661 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-e30b3267-0d59-4f87-8773-571247f02b09 None None] MFA Rules not processed for user `2915babd40aa42e8bf7cc85c5a97daa6`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:50:19.860965 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-e30b3267-0d59-4f87-8773-571247f02b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:50:19.870374 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1387/2777] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 12 09:50:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:50:19.882956 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3010546-1972-4eab-a09d-fae913efa489 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:50:19.884609 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-c3010546-1972-4eab-a09d-fae913efa489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:50:19.963612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3010546-1972-4eab-a09d-fae913efa489 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:50:19.967342 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef85343-f0a9-4d05-9f5c-3e8efa10669f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0981a8c6d9ac413b99aae95a6cdd3be5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:50:19.968010 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef85343-f0a9-4d05-9f5c-3e8efa10669f service glance] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:50:19.968288 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef85343-f0a9-4d05-9f5c-3e8efa10669f service glance] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:50:19.968558 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef85343-f0a9-4d05-9f5c-3e8efa10669f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:50:19.978435 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef85343-f0a9-4d05-9f5c-3e8efa10669f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:50:19.979849 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef85343-f0a9-4d05-9f5c-3e8efa10669f service glance] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:50:19.990265 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1391/2778] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:50:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:50:20.056647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e944f-9b17-4eed-8927-a97b6eac4087 None None] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:50:20.056957 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e944f-9b17-4eed-8927-a97b6eac4087 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:50:20.057232 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e944f-9b17-4eed-8927-a97b6eac4087 None None] PATH_INFO: `/` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:50:20.058620 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1388/2779] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 12 09:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:50:20.063263 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff7dde-2132-430c-80eb-d230030bbfcf None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:50:20.063556 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff7dde-2132-430c-80eb-d230030bbfcf None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:50:20.063865 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff7dde-2132-430c-80eb-d230030bbfcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:50:20.100678 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-07ff7dde-2132-430c-80eb-d230030bbfcf None None] MFA Rules not processed for user `bf7b793f84bd4a72a68d5ab65221e1a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:50:20.101719 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-07ff7dde-2132-430c-80eb-d230030bbfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:50:20.108244 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1392/2780] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 12 09:50:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:50:20.119766 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e944f-9b17-4eed-8927-a97b6eac4087 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:50:20.132021 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e944f-9b17-4eed-8927-a97b6eac4087 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:50:20.135614 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e2d451-e79c-4b28-80e7-ac2eaa538b36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:50:20.136244 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2d451-e79c-4b28-80e7-ac2eaa538b36 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:50:20.136523 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2d451-e79c-4b28-80e7-ac2eaa538b36 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:50:20.136797 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2d451-e79c-4b28-80e7-ac2eaa538b36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:50:20.144654 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e2d451-e79c-4b28-80e7-ac2eaa538b36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:50:20.146006 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e2d451-e79c-4b28-80e7-ac2eaa538b36 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:50:20.153385 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1389/2781] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:50:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:50:20.232776 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a5070-c6fe-4469-9749-42df8cf31f3b None None] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:50:20.233068 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a5070-c6fe-4469-9749-42df8cf31f3b None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:50:20.233346 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a5070-c6fe-4469-9749-42df8cf31f3b None None] PATH_INFO: `/` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:50:20.234760 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1393/2782] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 12 09:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 09:50:20.240612 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f2a9e-879a-489d-a64a-764fa8231da2 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:50:20.241005 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f2a9e-879a-489d-a64a-764fa8231da2 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:50:20.241281 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f2a9e-879a-489d-a64a-764fa8231da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:50:20.259604 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-dc1f2a9e-879a-489d-a64a-764fa8231da2 None None] MFA Rules not processed for user `2915babd40aa42e8bf7cc85c5a97daa6`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:50:20.260803 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-dc1f2a9e-879a-489d-a64a-764fa8231da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:50:20.270465 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1390/2783] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 12 09:50:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:50:20.280551 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a5070-c6fe-4469-9749-42df8cf31f3b None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:50:20.291652 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a5070-c6fe-4469-9749-42df8cf31f3b None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:50:20.295225 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce433f-c5f3-4986-bbdb-a123e68dd0f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:50:20.295904 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce433f-c5f3-4986-bbdb-a123e68dd0f2 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:50:20.296194 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce433f-c5f3-4986-bbdb-a123e68dd0f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:50:20.296478 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce433f-c5f3-4986-bbdb-a123e68dd0f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:50:20.307257 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce433f-c5f3-4986-bbdb-a123e68dd0f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:50:20.308668 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce433f-c5f3-4986-bbdb-a123e68dd0f2 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:50:20.319865 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1394/2784] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:50:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:50:20.378659 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f2a9e-879a-489d-a64a-764fa8231da2 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:50:20.380020 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-dc1f2a9e-879a-489d-a64a-764fa8231da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:50:20.444595 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f2a9e-879a-489d-a64a-764fa8231da2 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:50:20.449490 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ff072-5f75-48e3-9031-51d81d37df6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525f4699878f461e82f7f06ef60c176a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:50:20.450159 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ff072-5f75-48e3-9031-51d81d37df6f service placement] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:50:20.450440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ff072-5f75-48e3-9031-51d81d37df6f service placement] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:50:20.450708 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ff072-5f75-48e3-9031-51d81d37df6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:50:20.452422 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-d11ff072-5f75-48e3-9031-51d81d37df6f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:50:20.463273 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ff072-5f75-48e3-9031-51d81d37df6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:50:20.464821 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ff072-5f75-48e3-9031-51d81d37df6f service placement] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:50:20.474395 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1391/2785] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:50:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:50:22.256291 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6d213-400f-445b-b2db-60a008e64538 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:50:22.256817 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6d213-400f-445b-b2db-60a008e64538 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:50:22.256817 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6d213-400f-445b-b2db-60a008e64538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:50:22.274337 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-53d6d213-400f-445b-b2db-60a008e64538 None None] MFA Rules not processed for user `bd41f419750140268f4d4b77456065c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:50:22.276022 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-53d6d213-400f-445b-b2db-60a008e64538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:50:22.282639 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1395/2786] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 12 09:50:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:50:22.295120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ff072-5f75-48e3-9031-51d81d37df6f service placement] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:50:22.307074 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ff072-5f75-48e3-9031-51d81d37df6f service placement] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:50:22.312046 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81021622-27b4-4a4c-9d0f-101220511df3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7693a31911346f9bb2c01efcd8e16e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:50:22.312680 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81021622-27b4-4a4c-9d0f-101220511df3 service swift] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:50:22.312984 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81021622-27b4-4a4c-9d0f-101220511df3 service swift] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:50:22.313274 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81021622-27b4-4a4c-9d0f-101220511df3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:50:22.321467 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81021622-27b4-4a4c-9d0f-101220511df3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:50:22.323070 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81021622-27b4-4a4c-9d0f-101220511df3 service swift] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:50:22.330858 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1392/2787] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 12 09:50:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 09:50:39.895995 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af0308-b770-4da7-b765-7b73c8a3a81d None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:50:39.896538 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af0308-b770-4da7-b765-7b73c8a3a81d None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:50:39.896538 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af0308-b770-4da7-b765-7b73c8a3a81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:50:39.914417 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-b5af0308-b770-4da7-b765-7b73c8a3a81d None None] MFA Rules not processed for user `bd41f419750140268f4d4b77456065c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:50:39.915530 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-b5af0308-b770-4da7-b765-7b73c8a3a81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:50:39.922676 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1396/2788] 10.222.0.60 () {58 vars in 967 bytes} [Thu May 12 09:50:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:50:39.934933 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81021622-27b4-4a4c-9d0f-101220511df3 service swift] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:50:39.945123 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81021622-27b4-4a4c-9d0f-101220511df3 service swift] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:50:39.950263 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37d95f-26bb-4cbc-afb2-63a8e1ab8397 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7693a31911346f9bb2c01efcd8e16e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:50:39.950905 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37d95f-26bb-4cbc-afb2-63a8e1ab8397 service swift] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:50:39.951209 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37d95f-26bb-4cbc-afb2-63a8e1ab8397 service swift] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:50:39.951474 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37d95f-26bb-4cbc-afb2-63a8e1ab8397 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:50:39.959852 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37d95f-26bb-4cbc-afb2-63a8e1ab8397 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:50:39.961393 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37d95f-26bb-4cbc-afb2-63a8e1ab8397 service swift] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:50:39.969047 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1393/2789] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 12 09:50:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 09:51:39.078268 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af0308-b770-4da7-b765-7b73c8a3a81d None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:39.098157 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af0308-b770-4da7-b765-7b73c8a3a81d None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:39.107316 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e0e02-8d37-4e81-ac73-d01559767f0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:39.108053 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e0e02-8d37-4e81-ac73-d01559767f0a service nova] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:39.108533 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e0e02-8d37-4e81-ac73-d01559767f0a service nova] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:39.108816 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e0e02-8d37-4e81-ac73-d01559767f0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:39.111358 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-309e0e02-8d37-4e81-ac73-d01559767f0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:39.125762 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e0e02-8d37-4e81-ac73-d01559767f0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:39.127526 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e0e02-8d37-4e81-ac73-d01559767f0a service nova] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:39.140654 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1397/2790] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:51:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:51:42.888028 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ed0a4-2c92-4691-aec5-3aa4522f7375 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:42.888602 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ed0a4-2c92-4691-aec5-3aa4522f7375 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:42.888602 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ed0a4-2c92-4691-aec5-3aa4522f7375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:42.907115 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-323ed0a4-2c92-4691-aec5-3aa4522f7375 None None] MFA Rules not processed for user `06be00f6a9ad465195c7606883b4160d`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:51:42.908441 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-323ed0a4-2c92-4691-aec5-3aa4522f7375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:42.917313 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1394/2791] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:51:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:51:43.263304 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e0e02-8d37-4e81-ac73-d01559767f0a service nova] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:43.273242 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e0e02-8d37-4e81-ac73-d01559767f0a service nova] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:43.276746 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48058771-7373-4e40-9de6-63a69edd4e11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:43.277364 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48058771-7373-4e40-9de6-63a69edd4e11 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:43.277729 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48058771-7373-4e40-9de6-63a69edd4e11 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:43.278038 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48058771-7373-4e40-9de6-63a69edd4e11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:43.279843 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-48058771-7373-4e40-9de6-63a69edd4e11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:43.289586 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48058771-7373-4e40-9de6-63a69edd4e11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:43.291038 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48058771-7373-4e40-9de6-63a69edd4e11 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:43.298783 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1398/2792] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:51:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:51:44.267647 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ed0a4-2c92-4691-aec5-3aa4522f7375 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:44.269128 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-323ed0a4-2c92-4691-aec5-3aa4522f7375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:44.281256 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ed0a4-2c92-4691-aec5-3aa4522f7375 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:44.285227 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297544d-2f5d-4003-a46a-0fa14abfb260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:44.286139 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297544d-2f5d-4003-a46a-0fa14abfb260 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:44.286428 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297544d-2f5d-4003-a46a-0fa14abfb260 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:44.286705 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297544d-2f5d-4003-a46a-0fa14abfb260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:44.289064 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-f297544d-2f5d-4003-a46a-0fa14abfb260 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:44.348834 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297544d-2f5d-4003-a46a-0fa14abfb260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:44.350330 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297544d-2f5d-4003-a46a-0fa14abfb260 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:44.360461 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1395/2793] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:51:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:51:47.768282 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48058771-7373-4e40-9de6-63a69edd4e11 service neutron] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:47.769878 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-48058771-7373-4e40-9de6-63a69edd4e11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:47.785115 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48058771-7373-4e40-9de6-63a69edd4e11 service neutron] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:47.790860 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd19ac1-59a2-4191-a507-376ff5fb87f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:47.791689 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd19ac1-59a2-4191-a507-376ff5fb87f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:47.791974 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd19ac1-59a2-4191-a507-376ff5fb87f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:47.792250 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd19ac1-59a2-4191-a507-376ff5fb87f7 admin admin] PATH_INFO: `/v3/users/f739359acd844279aa56ef7d69f4c299` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:47.793475 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd19ac1-59a2-4191-a507-376ff5fb87f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f739359acd844279aa56ef7d69f4c299)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:47.795455 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd19ac1-59a2-4191-a507-376ff5fb87f7 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:47.840991 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-5dd19ac1-59a2-4191-a507-376ff5fb87f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f739359acd844279aa56ef7d69f4c299'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:47.853245 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-5dd19ac1-59a2-4191-a507-376ff5fb87f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f739359acd844279aa56ef7d69f4c299'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:47.853981 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-5dd19ac1-59a2-4191-a507-376ff5fb87f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f739359acd844279aa56ef7d69f4c299'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:47.861132 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-5dd19ac1-59a2-4191-a507-376ff5fb87f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f739359acd844279aa56ef7d69f4c299'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:47.868761 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-5dd19ac1-59a2-4191-a507-376ff5fb87f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f739359acd844279aa56ef7d69f4c299'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:47.874845 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1399/2794] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:51:47 2022] DELETE /identity/v3/users/f739359acd844279aa56ef7d69f4c299 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:51:48.052168 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297544d-2f5d-4003-a46a-0fa14abfb260 service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:48.064379 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297544d-2f5d-4003-a46a-0fa14abfb260 service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:48.130658 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8bc3c-5ab1-4243-8f7f-ce243ba0982d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:48.131407 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8bc3c-5ab1-4243-8f7f-ce243ba0982d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:48.131692 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8bc3c-5ab1-4243-8f7f-ce243ba0982d admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:48.132002 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8bc3c-5ab1-4243-8f7f-ce243ba0982d admin admin] PATH_INFO: `/v3/projects/b879e240eb4f48139e28cc43223b21da` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:48.133188 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d8bc3c-5ab1-4243-8f7f-ce243ba0982d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b879e240eb4f48139e28cc43223b21da)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:48.135182 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d8bc3c-5ab1-4243-8f7f-ce243ba0982d admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:48.181126 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-b7d8bc3c-5ab1-4243-8f7f-ce243ba0982d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b879e240eb4f48139e28cc43223b21da', 'request_id': 'req-b7d8bc3c-5ab1-4243-8f7f-ce243ba0982d'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:48.186623 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-b7d8bc3c-5ab1-4243-8f7f-ce243ba0982d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b879e240eb4f48139e28cc43223b21da', 'request_id': 'req-b7d8bc3c-5ab1-4243-8f7f-ce243ba0982d'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:48.194376 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-b7d8bc3c-5ab1-4243-8f7f-ce243ba0982d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b879e240eb4f48139e28cc43223b21da', 'request_id': 'req-b7d8bc3c-5ab1-4243-8f7f-ce243ba0982d'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:48.205537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-b7d8bc3c-5ab1-4243-8f7f-ce243ba0982d admin admin] The token cache is being invalidate because project b879e240eb4f48139e28cc43223b21da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:51:48.205989 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-b7d8bc3c-5ab1-4243-8f7f-ce243ba0982d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:48.206673 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-b7d8bc3c-5ab1-4243-8f7f-ce243ba0982d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:48.208401 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1396/2795] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:51:48 2022] DELETE /identity/v3/projects/b879e240eb4f48139e28cc43223b21da => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:51:48.213874 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9d863-1182-437d-88a9-d80093b0e819 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:48.214275 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9d863-1182-437d-88a9-d80093b0e819 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:48.214562 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9d863-1182-437d-88a9-d80093b0e819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:48.233941 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-a2c9d863-1182-437d-88a9-d80093b0e819 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:51:48.235073 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-a2c9d863-1182-437d-88a9-d80093b0e819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:48.293779 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1400/2796] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:51:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:51:48.302625 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282fd57-f397-4759-82f2-be98a82251f4 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:48.302955 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282fd57-f397-4759-82f2-be98a82251f4 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:48.303163 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282fd57-f397-4759-82f2-be98a82251f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:48.322757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-5282fd57-f397-4759-82f2-be98a82251f4 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:51:48.323986 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-5282fd57-f397-4759-82f2-be98a82251f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:48.332344 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1397/2797] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:51:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:51:48.337335 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9d863-1182-437d-88a9-d80093b0e819 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:48.348030 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9d863-1182-437d-88a9-d80093b0e819 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:48.353821 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112900c1-7c55-4174-b1c8-5321eeababe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:48.354504 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112900c1-7c55-4174-b1c8-5321eeababe9 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:48.354781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112900c1-7c55-4174-b1c8-5321eeababe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:48.355051 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112900c1-7c55-4174-b1c8-5321eeababe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:48.355770 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112900c1-7c55-4174-b1c8-5321eeababe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:51:48.356072 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112900c1-7c55-4174-b1c8-5321eeababe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:48.357651 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112900c1-7c55-4174-b1c8-5321eeababe9 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:48.369306 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1401/2798] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:51:48.373475 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282fd57-f397-4759-82f2-be98a82251f4 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:48.382832 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282fd57-f397-4759-82f2-be98a82251f4 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:48.387424 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418668fd-1901-4127-af6b-7756aa2e0d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:48.388071 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418668fd-1901-4127-af6b-7756aa2e0d4e admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:48.388351 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418668fd-1901-4127-af6b-7756aa2e0d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:48.388622 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418668fd-1901-4127-af6b-7756aa2e0d4e admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:48.389310 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418668fd-1901-4127-af6b-7756aa2e0d4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:48.391207 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418668fd-1901-4127-af6b-7756aa2e0d4e admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:48.419735 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1398/2799] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:51:48 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:51:48.420926 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112900c1-7c55-4174-b1c8-5321eeababe9 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:48.431273 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112900c1-7c55-4174-b1c8-5321eeababe9 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:48.485105 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493294f7-48cb-42a0-95ea-04b6897561c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:48.485683 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493294f7-48cb-42a0-95ea-04b6897561c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:48.485999 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493294f7-48cb-42a0-95ea-04b6897561c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:48.486274 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493294f7-48cb-42a0-95ea-04b6897561c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:48.486953 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493294f7-48cb-42a0-95ea-04b6897561c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:48.488854 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493294f7-48cb-42a0-95ea-04b6897561c1 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:48.507515 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1402/2800] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:51:48 2022] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:51:48.511558 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418668fd-1901-4127-af6b-7756aa2e0d4e admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:48.522100 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418668fd-1901-4127-af6b-7756aa2e0d4e admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:48.527107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416abc12-6b40-4c50-b0fb-822d2f3185f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:48.527760 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416abc12-6b40-4c50-b0fb-822d2f3185f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:48.528038 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416abc12-6b40-4c50-b0fb-822d2f3185f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:48.528310 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416abc12-6b40-4c50-b0fb-822d2f3185f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:48.529054 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416abc12-6b40-4c50-b0fb-822d2f3185f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:48.530697 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416abc12-6b40-4c50-b0fb-822d2f3185f2 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:48.541225 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1399/2801] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:51:48.544955 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493294f7-48cb-42a0-95ea-04b6897561c1 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:48.554550 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493294f7-48cb-42a0-95ea-04b6897561c1 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:48.559087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebde37-f128-47b5-bf0c-0aa0c60ec7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:48.559727 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebde37-f128-47b5-bf0c-0aa0c60ec7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:48.560031 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebde37-f128-47b5-bf0c-0aa0c60ec7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:48.560289 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebde37-f128-47b5-bf0c-0aa0c60ec7c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:48.561008 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ebde37-f128-47b5-bf0c-0aa0c60ec7c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:48.562617 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ebde37-f128-47b5-bf0c-0aa0c60ec7c7 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:48.575228 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1403/2802] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:51:48.579383 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416abc12-6b40-4c50-b0fb-822d2f3185f2 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:48.589892 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416abc12-6b40-4c50-b0fb-822d2f3185f2 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:48.594518 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c2fb7-bdb1-4a0c-baed-2eb1af3a1230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:48.595386 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c2fb7-bdb1-4a0c-baed-2eb1af3a1230 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:48.595674 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c2fb7-bdb1-4a0c-baed-2eb1af3a1230 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:48.595954 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c2fb7-bdb1-4a0c-baed-2eb1af3a1230 admin admin] PATH_INFO: `/v3/projects/4c313f817ab146bfba3db68f3931a848/users/866a1947b37943adb2a2705ad3245fe3/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:48.611198 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c2fb7-bdb1-4a0c-baed-2eb1af3a1230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c313f817ab146bfba3db68f3931a848, user_id=866a1947b37943adb2a2705ad3245fe3, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:48.613811 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c2fb7-bdb1-4a0c-baed-2eb1af3a1230 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:48.627818 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1400/2803] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:51:48 2022] PUT /identity/v3/projects/4c313f817ab146bfba3db68f3931a848/users/866a1947b37943adb2a2705ad3245fe3/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:51:48.638369 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094bbc8-069e-43b5-b3b0-7519a0907abf None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:48.638681 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094bbc8-069e-43b5-b3b0-7519a0907abf None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:48.638957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094bbc8-069e-43b5-b3b0-7519a0907abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:48.666685 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-a094bbc8-069e-43b5-b3b0-7519a0907abf None None] MFA Rules not processed for user `866a1947b37943adb2a2705ad3245fe3`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:51:48.667885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-a094bbc8-069e-43b5-b3b0-7519a0907abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:48.728629 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1404/2804] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:51:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:51:48.740228 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c2fb7-bdb1-4a0c-baed-2eb1af3a1230 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:48.741889 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-de1c2fb7-bdb1-4a0c-baed-2eb1af3a1230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:48.811667 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c2fb7-bdb1-4a0c-baed-2eb1af3a1230 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:48.817737 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f4d92-50a2-4a35-9584-b03f21603cfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:48.818419 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f4d92-50a2-4a35-9584-b03f21603cfe service nova] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:48.818703 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f4d92-50a2-4a35-9584-b03f21603cfe service nova] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:48.818978 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f4d92-50a2-4a35-9584-b03f21603cfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:48.827462 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f4d92-50a2-4a35-9584-b03f21603cfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:48.829013 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f4d92-50a2-4a35-9584-b03f21603cfe service nova] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:48.838313 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1401/2805] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:51:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:51:51.500046 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094bbc8-069e-43b5-b3b0-7519a0907abf None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:51.557222 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094bbc8-069e-43b5-b3b0-7519a0907abf None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:51.561706 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9f4c3-ac59-44f3-81ac-6f063d57eb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:51.562601 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9f4c3-ac59-44f3-81ac-6f063d57eb7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:51.562878 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9f4c3-ac59-44f3-81ac-6f063d57eb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:51.563148 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9f4c3-ac59-44f3-81ac-6f063d57eb7e admin admin] PATH_INFO: `/v3/users/866a1947b37943adb2a2705ad3245fe3` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:51.564344 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9f4c3-ac59-44f3-81ac-6f063d57eb7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=866a1947b37943adb2a2705ad3245fe3)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:51.566262 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9f4c3-ac59-44f3-81ac-6f063d57eb7e admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:51.610425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f5f9f4c3-ac59-44f3-81ac-6f063d57eb7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '866a1947b37943adb2a2705ad3245fe3'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:51.621498 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f5f9f4c3-ac59-44f3-81ac-6f063d57eb7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '866a1947b37943adb2a2705ad3245fe3'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:51.622173 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f5f9f4c3-ac59-44f3-81ac-6f063d57eb7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '866a1947b37943adb2a2705ad3245fe3'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:51.628914 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f5f9f4c3-ac59-44f3-81ac-6f063d57eb7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '866a1947b37943adb2a2705ad3245fe3'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:51.636186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f5f9f4c3-ac59-44f3-81ac-6f063d57eb7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '866a1947b37943adb2a2705ad3245fe3'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:51.642364 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1405/2806] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:51:51 2022] DELETE /identity/v3/users/866a1947b37943adb2a2705ad3245fe3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:51:51.646977 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed457248-1971-4ad3-9fc2-9402ce85b6d6 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:51.647445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed457248-1971-4ad3-9fc2-9402ce85b6d6 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:51.647584 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed457248-1971-4ad3-9fc2-9402ce85b6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:51.664798 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-ed457248-1971-4ad3-9fc2-9402ce85b6d6 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:51:51.666007 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-ed457248-1971-4ad3-9fc2-9402ce85b6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:51.721177 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1402/2807] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:51:51.730606 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9f4c3-ac59-44f3-81ac-6f063d57eb7e admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:51.731994 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-f5f9f4c3-ac59-44f3-81ac-6f063d57eb7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:51.788874 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9f4c3-ac59-44f3-81ac-6f063d57eb7e admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:51.792486 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bb980-e098-4d32-9d8e-e1c044b8902a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:51.793118 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bb980-e098-4d32-9d8e-e1c044b8902a service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:51.793395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bb980-e098-4d32-9d8e-e1c044b8902a service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:51.793665 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bb980-e098-4d32-9d8e-e1c044b8902a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:51.802419 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7bb980-e098-4d32-9d8e-e1c044b8902a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:51.803876 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7bb980-e098-4d32-9d8e-e1c044b8902a service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:51.813076 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1406/2808] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:51:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:51:52.067856 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed457248-1971-4ad3-9fc2-9402ce85b6d6 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:52.069308 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-ed457248-1971-4ad3-9fc2-9402ce85b6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:52.083616 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed457248-1971-4ad3-9fc2-9402ce85b6d6 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:52.088803 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e06a4-dd5e-4850-96c3-cfe3b31001f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:52.089841 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e06a4-dd5e-4850-96c3-cfe3b31001f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:52.090171 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e06a4-dd5e-4850-96c3-cfe3b31001f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:52.090471 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e06a4-dd5e-4850-96c3-cfe3b31001f0 admin admin] PATH_INFO: `/v3/projects/4c313f817ab146bfba3db68f3931a848` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:52.091637 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e06a4-dd5e-4850-96c3-cfe3b31001f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c313f817ab146bfba3db68f3931a848)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:52.093533 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e06a4-dd5e-4850-96c3-cfe3b31001f0 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:52.144211 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-3f0e06a4-dd5e-4850-96c3-cfe3b31001f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c313f817ab146bfba3db68f3931a848', 'request_id': 'req-3f0e06a4-dd5e-4850-96c3-cfe3b31001f0'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:52.149478 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-3f0e06a4-dd5e-4850-96c3-cfe3b31001f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c313f817ab146bfba3db68f3931a848', 'request_id': 'req-3f0e06a4-dd5e-4850-96c3-cfe3b31001f0'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:52.155857 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-3f0e06a4-dd5e-4850-96c3-cfe3b31001f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c313f817ab146bfba3db68f3931a848', 'request_id': 'req-3f0e06a4-dd5e-4850-96c3-cfe3b31001f0'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:52.166611 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-3f0e06a4-dd5e-4850-96c3-cfe3b31001f0 admin admin] The token cache is being invalidate because project 4c313f817ab146bfba3db68f3931a848 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:51:52.166900 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-3f0e06a4-dd5e-4850-96c3-cfe3b31001f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:52.167521 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-3f0e06a4-dd5e-4850-96c3-cfe3b31001f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:52.169061 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1403/2809] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:51:52 2022] DELETE /identity/v3/projects/4c313f817ab146bfba3db68f3931a848 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:51:52.173852 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44893c-57c5-4ad3-9787-0302b0f363b9 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:52.174232 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44893c-57c5-4ad3-9787-0302b0f363b9 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:52.174512 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44893c-57c5-4ad3-9787-0302b0f363b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:52.192153 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-bc44893c-57c5-4ad3-9787-0302b0f363b9 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:51:52.193339 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-bc44893c-57c5-4ad3-9787-0302b0f363b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:52.250383 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1407/2810] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:51:52.257980 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7ab0e-fae0-4d86-850f-dbc29063d281 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:52.258823 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7ab0e-fae0-4d86-850f-dbc29063d281 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:52.259110 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7ab0e-fae0-4d86-850f-dbc29063d281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:52.281972 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-d5f7ab0e-fae0-4d86-850f-dbc29063d281 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:51:52.283167 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-d5f7ab0e-fae0-4d86-850f-dbc29063d281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:52.291648 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1404/2811] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:51:52.295627 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44893c-57c5-4ad3-9787-0302b0f363b9 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:52.306302 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44893c-57c5-4ad3-9787-0302b0f363b9 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:52.311186 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77e5f0-61ef-4d9e-99a8-88b3aa67a9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:52.311842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77e5f0-61ef-4d9e-99a8-88b3aa67a9fc admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:52.312127 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77e5f0-61ef-4d9e-99a8-88b3aa67a9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:52.312404 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77e5f0-61ef-4d9e-99a8-88b3aa67a9fc admin admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:52.313125 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c77e5f0-61ef-4d9e-99a8-88b3aa67a9fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:51:52.313437 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c77e5f0-61ef-4d9e-99a8-88b3aa67a9fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:52.315103 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c77e5f0-61ef-4d9e-99a8-88b3aa67a9fc admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:52.329808 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1408/2812] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:51:52.330923 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7ab0e-fae0-4d86-850f-dbc29063d281 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:52.340368 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7ab0e-fae0-4d86-850f-dbc29063d281 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:52.345026 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c48696-95fb-47a7-ac5a-5e0ecc87b7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:52.345682 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c48696-95fb-47a7-ac5a-5e0ecc87b7ef admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:52.345992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c48696-95fb-47a7-ac5a-5e0ecc87b7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:52.346269 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c48696-95fb-47a7-ac5a-5e0ecc87b7ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:52.346954 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c48696-95fb-47a7-ac5a-5e0ecc87b7ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:52.348832 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c48696-95fb-47a7-ac5a-5e0ecc87b7ef admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:52.374804 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1405/2813] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:51:52 2022] POST /identity/v3/projects => generated 389 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:51:52.379620 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77e5f0-61ef-4d9e-99a8-88b3aa67a9fc admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:52.389928 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77e5f0-61ef-4d9e-99a8-88b3aa67a9fc admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:52.445303 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08257416-1705-4151-ba2e-a196f1c4a159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:52.446043 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08257416-1705-4151-ba2e-a196f1c4a159 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:52.446340 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08257416-1705-4151-ba2e-a196f1c4a159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:52.446589 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08257416-1705-4151-ba2e-a196f1c4a159 admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:52.447622 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08257416-1705-4151-ba2e-a196f1c4a159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:52.449495 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08257416-1705-4151-ba2e-a196f1c4a159 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:52.468922 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1409/2814] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:51:52 2022] POST /identity/v3/users => generated 295 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:51:52.473065 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c48696-95fb-47a7-ac5a-5e0ecc87b7ef admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:52.483484 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c48696-95fb-47a7-ac5a-5e0ecc87b7ef admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:52.488085 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2495894-1c5d-443b-a79b-572ad3dd8bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:52.488722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2495894-1c5d-443b-a79b-572ad3dd8bec admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:52.489000 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2495894-1c5d-443b-a79b-572ad3dd8bec admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:52.489273 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2495894-1c5d-443b-a79b-572ad3dd8bec admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:52.490023 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2495894-1c5d-443b-a79b-572ad3dd8bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:52.491749 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2495894-1c5d-443b-a79b-572ad3dd8bec admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:52.502599 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1406/2815] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:51:52.506453 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08257416-1705-4151-ba2e-a196f1c4a159 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:52.518334 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08257416-1705-4151-ba2e-a196f1c4a159 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:52.522944 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3faf2-b281-488c-af49-13fdf19cec97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:52.523576 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3faf2-b281-488c-af49-13fdf19cec97 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:52.523884 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3faf2-b281-488c-af49-13fdf19cec97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:52.524153 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3faf2-b281-488c-af49-13fdf19cec97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:52.524982 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3faf2-b281-488c-af49-13fdf19cec97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:52.526591 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3faf2-b281-488c-af49-13fdf19cec97 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:52.535990 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1410/2816] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:51:52.540633 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2495894-1c5d-443b-a79b-572ad3dd8bec admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:52.551673 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2495894-1c5d-443b-a79b-572ad3dd8bec admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:52.556820 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42ebd9-d8c2-488b-a256-4cdddeaed61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:52.557684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42ebd9-d8c2-488b-a256-4cdddeaed61b admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:52.557990 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42ebd9-d8c2-488b-a256-4cdddeaed61b admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:52.558269 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42ebd9-d8c2-488b-a256-4cdddeaed61b admin admin] PATH_INFO: `/v3/projects/d5b35f1b0f374bb680ad522896836e11/users/fd2cb5aab70f48af9de6acd85f4d6c93/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:52.572059 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42ebd9-d8c2-488b-a256-4cdddeaed61b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5b35f1b0f374bb680ad522896836e11, user_id=fd2cb5aab70f48af9de6acd85f4d6c93, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:52.574699 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42ebd9-d8c2-488b-a256-4cdddeaed61b admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:52.587030 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1407/2817] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:51:52 2022] PUT /identity/v3/projects/d5b35f1b0f374bb680ad522896836e11/users/fd2cb5aab70f48af9de6acd85f4d6c93/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:51:52.598408 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8a964-d0ee-46aa-915f-3e15e8386086 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:52.598701 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8a964-d0ee-46aa-915f-3e15e8386086 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:52.598985 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8a964-d0ee-46aa-915f-3e15e8386086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:52.625593 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-f7a8a964-d0ee-46aa-915f-3e15e8386086 None None] MFA Rules not processed for user `fd2cb5aab70f48af9de6acd85f4d6c93`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:51:52.626821 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-f7a8a964-d0ee-46aa-915f-3e15e8386086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:52.688030 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1411/2818] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:51:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:51:52.692446 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42ebd9-d8c2-488b-a256-4cdddeaed61b admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:52.750017 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42ebd9-d8c2-488b-a256-4cdddeaed61b admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:52.754838 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a11d72-b4bf-423c-9633-bb1ddcd0285f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:52.755436 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a11d72-b4bf-423c-9633-bb1ddcd0285f admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:52.755722 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a11d72-b4bf-423c-9633-bb1ddcd0285f admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:52.755995 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a11d72-b4bf-423c-9633-bb1ddcd0285f admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:52.756692 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a11d72-b4bf-423c-9633-bb1ddcd0285f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:52.758714 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a11d72-b4bf-423c-9633-bb1ddcd0285f admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:52.785951 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1408/2819] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:51:52 2022] POST /identity/v3/projects => generated 389 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:51:52.790869 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8a964-d0ee-46aa-915f-3e15e8386086 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:52.801350 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8a964-d0ee-46aa-915f-3e15e8386086 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:52.855106 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad9cd1-2781-4030-9b6c-95d5a3d8b59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:52.855765 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad9cd1-2781-4030-9b6c-95d5a3d8b59d admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:52.856045 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad9cd1-2781-4030-9b6c-95d5a3d8b59d admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:52.856318 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad9cd1-2781-4030-9b6c-95d5a3d8b59d admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:52.856998 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad9cd1-2781-4030-9b6c-95d5a3d8b59d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:52.858944 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad9cd1-2781-4030-9b6c-95d5a3d8b59d admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:52.879275 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1412/2820] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:51:52 2022] POST /identity/v3/users => generated 301 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:51:52.881607 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a11d72-b4bf-423c-9633-bb1ddcd0285f admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:52.891809 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a11d72-b4bf-423c-9633-bb1ddcd0285f admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:52.896334 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0518a33-b0ef-493f-8a78-0824ec3145e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:52.896988 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0518a33-b0ef-493f-8a78-0824ec3145e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:52.897271 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0518a33-b0ef-493f-8a78-0824ec3145e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:52.897546 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0518a33-b0ef-493f-8a78-0824ec3145e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:52.898302 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0518a33-b0ef-493f-8a78-0824ec3145e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:52.900418 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0518a33-b0ef-493f-8a78-0824ec3145e6 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:52.910490 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1409/2821] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:51:52.914163 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad9cd1-2781-4030-9b6c-95d5a3d8b59d admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:52.924413 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad9cd1-2781-4030-9b6c-95d5a3d8b59d admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:52.929055 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a0912-cadc-4ca3-9e9b-5a3bb4629994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:52.929942 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a0912-cadc-4ca3-9e9b-5a3bb4629994 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:52.930224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a0912-cadc-4ca3-9e9b-5a3bb4629994 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:52.930499 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a0912-cadc-4ca3-9e9b-5a3bb4629994 admin admin] PATH_INFO: `/v3/projects/22f2a9dfd7e642ca852ea8879bbec334/users/00ea234ad5f54cf680cfc0bce447fe52/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:52.944707 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a0912-cadc-4ca3-9e9b-5a3bb4629994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f2a9dfd7e642ca852ea8879bbec334, user_id=00ea234ad5f54cf680cfc0bce447fe52, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:52.947376 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a0912-cadc-4ca3-9e9b-5a3bb4629994 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:52.960348 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1413/2822] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:51:52 2022] PUT /identity/v3/projects/22f2a9dfd7e642ca852ea8879bbec334/users/00ea234ad5f54cf680cfc0bce447fe52/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:51:52.964669 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0518a33-b0ef-493f-8a78-0824ec3145e6 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:52.974373 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0518a33-b0ef-493f-8a78-0824ec3145e6 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:53.029179 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c1c97-9c64-45a1-81e3-e71fa1bda0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:53.029774 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c1c97-9c64-45a1-81e3-e71fa1bda0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:53.030088 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c1c97-9c64-45a1-81e3-e71fa1bda0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:53.030363 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c1c97-9c64-45a1-81e3-e71fa1bda0f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:53.031078 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c1c97-9c64-45a1-81e3-e71fa1bda0f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:53.032649 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c1c97-9c64-45a1-81e3-e71fa1bda0f6 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:53.042345 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1410/2823] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:51:53.046326 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a0912-cadc-4ca3-9e9b-5a3bb4629994 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:53.056204 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a0912-cadc-4ca3-9e9b-5a3bb4629994 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:53.060802 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803d876-b18d-43c5-857c-64ced8cc512f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:53.061666 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803d876-b18d-43c5-857c-64ced8cc512f admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:53.061980 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803d876-b18d-43c5-857c-64ced8cc512f admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:53.062257 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803d876-b18d-43c5-857c-64ced8cc512f admin admin] PATH_INFO: `/v3/projects/22f2a9dfd7e642ca852ea8879bbec334/users/00ea234ad5f54cf680cfc0bce447fe52/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:53.064222 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803d876-b18d-43c5-857c-64ced8cc512f admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f2a9dfd7e642ca852ea8879bbec334, user_id=00ea234ad5f54cf680cfc0bce447fe52, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:53.066867 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803d876-b18d-43c5-857c-64ced8cc512f admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:53.077164 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1414/2824] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:51:53 2022] PUT /identity/v3/projects/22f2a9dfd7e642ca852ea8879bbec334/users/00ea234ad5f54cf680cfc0bce447fe52/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:51:53.087557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cead5c-4260-4019-9de9-203a83f28a6f None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:53.087844 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cead5c-4260-4019-9de9-203a83f28a6f None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:53.088120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cead5c-4260-4019-9de9-203a83f28a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:53.113453 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-b2cead5c-4260-4019-9de9-203a83f28a6f None None] MFA Rules not processed for user `00ea234ad5f54cf680cfc0bce447fe52`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:51:53.114680 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-b2cead5c-4260-4019-9de9-203a83f28a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:53.182901 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1411/2825] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:51:53 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:51:53.193234 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803d876-b18d-43c5-857c-64ced8cc512f admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:53.194922 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-5803d876-b18d-43c5-857c-64ced8cc512f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:53.252850 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803d876-b18d-43c5-857c-64ced8cc512f admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:53.256515 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039fc4fb-ed30-46b2-b104-97b1d62c758e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:53.257152 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fc4fb-ed30-46b2-b104-97b1d62c758e service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:53.257434 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fc4fb-ed30-46b2-b104-97b1d62c758e service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:53.257707 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fc4fb-ed30-46b2-b104-97b1d62c758e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:53.267254 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039fc4fb-ed30-46b2-b104-97b1d62c758e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:53.268705 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039fc4fb-ed30-46b2-b104-97b1d62c758e service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:53.278538 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1415/2826] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:51:53 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:51:53.400148 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cead5c-4260-4019-9de9-203a83f28a6f None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:53.459052 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cead5c-4260-4019-9de9-203a83f28a6f None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:53.463758 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b5e99-e5a1-4d42-80bb-fe703e2e929f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:53.464477 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b5e99-e5a1-4d42-80bb-fe703e2e929f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:53.464755 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b5e99-e5a1-4d42-80bb-fe703e2e929f admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:53.465025 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b5e99-e5a1-4d42-80bb-fe703e2e929f admin admin] PATH_INFO: `/v3/users/fd2cb5aab70f48af9de6acd85f4d6c93` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:53.466258 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b5e99-e5a1-4d42-80bb-fe703e2e929f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd2cb5aab70f48af9de6acd85f4d6c93)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:53.468153 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b5e99-e5a1-4d42-80bb-fe703e2e929f admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:53.512909 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-148b5e99-e5a1-4d42-80bb-fe703e2e929f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd2cb5aab70f48af9de6acd85f4d6c93'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:53.524731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-148b5e99-e5a1-4d42-80bb-fe703e2e929f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd2cb5aab70f48af9de6acd85f4d6c93'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:53.525455 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-148b5e99-e5a1-4d42-80bb-fe703e2e929f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd2cb5aab70f48af9de6acd85f4d6c93'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:53.533359 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-148b5e99-e5a1-4d42-80bb-fe703e2e929f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd2cb5aab70f48af9de6acd85f4d6c93'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:53.540300 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-148b5e99-e5a1-4d42-80bb-fe703e2e929f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd2cb5aab70f48af9de6acd85f4d6c93'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:53.546306 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1412/2827] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:51:53 2022] DELETE /identity/v3/users/fd2cb5aab70f48af9de6acd85f4d6c93 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:51:53.550770 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35431ddd-aac3-4613-91c7-0c9e0c8dc6ac None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:53.551204 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35431ddd-aac3-4613-91c7-0c9e0c8dc6ac None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:53.551350 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35431ddd-aac3-4613-91c7-0c9e0c8dc6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:53.572387 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-35431ddd-aac3-4613-91c7-0c9e0c8dc6ac None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:51:53.573594 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-35431ddd-aac3-4613-91c7-0c9e0c8dc6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:53.630808 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1416/2828] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:51:53.640911 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b5e99-e5a1-4d42-80bb-fe703e2e929f admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:53.642702 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-148b5e99-e5a1-4d42-80bb-fe703e2e929f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:53.697607 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b5e99-e5a1-4d42-80bb-fe703e2e929f admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:53.701213 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa144a7e-93d7-45fb-83a1-f8d825066715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:53.701850 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa144a7e-93d7-45fb-83a1-f8d825066715 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:53.702160 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa144a7e-93d7-45fb-83a1-f8d825066715 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:53.702432 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa144a7e-93d7-45fb-83a1-f8d825066715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:53.711201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa144a7e-93d7-45fb-83a1-f8d825066715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:53.712629 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa144a7e-93d7-45fb-83a1-f8d825066715 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:53.721697 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1413/2829] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:51:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:51:53.989977 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35431ddd-aac3-4613-91c7-0c9e0c8dc6ac None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:53.991497 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-35431ddd-aac3-4613-91c7-0c9e0c8dc6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:54.004565 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35431ddd-aac3-4613-91c7-0c9e0c8dc6ac None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:54.009566 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898b23c-98b1-4775-a836-bf735e1ba6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:54.011108 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898b23c-98b1-4775-a836-bf735e1ba6bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:54.011384 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898b23c-98b1-4775-a836-bf735e1ba6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:54.011653 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898b23c-98b1-4775-a836-bf735e1ba6bd admin admin] PATH_INFO: `/v3/projects/d5b35f1b0f374bb680ad522896836e11` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:54.012837 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898b23c-98b1-4775-a836-bf735e1ba6bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5b35f1b0f374bb680ad522896836e11)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:54.014760 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898b23c-98b1-4775-a836-bf735e1ba6bd admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:54.058630 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f898b23c-98b1-4775-a836-bf735e1ba6bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5b35f1b0f374bb680ad522896836e11', 'request_id': 'req-f898b23c-98b1-4775-a836-bf735e1ba6bd'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:54.064097 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f898b23c-98b1-4775-a836-bf735e1ba6bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5b35f1b0f374bb680ad522896836e11', 'request_id': 'req-f898b23c-98b1-4775-a836-bf735e1ba6bd'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:54.071633 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f898b23c-98b1-4775-a836-bf735e1ba6bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5b35f1b0f374bb680ad522896836e11', 'request_id': 'req-f898b23c-98b1-4775-a836-bf735e1ba6bd'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:54.082325 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f898b23c-98b1-4775-a836-bf735e1ba6bd admin admin] The token cache is being invalidate because project d5b35f1b0f374bb680ad522896836e11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:51:54.082607 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f898b23c-98b1-4775-a836-bf735e1ba6bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:54.083232 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-f898b23c-98b1-4775-a836-bf735e1ba6bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:54.084773 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1417/2830] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:51:53 2022] DELETE /identity/v3/projects/d5b35f1b0f374bb680ad522896836e11 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:51:54.089373 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa144a7e-93d7-45fb-83a1-f8d825066715 service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:54.098801 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa144a7e-93d7-45fb-83a1-f8d825066715 service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:54.153870 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1b5e0-7d54-4605-b9c3-679b3b98e913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:54.154792 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1b5e0-7d54-4605-b9c3-679b3b98e913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:54.155101 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1b5e0-7d54-4605-b9c3-679b3b98e913 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:54.155382 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1b5e0-7d54-4605-b9c3-679b3b98e913 admin admin] PATH_INFO: `/v3/users/00ea234ad5f54cf680cfc0bce447fe52` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:54.156575 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1b5e0-7d54-4605-b9c3-679b3b98e913 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00ea234ad5f54cf680cfc0bce447fe52)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:54.158564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1b5e0-7d54-4605-b9c3-679b3b98e913 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:54.202550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-35d1b5e0-7d54-4605-b9c3-679b3b98e913 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00ea234ad5f54cf680cfc0bce447fe52'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:54.213505 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-35d1b5e0-7d54-4605-b9c3-679b3b98e913 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00ea234ad5f54cf680cfc0bce447fe52'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:54.214164 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-35d1b5e0-7d54-4605-b9c3-679b3b98e913 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00ea234ad5f54cf680cfc0bce447fe52'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:54.220971 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-35d1b5e0-7d54-4605-b9c3-679b3b98e913 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00ea234ad5f54cf680cfc0bce447fe52'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:54.227679 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-35d1b5e0-7d54-4605-b9c3-679b3b98e913 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00ea234ad5f54cf680cfc0bce447fe52'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:54.233306 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1414/2831] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:51:54 2022] DELETE /identity/v3/users/00ea234ad5f54cf680cfc0bce447fe52 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:51:54.487239 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898b23c-98b1-4775-a836-bf735e1ba6bd admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:54.488747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-f898b23c-98b1-4775-a836-bf735e1ba6bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:54.504683 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898b23c-98b1-4775-a836-bf735e1ba6bd admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:54.562379 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959d318-cf9a-49ff-9b7c-3db3d635ec0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:54.563523 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959d318-cf9a-49ff-9b7c-3db3d635ec0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:54.563792 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959d318-cf9a-49ff-9b7c-3db3d635ec0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:54.564073 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959d318-cf9a-49ff-9b7c-3db3d635ec0e admin admin] PATH_INFO: `/v3/projects/22f2a9dfd7e642ca852ea8879bbec334` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:54.565284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959d318-cf9a-49ff-9b7c-3db3d635ec0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=22f2a9dfd7e642ca852ea8879bbec334)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:54.567218 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959d318-cf9a-49ff-9b7c-3db3d635ec0e admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:54.612387 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-b959d318-cf9a-49ff-9b7c-3db3d635ec0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22f2a9dfd7e642ca852ea8879bbec334', 'request_id': 'req-b959d318-cf9a-49ff-9b7c-3db3d635ec0e'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:54.619021 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-b959d318-cf9a-49ff-9b7c-3db3d635ec0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22f2a9dfd7e642ca852ea8879bbec334', 'request_id': 'req-b959d318-cf9a-49ff-9b7c-3db3d635ec0e'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:54.626274 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-b959d318-cf9a-49ff-9b7c-3db3d635ec0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22f2a9dfd7e642ca852ea8879bbec334', 'request_id': 'req-b959d318-cf9a-49ff-9b7c-3db3d635ec0e'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:54.639001 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-b959d318-cf9a-49ff-9b7c-3db3d635ec0e admin admin] The token cache is being invalidate because project 22f2a9dfd7e642ca852ea8879bbec334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:51:54.639361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-b959d318-cf9a-49ff-9b7c-3db3d635ec0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:54.639972 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-b959d318-cf9a-49ff-9b7c-3db3d635ec0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:54.642060 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1418/2832] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:51:54 2022] DELETE /identity/v3/projects/22f2a9dfd7e642ca852ea8879bbec334 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:51:54.646876 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43775d-bcb8-4bd1-bfb6-f6a20df5a117 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:54.647250 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43775d-bcb8-4bd1-bfb6-f6a20df5a117 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:54.647591 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43775d-bcb8-4bd1-bfb6-f6a20df5a117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:54.665626 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-eb43775d-bcb8-4bd1-bfb6-f6a20df5a117 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:51:54.666927 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-eb43775d-bcb8-4bd1-bfb6-f6a20df5a117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:54.724024 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1415/2833] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:51:54.732049 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a584f-8da9-41c3-a0f3-ea9844b74f1e None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:54.732336 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a584f-8da9-41c3-a0f3-ea9844b74f1e None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:54.732635 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a584f-8da9-41c3-a0f3-ea9844b74f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:54.751321 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-450a584f-8da9-41c3-a0f3-ea9844b74f1e None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:51:54.752518 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-450a584f-8da9-41c3-a0f3-ea9844b74f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:54.760698 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1419/2834] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:51:54.765075 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43775d-bcb8-4bd1-bfb6-f6a20df5a117 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:54.775490 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43775d-bcb8-4bd1-bfb6-f6a20df5a117 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:54.781734 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88603136-555f-4b35-a171-1ee979127ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:54.782452 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88603136-555f-4b35-a171-1ee979127ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:54.782739 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88603136-555f-4b35-a171-1ee979127ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:54.783016 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88603136-555f-4b35-a171-1ee979127ed4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:54.783743 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88603136-555f-4b35-a171-1ee979127ed4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79816) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:51:54.784054 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88603136-555f-4b35-a171-1ee979127ed4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:54.785704 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88603136-555f-4b35-a171-1ee979127ed4 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:54.797822 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1416/2835] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:51:54.802175 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a584f-8da9-41c3-a0f3-ea9844b74f1e None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:54.811717 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a584f-8da9-41c3-a0f3-ea9844b74f1e None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:54.816402 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a5240-66ca-4c56-840a-1e7c78856cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:54.817049 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a5240-66ca-4c56-840a-1e7c78856cfa admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:54.817329 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a5240-66ca-4c56-840a-1e7c78856cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:54.817600 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a5240-66ca-4c56-840a-1e7c78856cfa admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:54.818332 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a5240-66ca-4c56-840a-1e7c78856cfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:54.820215 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a5240-66ca-4c56-840a-1e7c78856cfa admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:54.844112 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1420/2836] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:51:54 2022] POST /identity/v3/projects => generated 379 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:51:54.848186 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88603136-555f-4b35-a171-1ee979127ed4 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:54.858406 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88603136-555f-4b35-a171-1ee979127ed4 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:54.912620 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72437a-3f64-4e88-bfb5-c8beaf414abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:54.913239 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72437a-3f64-4e88-bfb5-c8beaf414abd admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:54.913522 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72437a-3f64-4e88-bfb5-c8beaf414abd admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:54.913797 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72437a-3f64-4e88-bfb5-c8beaf414abd admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:54.915115 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72437a-3f64-4e88-bfb5-c8beaf414abd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:54.917022 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72437a-3f64-4e88-bfb5-c8beaf414abd admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:54.936512 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1417/2837] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:51:54 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:51:54.940554 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a5240-66ca-4c56-840a-1e7c78856cfa admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:54.950475 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a5240-66ca-4c56-840a-1e7c78856cfa admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:54.954995 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d1e37-63d9-4ac2-881e-2cebe55e4277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:54.955637 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d1e37-63d9-4ac2-881e-2cebe55e4277 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:54.955914 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d1e37-63d9-4ac2-881e-2cebe55e4277 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:54.956185 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d1e37-63d9-4ac2-881e-2cebe55e4277 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:54.956907 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d1e37-63d9-4ac2-881e-2cebe55e4277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:54.958522 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d1e37-63d9-4ac2-881e-2cebe55e4277 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:54.968868 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1421/2838] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:51:54.972598 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72437a-3f64-4e88-bfb5-c8beaf414abd admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:54.982931 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72437a-3f64-4e88-bfb5-c8beaf414abd admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:54.987593 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954152ab-5faf-4c0a-a8a5-651b29c8e1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:54.988250 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954152ab-5faf-4c0a-a8a5-651b29c8e1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:54.988537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954152ab-5faf-4c0a-a8a5-651b29c8e1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:54.988813 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954152ab-5faf-4c0a-a8a5-651b29c8e1c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:54.989533 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954152ab-5faf-4c0a-a8a5-651b29c8e1c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:54.991166 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954152ab-5faf-4c0a-a8a5-651b29c8e1c9 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:55.001529 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1418/2839] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:51:55.005297 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d1e37-63d9-4ac2-881e-2cebe55e4277 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:55.014898 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d1e37-63d9-4ac2-881e-2cebe55e4277 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:55.019658 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92262c-0c27-40e6-87a4-ee92519a0187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:55.020502 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92262c-0c27-40e6-87a4-ee92519a0187 admin admin] REQUEST_METHOD: `PUT` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:55.020777 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92262c-0c27-40e6-87a4-ee92519a0187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:55.021044 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92262c-0c27-40e6-87a4-ee92519a0187 admin admin] PATH_INFO: `/v3/projects/2d52245c9e88456fbee547f9a1d04981/users/10866af878bc497d9063ddd93063294a/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:55.035349 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92262c-0c27-40e6-87a4-ee92519a0187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d52245c9e88456fbee547f9a1d04981, user_id=10866af878bc497d9063ddd93063294a, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:55.037968 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92262c-0c27-40e6-87a4-ee92519a0187 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:55.050521 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1422/2840] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:51:55 2022] PUT /identity/v3/projects/2d52245c9e88456fbee547f9a1d04981/users/10866af878bc497d9063ddd93063294a/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:51:55.061531 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84770795-a71d-4549-be35-778bda80b35e None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:55.061950 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84770795-a71d-4549-be35-778bda80b35e None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:55.062233 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84770795-a71d-4549-be35-778bda80b35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:55.088007 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-84770795-a71d-4549-be35-778bda80b35e None None] MFA Rules not processed for user `10866af878bc497d9063ddd93063294a`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:51:55.089181 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-84770795-a71d-4549-be35-778bda80b35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:55.149824 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1419/2841] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:51:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:51:55.154226 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92262c-0c27-40e6-87a4-ee92519a0187 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:55.212023 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92262c-0c27-40e6-87a4-ee92519a0187 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:55.216657 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cb9db-0685-4437-96c2-0c8315b12e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:55.217293 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cb9db-0685-4437-96c2-0c8315b12e65 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:55.217571 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cb9db-0685-4437-96c2-0c8315b12e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:55.217842 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cb9db-0685-4437-96c2-0c8315b12e65 admin admin] PATH_INFO: `/v3/projects` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:55.218546 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813cb9db-0685-4437-96c2-0c8315b12e65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:55.220425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813cb9db-0685-4437-96c2-0c8315b12e65 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:55.245016 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1423/2842] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:51:55 2022] POST /identity/v3/projects => generated 379 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:51:55.248985 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84770795-a71d-4549-be35-778bda80b35e None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:55.259973 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84770795-a71d-4549-be35-778bda80b35e None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:55.313963 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06732993-13dc-4de9-b102-49f4f0e46d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:55.314620 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06732993-13dc-4de9-b102-49f4f0e46d20 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:55.314903 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06732993-13dc-4de9-b102-49f4f0e46d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:55.315172 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06732993-13dc-4de9-b102-49f4f0e46d20 admin admin] PATH_INFO: `/v3/users` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:55.315854 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06732993-13dc-4de9-b102-49f4f0e46d20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:55.317727 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06732993-13dc-4de9-b102-49f4f0e46d20 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:55.337499 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1420/2843] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:51:55 2022] POST /identity/v3/users => generated 296 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:51:55.341455 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cb9db-0685-4437-96c2-0c8315b12e65 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:55.351585 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cb9db-0685-4437-96c2-0c8315b12e65 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:55.356260 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda11ad-395c-44d7-a417-10f6528206a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:55.356911 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda11ad-395c-44d7-a417-10f6528206a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:55.357196 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda11ad-395c-44d7-a417-10f6528206a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:55.357474 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda11ad-395c-44d7-a417-10f6528206a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:55.358268 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda11ad-395c-44d7-a417-10f6528206a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:55.359848 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda11ad-395c-44d7-a417-10f6528206a6 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:55.369998 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1424/2844] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:51:55.373737 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06732993-13dc-4de9-b102-49f4f0e46d20 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:55.384127 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06732993-13dc-4de9-b102-49f4f0e46d20 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:55.388739 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a6931-8df5-4bff-9fca-340c2ee390c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:55.389604 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a6931-8df5-4bff-9fca-340c2ee390c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:55.389884 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a6931-8df5-4bff-9fca-340c2ee390c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:55.390187 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a6931-8df5-4bff-9fca-340c2ee390c1 admin admin] PATH_INFO: `/v3/projects/6db9350fc75e442783ad6bd4bad78bc7/users/00817a35f4a84c2b81b9c601067302b9/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:55.404852 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a6931-8df5-4bff-9fca-340c2ee390c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6db9350fc75e442783ad6bd4bad78bc7, user_id=00817a35f4a84c2b81b9c601067302b9, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:55.407490 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a6931-8df5-4bff-9fca-340c2ee390c1 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:55.420312 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1421/2845] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:51:55 2022] PUT /identity/v3/projects/6db9350fc75e442783ad6bd4bad78bc7/users/00817a35f4a84c2b81b9c601067302b9/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:51:55.424122 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda11ad-395c-44d7-a417-10f6528206a6 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:55.433877 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda11ad-395c-44d7-a417-10f6528206a6 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:55.487394 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed251ee-03da-49ff-85d5-86a37b805eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:55.488040 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed251ee-03da-49ff-85d5-86a37b805eda admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:55.488319 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed251ee-03da-49ff-85d5-86a37b805eda admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:55.488591 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed251ee-03da-49ff-85d5-86a37b805eda admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:55.489293 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed251ee-03da-49ff-85d5-86a37b805eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:55.490925 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed251ee-03da-49ff-85d5-86a37b805eda admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:55.500051 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1425/2846] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:51:55.504050 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a6931-8df5-4bff-9fca-340c2ee390c1 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:55.514505 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a6931-8df5-4bff-9fca-340c2ee390c1 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:55.519304 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d07ac2-bb1e-4e03-bd3d-0d305c504a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:55.520163 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d07ac2-bb1e-4e03-bd3d-0d305c504a43 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:55.520444 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d07ac2-bb1e-4e03-bd3d-0d305c504a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:55.520723 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d07ac2-bb1e-4e03-bd3d-0d305c504a43 admin admin] PATH_INFO: `/v3/projects/6db9350fc75e442783ad6bd4bad78bc7/users/00817a35f4a84c2b81b9c601067302b9/roles/8f01c4c38fa44034a54c1f8cd2d2db1a` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:55.522817 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d07ac2-bb1e-4e03-bd3d-0d305c504a43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6db9350fc75e442783ad6bd4bad78bc7, user_id=00817a35f4a84c2b81b9c601067302b9, role_id=8f01c4c38fa44034a54c1f8cd2d2db1a)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:55.526111 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d07ac2-bb1e-4e03-bd3d-0d305c504a43 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:55.536032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1422/2847] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:51:55 2022] PUT /identity/v3/projects/6db9350fc75e442783ad6bd4bad78bc7/users/00817a35f4a84c2b81b9c601067302b9/roles/8f01c4c38fa44034a54c1f8cd2d2db1a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:51:55.546150 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919dc45-663b-48ba-831a-63b092e70dd7 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:55.546441 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919dc45-663b-48ba-831a-63b092e70dd7 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:55.546723 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919dc45-663b-48ba-831a-63b092e70dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:55.573806 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-5919dc45-663b-48ba-831a-63b092e70dd7 None None] MFA Rules not processed for user `00817a35f4a84c2b81b9c601067302b9`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:51:55.575034 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-5919dc45-663b-48ba-831a-63b092e70dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:55.640031 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1426/2848] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:51:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:51:55.651865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d07ac2-bb1e-4e03-bd3d-0d305c504a43 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:55.653573 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-91d07ac2-bb1e-4e03-bd3d-0d305c504a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:55.708482 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d07ac2-bb1e-4e03-bd3d-0d305c504a43 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:55.712240 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f7fcb-53f5-41fe-99e5-951c35b3cdd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:55.712869 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f7fcb-53f5-41fe-99e5-951c35b3cdd5 service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:55.713154 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f7fcb-53f5-41fe-99e5-951c35b3cdd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:55.713430 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f7fcb-53f5-41fe-99e5-951c35b3cdd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:55.722155 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f7fcb-53f5-41fe-99e5-951c35b3cdd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:55.723560 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f7fcb-53f5-41fe-99e5-951c35b3cdd5 service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:55.732702 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1423/2849] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:51:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:51:56.087088 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5919dc45-663b-48ba-831a-63b092e70dd7 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:56.147672 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5919dc45-663b-48ba-831a-63b092e70dd7 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:56.152319 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3920d-f59b-4fcf-8538-af98f66db8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:56.153179 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3920d-f59b-4fcf-8538-af98f66db8a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:56.153456 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3920d-f59b-4fcf-8538-af98f66db8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:56.153734 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3920d-f59b-4fcf-8538-af98f66db8a5 admin admin] PATH_INFO: `/v3/users/10866af878bc497d9063ddd93063294a` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:56.154948 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3920d-f59b-4fcf-8538-af98f66db8a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10866af878bc497d9063ddd93063294a)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:56.156851 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3920d-f59b-4fcf-8538-af98f66db8a5 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:56.200797 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-00f3920d-f59b-4fcf-8538-af98f66db8a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10866af878bc497d9063ddd93063294a'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:56.211755 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-00f3920d-f59b-4fcf-8538-af98f66db8a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10866af878bc497d9063ddd93063294a'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:56.212399 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-00f3920d-f59b-4fcf-8538-af98f66db8a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10866af878bc497d9063ddd93063294a'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:56.219332 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-00f3920d-f59b-4fcf-8538-af98f66db8a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10866af878bc497d9063ddd93063294a'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:56.225781 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-00f3920d-f59b-4fcf-8538-af98f66db8a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10866af878bc497d9063ddd93063294a'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:56.231960 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1427/2850] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:51:56 2022] DELETE /identity/v3/users/10866af878bc497d9063ddd93063294a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:51:56.236532 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91055f09-8e85-4377-866d-348bfd6de4f1 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:56.236846 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91055f09-8e85-4377-866d-348bfd6de4f1 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:56.237120 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91055f09-8e85-4377-866d-348bfd6de4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:56.254770 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-91055f09-8e85-4377-866d-348bfd6de4f1 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:51:56.255891 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-91055f09-8e85-4377-866d-348bfd6de4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:56.312098 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1424/2851] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:51:56.321591 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3920d-f59b-4fcf-8538-af98f66db8a5 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:56.323004 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-00f3920d-f59b-4fcf-8538-af98f66db8a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:56.377706 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3920d-f59b-4fcf-8538-af98f66db8a5 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:56.381269 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7a73a-ed65-4953-8329-1356141ff10a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:56.381917 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7a73a-ed65-4953-8329-1356141ff10a service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:56.382215 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7a73a-ed65-4953-8329-1356141ff10a service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:56.382485 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7a73a-ed65-4953-8329-1356141ff10a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:56.391249 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7a73a-ed65-4953-8329-1356141ff10a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:56.392912 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7a73a-ed65-4953-8329-1356141ff10a service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:56.402531 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1428/2852] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:51:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:51:56.663280 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91055f09-8e85-4377-866d-348bfd6de4f1 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:56.665416 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-91055f09-8e85-4377-866d-348bfd6de4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:56.683075 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91055f09-8e85-4377-866d-348bfd6de4f1 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:56.687930 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8d698-588f-4af9-b83b-fe902d2e8f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:56.688799 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8d698-588f-4af9-b83b-fe902d2e8f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:56.689080 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8d698-588f-4af9-b83b-fe902d2e8f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:56.689354 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8d698-588f-4af9-b83b-fe902d2e8f84 admin admin] PATH_INFO: `/v3/projects/2d52245c9e88456fbee547f9a1d04981` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:56.690548 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8d698-588f-4af9-b83b-fe902d2e8f84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d52245c9e88456fbee547f9a1d04981)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:56.692510 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8d698-588f-4af9-b83b-fe902d2e8f84 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:56.738537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-5fa8d698-588f-4af9-b83b-fe902d2e8f84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d52245c9e88456fbee547f9a1d04981', 'request_id': 'req-5fa8d698-588f-4af9-b83b-fe902d2e8f84'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:56.743698 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-5fa8d698-588f-4af9-b83b-fe902d2e8f84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d52245c9e88456fbee547f9a1d04981', 'request_id': 'req-5fa8d698-588f-4af9-b83b-fe902d2e8f84'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:56.750124 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-5fa8d698-588f-4af9-b83b-fe902d2e8f84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d52245c9e88456fbee547f9a1d04981', 'request_id': 'req-5fa8d698-588f-4af9-b83b-fe902d2e8f84'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:56.761037 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-5fa8d698-588f-4af9-b83b-fe902d2e8f84 admin admin] The token cache is being invalidate because project 2d52245c9e88456fbee547f9a1d04981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:51:56.761318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-5fa8d698-588f-4af9-b83b-fe902d2e8f84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:56.761950 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-5fa8d698-588f-4af9-b83b-fe902d2e8f84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:56.763498 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1425/2853] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:51:56 2022] DELETE /identity/v3/projects/2d52245c9e88456fbee547f9a1d04981 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:51:56.767697 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7a73a-ed65-4953-8329-1356141ff10a service neutron] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:56.777529 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7a73a-ed65-4953-8329-1356141ff10a service neutron] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:56.831385 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db4d7f-7f31-4196-89e5-3b35539be0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:56.832179 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db4d7f-7f31-4196-89e5-3b35539be0cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:56.832460 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db4d7f-7f31-4196-89e5-3b35539be0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:56.832734 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db4d7f-7f31-4196-89e5-3b35539be0cd admin admin] PATH_INFO: `/v3/users/00817a35f4a84c2b81b9c601067302b9` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:56.833922 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db4d7f-7f31-4196-89e5-3b35539be0cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=00817a35f4a84c2b81b9c601067302b9)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:56.835865 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db4d7f-7f31-4196-89e5-3b35539be0cd admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:56.879792 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-87db4d7f-7f31-4196-89e5-3b35539be0cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00817a35f4a84c2b81b9c601067302b9'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:56.891722 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-87db4d7f-7f31-4196-89e5-3b35539be0cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00817a35f4a84c2b81b9c601067302b9'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:56.892380 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-87db4d7f-7f31-4196-89e5-3b35539be0cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00817a35f4a84c2b81b9c601067302b9'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:56.899971 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-87db4d7f-7f31-4196-89e5-3b35539be0cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00817a35f4a84c2b81b9c601067302b9'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:56.906885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-87db4d7f-7f31-4196-89e5-3b35539be0cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00817a35f4a84c2b81b9c601067302b9'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:56.912675 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1429/2854] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:51:56 2022] DELETE /identity/v3/users/00817a35f4a84c2b81b9c601067302b9 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:51:57.235613 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8d698-588f-4af9-b83b-fe902d2e8f84 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:57.237096 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-5fa8d698-588f-4af9-b83b-fe902d2e8f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:57.251386 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8d698-588f-4af9-b83b-fe902d2e8f84 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:57.308104 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e80c8-8e90-4413-95bb-aed6f70ccbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:57.308993 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e80c8-8e90-4413-95bb-aed6f70ccbbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:57.309273 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e80c8-8e90-4413-95bb-aed6f70ccbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:57.309545 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e80c8-8e90-4413-95bb-aed6f70ccbbf admin admin] PATH_INFO: `/v3/projects/6db9350fc75e442783ad6bd4bad78bc7` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:57.310756 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e80c8-8e90-4413-95bb-aed6f70ccbbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6db9350fc75e442783ad6bd4bad78bc7)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:57.312640 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e80c8-8e90-4413-95bb-aed6f70ccbbf admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:57.356195 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-691e80c8-8e90-4413-95bb-aed6f70ccbbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6db9350fc75e442783ad6bd4bad78bc7', 'request_id': 'req-691e80c8-8e90-4413-95bb-aed6f70ccbbf'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:57.361345 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-691e80c8-8e90-4413-95bb-aed6f70ccbbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6db9350fc75e442783ad6bd4bad78bc7', 'request_id': 'req-691e80c8-8e90-4413-95bb-aed6f70ccbbf'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:57.368706 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-691e80c8-8e90-4413-95bb-aed6f70ccbbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6db9350fc75e442783ad6bd4bad78bc7', 'request_id': 'req-691e80c8-8e90-4413-95bb-aed6f70ccbbf'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:57.379234 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-691e80c8-8e90-4413-95bb-aed6f70ccbbf admin admin] The token cache is being invalidate because project 6db9350fc75e442783ad6bd4bad78bc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:51:57.379564 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-691e80c8-8e90-4413-95bb-aed6f70ccbbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:57.380169 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-691e80c8-8e90-4413-95bb-aed6f70ccbbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:57.381709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1426/2855] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:51:57 2022] DELETE /identity/v3/projects/6db9350fc75e442783ad6bd4bad78bc7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:51:57.387205 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89584a-30fd-4c83-96fa-a9e0f5bcd2a0 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:57.387490 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89584a-30fd-4c83-96fa-a9e0f5bcd2a0 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:57.387814 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89584a-30fd-4c83-96fa-a9e0f5bcd2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:57.404838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-ca89584a-30fd-4c83-96fa-a9e0f5bcd2a0 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:51:57.406044 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-ca89584a-30fd-4c83-96fa-a9e0f5bcd2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:57.462820 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1430/2856] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:51:57.471576 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636530d-0983-4f76-b224-14d0fa5fc942 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:57.471861 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636530d-0983-4f76-b224-14d0fa5fc942 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:57.472135 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636530d-0983-4f76-b224-14d0fa5fc942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:57.489865 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-5636530d-0983-4f76-b224-14d0fa5fc942 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:51:57.491068 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-5636530d-0983-4f76-b224-14d0fa5fc942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:57.499489 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1427/2857] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:51:57.503581 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89584a-30fd-4c83-96fa-a9e0f5bcd2a0 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:57.513607 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89584a-30fd-4c83-96fa-a9e0f5bcd2a0 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:57.518320 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96fe71-a895-4717-bd70-f5d851e248c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:57.518954 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96fe71-a895-4717-bd70-f5d851e248c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:57.519232 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96fe71-a895-4717-bd70-f5d851e248c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:57.519498 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96fe71-a895-4717-bd70-f5d851e248c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:57.520211 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96fe71-a895-4717-bd70-f5d851e248c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:51:57.520515 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96fe71-a895-4717-bd70-f5d851e248c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:57.522105 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96fe71-a895-4717-bd70-f5d851e248c1 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:57.533034 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1431/2858] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:51:57.537039 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5636530d-0983-4f76-b224-14d0fa5fc942 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:57.546530 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5636530d-0983-4f76-b224-14d0fa5fc942 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:57.551073 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc25681-80d7-4b23-a9aa-68858583b012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:57.551731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc25681-80d7-4b23-a9aa-68858583b012 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:57.552011 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc25681-80d7-4b23-a9aa-68858583b012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:57.552281 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc25681-80d7-4b23-a9aa-68858583b012 admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:57.552962 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc25681-80d7-4b23-a9aa-68858583b012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:57.554935 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc25681-80d7-4b23-a9aa-68858583b012 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:57.579900 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1428/2859] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:51:57 2022] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:51:57.583936 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96fe71-a895-4717-bd70-f5d851e248c1 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:57.599080 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96fe71-a895-4717-bd70-f5d851e248c1 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:57.653426 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648db2d-6588-43ad-9361-ab56989f9f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:57.654024 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648db2d-6588-43ad-9361-ab56989f9f91 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:57.654306 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648db2d-6588-43ad-9361-ab56989f9f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:57.654581 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648db2d-6588-43ad-9361-ab56989f9f91 admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:57.655273 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648db2d-6588-43ad-9361-ab56989f9f91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:57.657171 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648db2d-6588-43ad-9361-ab56989f9f91 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:57.676407 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1432/2860] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:51:57 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:51:57.681365 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc25681-80d7-4b23-a9aa-68858583b012 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:57.691491 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc25681-80d7-4b23-a9aa-68858583b012 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:57.696032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a78b26-f893-4bcc-a8bb-9a9ea6081ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:57.696684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a78b26-f893-4bcc-a8bb-9a9ea6081ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:57.696968 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a78b26-f893-4bcc-a8bb-9a9ea6081ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:57.697240 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a78b26-f893-4bcc-a8bb-9a9ea6081ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:57.698005 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a78b26-f893-4bcc-a8bb-9a9ea6081ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:57.699584 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a78b26-f893-4bcc-a8bb-9a9ea6081ea6 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:57.709641 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1429/2861] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:51:57.713874 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648db2d-6588-43ad-9361-ab56989f9f91 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:57.723823 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648db2d-6588-43ad-9361-ab56989f9f91 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:57.729047 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd44c1-7ad5-4f5e-b9f0-d1f30bcc6232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:57.729694 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd44c1-7ad5-4f5e-b9f0-d1f30bcc6232 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:57.730011 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd44c1-7ad5-4f5e-b9f0-d1f30bcc6232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:57.730296 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd44c1-7ad5-4f5e-b9f0-d1f30bcc6232 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:57.731025 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd44c1-7ad5-4f5e-b9f0-d1f30bcc6232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:57.732648 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd44c1-7ad5-4f5e-b9f0-d1f30bcc6232 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:57.742455 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1433/2862] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:51:57.746918 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a78b26-f893-4bcc-a8bb-9a9ea6081ea6 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:57.756628 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a78b26-f893-4bcc-a8bb-9a9ea6081ea6 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:57.761281 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7b737-7cb0-4d70-be9a-02f898a46654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:57.762188 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7b737-7cb0-4d70-be9a-02f898a46654 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:57.762472 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7b737-7cb0-4d70-be9a-02f898a46654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:57.762746 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7b737-7cb0-4d70-be9a-02f898a46654 admin admin] PATH_INFO: `/v3/projects/2978c3148b224f568dfc5e12217a6922/users/3c0ed3bfe1c440e49c095687ba317fb3/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:57.776708 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7b737-7cb0-4d70-be9a-02f898a46654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2978c3148b224f568dfc5e12217a6922, user_id=3c0ed3bfe1c440e49c095687ba317fb3, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:57.779908 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7b737-7cb0-4d70-be9a-02f898a46654 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:57.793474 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1430/2863] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:51:57 2022] PUT /identity/v3/projects/2978c3148b224f568dfc5e12217a6922/users/3c0ed3bfe1c440e49c095687ba317fb3/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:51:57.803425 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa272e-1304-454a-b2f1-349c5bd1ce45 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:57.803927 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa272e-1304-454a-b2f1-349c5bd1ce45 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:57.804063 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa272e-1304-454a-b2f1-349c5bd1ce45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:57.834545 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-18fa272e-1304-454a-b2f1-349c5bd1ce45 None None] MFA Rules not processed for user `3c0ed3bfe1c440e49c095687ba317fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:51:57.835735 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-18fa272e-1304-454a-b2f1-349c5bd1ce45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:57.896191 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1434/2864] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:51:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:51:57.907087 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7b737-7cb0-4d70-be9a-02f898a46654 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:57.908656 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-93d7b737-7cb0-4d70-be9a-02f898a46654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:57.969159 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7b737-7cb0-4d70-be9a-02f898a46654 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:57.972815 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99ef18-4f37-48c2-9e13-ac5ef9857595 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:57.973456 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99ef18-4f37-48c2-9e13-ac5ef9857595 service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:57.973734 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99ef18-4f37-48c2-9e13-ac5ef9857595 service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:57.974032 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99ef18-4f37-48c2-9e13-ac5ef9857595 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:57.982661 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99ef18-4f37-48c2-9e13-ac5ef9857595 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:57.984068 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99ef18-4f37-48c2-9e13-ac5ef9857595 service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:57.993320 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1431/2865] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:51:57 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:51:58.015485 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa272e-1304-454a-b2f1-349c5bd1ce45 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:58.076018 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa272e-1304-454a-b2f1-349c5bd1ce45 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:58.080577 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89ad9f-b7d2-43e4-aec0-ebb1e1fbd4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:58.081518 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89ad9f-b7d2-43e4-aec0-ebb1e1fbd4d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:58.081802 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89ad9f-b7d2-43e4-aec0-ebb1e1fbd4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:58.082112 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89ad9f-b7d2-43e4-aec0-ebb1e1fbd4d1 admin admin] PATH_INFO: `/v3/users/3c0ed3bfe1c440e49c095687ba317fb3` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:58.083320 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb89ad9f-b7d2-43e4-aec0-ebb1e1fbd4d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c0ed3bfe1c440e49c095687ba317fb3)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:58.085285 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb89ad9f-b7d2-43e4-aec0-ebb1e1fbd4d1 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:58.131174 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-eb89ad9f-b7d2-43e4-aec0-ebb1e1fbd4d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c0ed3bfe1c440e49c095687ba317fb3'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:58.142519 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-eb89ad9f-b7d2-43e4-aec0-ebb1e1fbd4d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c0ed3bfe1c440e49c095687ba317fb3'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:58.143193 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-eb89ad9f-b7d2-43e4-aec0-ebb1e1fbd4d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c0ed3bfe1c440e49c095687ba317fb3'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:58.149747 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-eb89ad9f-b7d2-43e4-aec0-ebb1e1fbd4d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c0ed3bfe1c440e49c095687ba317fb3'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:58.156167 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-eb89ad9f-b7d2-43e4-aec0-ebb1e1fbd4d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c0ed3bfe1c440e49c095687ba317fb3'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:58.161940 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1435/2866] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:51:58 2022] DELETE /identity/v3/users/3c0ed3bfe1c440e49c095687ba317fb3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:51:58.166968 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbc494-d02e-4791-b7a1-bbe79483606e None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:58.167260 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbc494-d02e-4791-b7a1-bbe79483606e None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:58.167537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbc494-d02e-4791-b7a1-bbe79483606e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:58.185125 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-debbc494-d02e-4791-b7a1-bbe79483606e None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:51:58.186329 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-debbc494-d02e-4791-b7a1-bbe79483606e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:58.243413 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1432/2867] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:51:58.254322 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89ad9f-b7d2-43e4-aec0-ebb1e1fbd4d1 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:58.255713 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-eb89ad9f-b7d2-43e4-aec0-ebb1e1fbd4d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:58.314639 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89ad9f-b7d2-43e4-aec0-ebb1e1fbd4d1 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:58.318272 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be76e4-1c50-49cd-9bbd-9fb13e15a459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:58.318940 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be76e4-1c50-49cd-9bbd-9fb13e15a459 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:58.319199 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be76e4-1c50-49cd-9bbd-9fb13e15a459 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:58.319450 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be76e4-1c50-49cd-9bbd-9fb13e15a459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:58.329087 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be76e4-1c50-49cd-9bbd-9fb13e15a459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:58.330679 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be76e4-1c50-49cd-9bbd-9fb13e15a459 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:58.340959 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1436/2868] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:51:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:51:58.611314 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbc494-d02e-4791-b7a1-bbe79483606e None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:58.613272 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-debbc494-d02e-4791-b7a1-bbe79483606e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:58.630636 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbc494-d02e-4791-b7a1-bbe79483606e None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:58.636417 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2fea07-1210-464d-967e-7c60d1750f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:58.637401 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fea07-1210-464d-967e-7c60d1750f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:58.637797 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fea07-1210-464d-967e-7c60d1750f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:58.638202 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fea07-1210-464d-967e-7c60d1750f9a admin admin] PATH_INFO: `/v3/projects/2978c3148b224f568dfc5e12217a6922` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:58.639755 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2fea07-1210-464d-967e-7c60d1750f9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2978c3148b224f568dfc5e12217a6922)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:58.642318 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2fea07-1210-464d-967e-7c60d1750f9a admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:58.643243 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be76e4-1c50-49cd-9bbd-9fb13e15a459 service neutron] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:58.644629 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-08be76e4-1c50-49cd-9bbd-9fb13e15a459 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:58.702212 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-df2fea07-1210-464d-967e-7c60d1750f9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2978c3148b224f568dfc5e12217a6922', 'request_id': 'req-df2fea07-1210-464d-967e-7c60d1750f9a'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:58.707964 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-df2fea07-1210-464d-967e-7c60d1750f9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2978c3148b224f568dfc5e12217a6922', 'request_id': 'req-df2fea07-1210-464d-967e-7c60d1750f9a'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:58.716495 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-df2fea07-1210-464d-967e-7c60d1750f9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2978c3148b224f568dfc5e12217a6922', 'request_id': 'req-df2fea07-1210-464d-967e-7c60d1750f9a'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:58.726225 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be76e4-1c50-49cd-9bbd-9fb13e15a459 service neutron] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:58.727940 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-df2fea07-1210-464d-967e-7c60d1750f9a admin admin] The token cache is being invalidate because project 2978c3148b224f568dfc5e12217a6922 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:51:58.728226 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-df2fea07-1210-464d-967e-7c60d1750f9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:58.728858 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-df2fea07-1210-464d-967e-7c60d1750f9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:58.730450 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1433/2869] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:51:58 2022] DELETE /identity/v3/projects/2978c3148b224f568dfc5e12217a6922 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:51:58.735773 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7c0bd-007b-46f5-8b20-31eff61714c7 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:58.736107 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7c0bd-007b-46f5-8b20-31eff61714c7 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:58.736331 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7c0bd-007b-46f5-8b20-31eff61714c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:58.753949 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-bbb7c0bd-007b-46f5-8b20-31eff61714c7 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:51:58.755139 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-bbb7c0bd-007b-46f5-8b20-31eff61714c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:58.789673 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b07721-9d50-48bd-90e3-cf33537b499b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:58.790412 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b07721-9d50-48bd-90e3-cf33537b499b service nova] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:58.790689 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b07721-9d50-48bd-90e3-cf33537b499b service nova] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:58.790957 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b07721-9d50-48bd-90e3-cf33537b499b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:58.792806 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-82b07721-9d50-48bd-90e3-cf33537b499b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:58.804615 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b07721-9d50-48bd-90e3-cf33537b499b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:58.806244 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b07721-9d50-48bd-90e3-cf33537b499b service nova] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:58.812898 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1434/2870] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:51:58.816584 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1437/2871] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:51:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 09:51:58.820311 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dea69-21a8-4639-9620-8a8c26b79c8c None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:58.821124 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dea69-21a8-4639-9620-8a8c26b79c8c None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:58.821399 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dea69-21a8-4639-9620-8a8c26b79c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:58.840022 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-f04dea69-21a8-4639-9620-8a8c26b79c8c None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:51:58.841326 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-f04dea69-21a8-4639-9620-8a8c26b79c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:58.851957 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1435/2872] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:51:58.856114 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b07721-9d50-48bd-90e3-cf33537b499b service nova] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:58.866607 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b07721-9d50-48bd-90e3-cf33537b499b service nova] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:58.871099 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e698c39-81e0-4aef-b1e9-6e92dab953f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:58.871735 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e698c39-81e0-4aef-b1e9-6e92dab953f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:58.872014 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e698c39-81e0-4aef-b1e9-6e92dab953f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:58.872284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e698c39-81e0-4aef-b1e9-6e92dab953f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:58.873026 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e698c39-81e0-4aef-b1e9-6e92dab953f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:51:58.873329 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e698c39-81e0-4aef-b1e9-6e92dab953f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:58.874943 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e698c39-81e0-4aef-b1e9-6e92dab953f1 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:58.886908 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1438/2873] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:51:58.891074 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04dea69-21a8-4639-9620-8a8c26b79c8c None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:58.901067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04dea69-21a8-4639-9620-8a8c26b79c8c None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:58.905748 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1992c8-7502-40e1-b1f7-82a96323a513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:58.906433 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1992c8-7502-40e1-b1f7-82a96323a513 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:58.906758 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1992c8-7502-40e1-b1f7-82a96323a513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:58.906994 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1992c8-7502-40e1-b1f7-82a96323a513 admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:58.907694 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1992c8-7502-40e1-b1f7-82a96323a513 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:58.909575 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1992c8-7502-40e1-b1f7-82a96323a513 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:58.934081 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1436/2874] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:51:58 2022] POST /identity/v3/projects => generated 361 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:51:58.938289 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e698c39-81e0-4aef-b1e9-6e92dab953f1 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:58.948456 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e698c39-81e0-4aef-b1e9-6e92dab953f1 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:59.010816 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be220066-2adb-43ec-bca0-6b7da2690696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:59.011493 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be220066-2adb-43ec-bca0-6b7da2690696 admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:59.011771 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be220066-2adb-43ec-bca0-6b7da2690696 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:59.012039 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be220066-2adb-43ec-bca0-6b7da2690696 admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:59.012933 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be220066-2adb-43ec-bca0-6b7da2690696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:59.014885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be220066-2adb-43ec-bca0-6b7da2690696 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:59.036780 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1439/2875] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:51:58 2022] POST /identity/v3/users => generated 281 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 09:51:59.040803 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1992c8-7502-40e1-b1f7-82a96323a513 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:59.051018 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1992c8-7502-40e1-b1f7-82a96323a513 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:59.056191 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52d2d8-966b-448d-8e51-0d18bee37a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:59.056874 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52d2d8-966b-448d-8e51-0d18bee37a27 admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:59.057148 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52d2d8-966b-448d-8e51-0d18bee37a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:59.057454 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52d2d8-966b-448d-8e51-0d18bee37a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:59.058176 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52d2d8-966b-448d-8e51-0d18bee37a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:59.059772 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52d2d8-966b-448d-8e51-0d18bee37a27 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:59.070381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1437/2876] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:51:59.074904 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be220066-2adb-43ec-bca0-6b7da2690696 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:59.085026 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be220066-2adb-43ec-bca0-6b7da2690696 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:59.089590 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a2db2-30af-4ba3-bb91-ef16523f5aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:59.090270 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a2db2-30af-4ba3-bb91-ef16523f5aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:59.090552 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a2db2-30af-4ba3-bb91-ef16523f5aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:59.090825 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a2db2-30af-4ba3-bb91-ef16523f5aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:59.091576 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a2db2-30af-4ba3-bb91-ef16523f5aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:59.093168 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a2db2-30af-4ba3-bb91-ef16523f5aa1 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:59.107045 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1440/2877] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 09:51:59.111166 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52d2d8-966b-448d-8e51-0d18bee37a27 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:59.121685 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52d2d8-966b-448d-8e51-0d18bee37a27 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:59.126347 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc68f4d-fe78-4d7e-a2ed-1749814538b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:59.127225 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc68f4d-fe78-4d7e-a2ed-1749814538b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:59.127508 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc68f4d-fe78-4d7e-a2ed-1749814538b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:59.127781 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc68f4d-fe78-4d7e-a2ed-1749814538b9 admin admin] PATH_INFO: `/v3/projects/62008bdcfc094569ad8a720ac787d615/users/bc5d1bb4bb5849b9a48883a5108e676b/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:59.142863 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc68f4d-fe78-4d7e-a2ed-1749814538b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62008bdcfc094569ad8a720ac787d615, user_id=bc5d1bb4bb5849b9a48883a5108e676b, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:59.145557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc68f4d-fe78-4d7e-a2ed-1749814538b9 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:59.157788 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1438/2878] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:51:59 2022] PUT /identity/v3/projects/62008bdcfc094569ad8a720ac787d615/users/bc5d1bb4bb5849b9a48883a5108e676b/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:51:59.216764 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc338dd2-3524-4a28-82b4-a944e91916ac None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:59.216764 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc338dd2-3524-4a28-82b4-a944e91916ac None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:59.217043 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc338dd2-3524-4a28-82b4-a944e91916ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:59.243436 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-fc338dd2-3524-4a28-82b4-a944e91916ac None None] MFA Rules not processed for user `bc5d1bb4bb5849b9a48883a5108e676b`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:51:59.244639 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-fc338dd2-3524-4a28-82b4-a944e91916ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:59.306333 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1441/2879] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:51:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:51:59.336582 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc68f4d-fe78-4d7e-a2ed-1749814538b9 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:59.338269 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-5fc68f4d-fe78-4d7e-a2ed-1749814538b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:59.393482 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc68f4d-fe78-4d7e-a2ed-1749814538b9 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:59.397253 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e4d12-ec13-439a-a91f-6791da749149 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:59.397992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e4d12-ec13-439a-a91f-6791da749149 service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:59.398211 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e4d12-ec13-439a-a91f-6791da749149 service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:59.398489 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e4d12-ec13-439a-a91f-6791da749149 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:59.407017 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e4d12-ec13-439a-a91f-6791da749149 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:59.408440 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e4d12-ec13-439a-a91f-6791da749149 service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:59.417845 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1439/2880] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:51:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:51:59.432547 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc338dd2-3524-4a28-82b4-a944e91916ac None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:59.493095 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc338dd2-3524-4a28-82b4-a944e91916ac None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:59.498640 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3f7f0-e78d-4391-9aaa-125cee68efc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:59.499504 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3f7f0-e78d-4391-9aaa-125cee68efc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:59.499778 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3f7f0-e78d-4391-9aaa-125cee68efc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:59.500048 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3f7f0-e78d-4391-9aaa-125cee68efc4 admin admin] PATH_INFO: `/v3/users/bc5d1bb4bb5849b9a48883a5108e676b` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:59.501240 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3f7f0-e78d-4391-9aaa-125cee68efc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc5d1bb4bb5849b9a48883a5108e676b)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:59.503387 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3f7f0-e78d-4391-9aaa-125cee68efc4 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:59.548936 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-19b3f7f0-e78d-4391-9aaa-125cee68efc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc5d1bb4bb5849b9a48883a5108e676b'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:59.560906 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-19b3f7f0-e78d-4391-9aaa-125cee68efc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc5d1bb4bb5849b9a48883a5108e676b'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:59.561523 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-19b3f7f0-e78d-4391-9aaa-125cee68efc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc5d1bb4bb5849b9a48883a5108e676b'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:59.569139 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-19b3f7f0-e78d-4391-9aaa-125cee68efc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc5d1bb4bb5849b9a48883a5108e676b'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:59.575857 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-19b3f7f0-e78d-4391-9aaa-125cee68efc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc5d1bb4bb5849b9a48883a5108e676b'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:51:59.581593 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1442/2881] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:51:59 2022] DELETE /identity/v3/users/bc5d1bb4bb5849b9a48883a5108e676b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:51:59.586096 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab6cc7-2ec9-4508-b5fc-1df15b19b3f6 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:59.586392 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab6cc7-2ec9-4508-b5fc-1df15b19b3f6 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:59.586695 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab6cc7-2ec9-4508-b5fc-1df15b19b3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:59.604230 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-b2ab6cc7-2ec9-4508-b5fc-1df15b19b3f6 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:51:59.605413 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-b2ab6cc7-2ec9-4508-b5fc-1df15b19b3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:59.664062 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1440/2882] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:51:59.674175 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3f7f0-e78d-4391-9aaa-125cee68efc4 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:51:59.675549 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-19b3f7f0-e78d-4391-9aaa-125cee68efc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:51:59.729929 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3f7f0-e78d-4391-9aaa-125cee68efc4 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:51:59.733463 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc21e9-0f13-4886-acc1-dae7fc223ca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:51:59.734120 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc21e9-0f13-4886-acc1-dae7fc223ca4 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:51:59.734395 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc21e9-0f13-4886-acc1-dae7fc223ca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:51:59.734664 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc21e9-0f13-4886-acc1-dae7fc223ca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:51:59.743929 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc21e9-0f13-4886-acc1-dae7fc223ca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:51:59.745361 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc21e9-0f13-4886-acc1-dae7fc223ca4 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:51:59.754412 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1443/2883] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:51:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:52:00.009691 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab6cc7-2ec9-4508-b5fc-1df15b19b3f6 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:52:00.011469 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-b2ab6cc7-2ec9-4508-b5fc-1df15b19b3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:52:00.026528 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab6cc7-2ec9-4508-b5fc-1df15b19b3f6 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:52:00.031869 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d1715-f8cf-4873-83d0-a45c3b271309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:52:00.032832 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d1715-f8cf-4873-83d0-a45c3b271309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:52:00.033286 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d1715-f8cf-4873-83d0-a45c3b271309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:52:00.033870 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d1715-f8cf-4873-83d0-a45c3b271309 admin admin] PATH_INFO: `/v3/projects/62008bdcfc094569ad8a720ac787d615` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:52:00.034778 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d1715-f8cf-4873-83d0-a45c3b271309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62008bdcfc094569ad8a720ac787d615)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:52:00.036689 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d1715-f8cf-4873-83d0-a45c3b271309 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:52:00.081558 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-5c5d1715-f8cf-4873-83d0-a45c3b271309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62008bdcfc094569ad8a720ac787d615', 'request_id': 'req-5c5d1715-f8cf-4873-83d0-a45c3b271309'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:52:00.087237 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-5c5d1715-f8cf-4873-83d0-a45c3b271309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62008bdcfc094569ad8a720ac787d615', 'request_id': 'req-5c5d1715-f8cf-4873-83d0-a45c3b271309'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:52:00.094177 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-5c5d1715-f8cf-4873-83d0-a45c3b271309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62008bdcfc094569ad8a720ac787d615', 'request_id': 'req-5c5d1715-f8cf-4873-83d0-a45c3b271309'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:52:00.105772 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-5c5d1715-f8cf-4873-83d0-a45c3b271309 admin admin] The token cache is being invalidate because project 62008bdcfc094569ad8a720ac787d615 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79816) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:52:00.106100 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-5c5d1715-f8cf-4873-83d0-a45c3b271309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:52:00.106757 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-5c5d1715-f8cf-4873-83d0-a45c3b271309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:52:00.108280 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1441/2884] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:52:00 2022] DELETE /identity/v3/projects/62008bdcfc094569ad8a720ac787d615 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:52:00.114031 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f7cb5-a6c4-4424-884f-78328b59eb93 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:52:00.114509 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f7cb5-a6c4-4424-884f-78328b59eb93 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:52:00.114630 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f7cb5-a6c4-4424-884f-78328b59eb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:52:00.131585 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-b57f7cb5-a6c4-4424-884f-78328b59eb93 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:52:00.132788 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-b57f7cb5-a6c4-4424-884f-78328b59eb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:52:00.189783 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1444/2885] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:52:00.197817 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c5640-b5b9-4c61-8f75-a58c1e385ecf None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:52:00.198201 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c5640-b5b9-4c61-8f75-a58c1e385ecf None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:52:00.198565 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c5640-b5b9-4c61-8f75-a58c1e385ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:52:00.217575 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-d96c5640-b5b9-4c61-8f75-a58c1e385ecf None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:52:00.218803 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-d96c5640-b5b9-4c61-8f75-a58c1e385ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:52:00.226707 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1442/2886] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:52:00.230938 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f7cb5-a6c4-4424-884f-78328b59eb93 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:52:00.240733 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f7cb5-a6c4-4424-884f-78328b59eb93 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:52:00.245353 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232b09a-8ead-4078-b846-7eb5d6a2c3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:52:00.246036 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232b09a-8ead-4078-b846-7eb5d6a2c3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:52:00.246324 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232b09a-8ead-4078-b846-7eb5d6a2c3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:52:00.246603 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232b09a-8ead-4078-b846-7eb5d6a2c3e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:52:00.247324 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3232b09a-8ead-4078-b846-7eb5d6a2c3e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79815) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 09:52:00.247632 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3232b09a-8ead-4078-b846-7eb5d6a2c3e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:52:00.249218 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3232b09a-8ead-4078-b846-7eb5d6a2c3e4 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:52:00.260908 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1445/2887] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 12 09:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 09:52:00.265150 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c5640-b5b9-4c61-8f75-a58c1e385ecf None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:52:00.274921 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c5640-b5b9-4c61-8f75-a58c1e385ecf None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:52:00.279657 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37580b0f-6d6e-4e16-ad59-d782015695a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:52:00.280239 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37580b0f-6d6e-4e16-ad59-d782015695a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:52:00.280517 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37580b0f-6d6e-4e16-ad59-d782015695a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:52:00.280791 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37580b0f-6d6e-4e16-ad59-d782015695a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:52:00.281473 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37580b0f-6d6e-4e16-ad59-d782015695a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:52:00.283388 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37580b0f-6d6e-4e16-ad59-d782015695a1 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:52:00.307696 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1443/2888] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 12 09:52:00 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:52:00.311856 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232b09a-8ead-4078-b846-7eb5d6a2c3e4 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:52:00.322000 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232b09a-8ead-4078-b846-7eb5d6a2c3e4 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:52:00.375825 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f4ee8-800c-4e64-88f7-282f044790df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:52:00.376405 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f4ee8-800c-4e64-88f7-282f044790df admin admin] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:52:00.376687 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f4ee8-800c-4e64-88f7-282f044790df admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:52:00.376961 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f4ee8-800c-4e64-88f7-282f044790df admin admin] PATH_INFO: `/v3/users` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:52:00.377649 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f4ee8-800c-4e64-88f7-282f044790df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:52:00.379619 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f4ee8-800c-4e64-88f7-282f044790df admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:52:00.402618 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1446/2889] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 12 09:52:00 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 09:52:00.407330 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37580b0f-6d6e-4e16-ad59-d782015695a1 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:52:00.417889 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37580b0f-6d6e-4e16-ad59-d782015695a1 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:52:00.422738 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e0e2b-fc02-4708-82dd-9fe5617a44fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:52:00.423498 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e0e2b-fc02-4708-82dd-9fe5617a44fc admin admin] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:52:00.423786 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e0e2b-fc02-4708-82dd-9fe5617a44fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:52:00.424122 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e0e2b-fc02-4708-82dd-9fe5617a44fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:52:00.424889 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e0e2b-fc02-4708-82dd-9fe5617a44fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:52:00.426554 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e0e2b-fc02-4708-82dd-9fe5617a44fc admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:52:00.442236 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1444/2890] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:52:00.444509 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f4ee8-800c-4e64-88f7-282f044790df admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:52:00.455301 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f4ee8-800c-4e64-88f7-282f044790df admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:52:00.460407 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f57ec-4356-4b46-be21-63c2712dd613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:52:00.461871 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f57ec-4356-4b46-be21-63c2712dd613 admin admin] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:52:00.462272 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f57ec-4356-4b46-be21-63c2712dd613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:52:00.462690 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f57ec-4356-4b46-be21-63c2712dd613 admin admin] PATH_INFO: `/v3/roles` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:52:00.463547 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f57ec-4356-4b46-be21-63c2712dd613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:52:00.465224 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f57ec-4356-4b46-be21-63c2712dd613 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:52:00.477227 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1447/2891] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 12 09:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 09:52:00.481468 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e0e2b-fc02-4708-82dd-9fe5617a44fc admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:52:00.491110 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e0e2b-fc02-4708-82dd-9fe5617a44fc admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:52:00.495656 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c07e6-ae0a-4f19-9a06-fd195b1dcd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:52:00.496526 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c07e6-ae0a-4f19-9a06-fd195b1dcd07 admin admin] REQUEST_METHOD: `PUT` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:52:00.496801 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c07e6-ae0a-4f19-9a06-fd195b1dcd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:52:00.497072 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c07e6-ae0a-4f19-9a06-fd195b1dcd07 admin admin] PATH_INFO: `/v3/projects/701c8e12dee7459cb9453824e53111bd/users/22d6c839d14548e899ba08065170f00e/roles/31076ec4ad6a42868d212118fe129d18` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:52:00.511467 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c07e6-ae0a-4f19-9a06-fd195b1dcd07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=701c8e12dee7459cb9453824e53111bd, user_id=22d6c839d14548e899ba08065170f00e, role_id=31076ec4ad6a42868d212118fe129d18)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:52:00.514093 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c07e6-ae0a-4f19-9a06-fd195b1dcd07 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:52:00.526804 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1445/2892] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 12 09:52:00 2022] PUT /identity/v3/projects/701c8e12dee7459cb9453824e53111bd/users/22d6c839d14548e899ba08065170f00e/roles/31076ec4ad6a42868d212118fe129d18 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:52:00.536854 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e77b3b-77a3-42d0-9535-6a5afdb98c53 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:52:00.537145 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e77b3b-77a3-42d0-9535-6a5afdb98c53 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:52:00.537421 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e77b3b-77a3-42d0-9535-6a5afdb98c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:52:00.563935 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-96e77b3b-77a3-42d0-9535-6a5afdb98c53 None None] MFA Rules not processed for user `22d6c839d14548e899ba08065170f00e`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:52:00.565210 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-96e77b3b-77a3-42d0-9535-6a5afdb98c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:52:00.627651 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1448/2893] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:52:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:52:00.639537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c07e6-ae0a-4f19-9a06-fd195b1dcd07 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:52:00.641684 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-7a3c07e6-ae0a-4f19-9a06-fd195b1dcd07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:52:00.696952 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c07e6-ae0a-4f19-9a06-fd195b1dcd07 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:52:00.700764 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bb821-8a03-48ba-bd90-35c2fc33244c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:52:00.701497 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bb821-8a03-48ba-bd90-35c2fc33244c service cinder] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:52:00.701842 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bb821-8a03-48ba-bd90-35c2fc33244c service cinder] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:52:00.702202 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bb821-8a03-48ba-bd90-35c2fc33244c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:52:00.710814 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bb821-8a03-48ba-bd90-35c2fc33244c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:52:00.712265 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bb821-8a03-48ba-bd90-35c2fc33244c service cinder] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:52:00.721399 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1446/2894] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:52:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:52:02.509385 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e77b3b-77a3-42d0-9535-6a5afdb98c53 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:52:02.510793 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-96e77b3b-77a3-42d0-9535-6a5afdb98c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:52:02.584261 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e77b3b-77a3-42d0-9535-6a5afdb98c53 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:52:02.589890 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693bb166-3d3f-41eb-9a08-7576e9cee28c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2915babd40aa42e8bf7cc85c5a97daa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:52:02.590555 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bb166-3d3f-41eb-9a08-7576e9cee28c service nova] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:52:02.590836 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bb166-3d3f-41eb-9a08-7576e9cee28c service nova] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:52:02.591110 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bb166-3d3f-41eb-9a08-7576e9cee28c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:52:02.593023 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-693bb166-3d3f-41eb-9a08-7576e9cee28c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:52:02.605773 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693bb166-3d3f-41eb-9a08-7576e9cee28c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:52:02.607530 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693bb166-3d3f-41eb-9a08-7576e9cee28c service nova] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:52:02.618680 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1449/2895] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:52:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:52:10.683690 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bb821-8a03-48ba-bd90-35c2fc33244c service cinder] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:52:10.741550 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bb821-8a03-48ba-bd90-35c2fc33244c service cinder] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:52:10.745981 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294d7cf-7a21-4385-8197-1dc8bc8da575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:52:10.746835 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294d7cf-7a21-4385-8197-1dc8bc8da575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:52:10.747112 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294d7cf-7a21-4385-8197-1dc8bc8da575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:52:10.747380 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294d7cf-7a21-4385-8197-1dc8bc8da575 admin admin] PATH_INFO: `/v3/users/22d6c839d14548e899ba08065170f00e` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:52:10.748542 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294d7cf-7a21-4385-8197-1dc8bc8da575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22d6c839d14548e899ba08065170f00e)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:52:10.750450 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294d7cf-7a21-4385-8197-1dc8bc8da575 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:52:10.795381 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e294d7cf-7a21-4385-8197-1dc8bc8da575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22d6c839d14548e899ba08065170f00e'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:52:10.807044 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e294d7cf-7a21-4385-8197-1dc8bc8da575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22d6c839d14548e899ba08065170f00e'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:52:10.807731 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e294d7cf-7a21-4385-8197-1dc8bc8da575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22d6c839d14548e899ba08065170f00e'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:52:10.814701 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e294d7cf-7a21-4385-8197-1dc8bc8da575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22d6c839d14548e899ba08065170f00e'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:52:10.821663 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-e294d7cf-7a21-4385-8197-1dc8bc8da575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22d6c839d14548e899ba08065170f00e'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:52:10.827278 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1447/2896] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:52:10 2022] DELETE /identity/v3/users/22d6c839d14548e899ba08065170f00e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:52:10.831668 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74538f65-00ef-4c15-94e4-3f22397fead7 None None] REQUEST_METHOD: `POST` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:52:10.832173 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74538f65-00ef-4c15-94e4-3f22397fead7 None None] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:52:10.832301 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74538f65-00ef-4c15-94e4-3f22397fead7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:52:10.850083 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.auth.core [None req-74538f65-00ef-4c15-94e4-3f22397fead7 None None] MFA Rules not processed for user `025f1b162f424dda98fae8e2f23a6180`. Rule list: `[]` (Enabled: `True`). {{(pid=79815) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:52:10.851370 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-74538f65-00ef-4c15-94e4-3f22397fead7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:52:10.907074 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1450/2897] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 09:52:10.916763 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294d7cf-7a21-4385-8197-1dc8bc8da575 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:52:10.918113 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-e294d7cf-7a21-4385-8197-1dc8bc8da575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:52:10.972804 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294d7cf-7a21-4385-8197-1dc8bc8da575 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:52:10.976524 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09dcbc-2870-4923-9756-409a7bf79982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:52:10.977161 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09dcbc-2870-4923-9756-409a7bf79982 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:52:10.977438 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09dcbc-2870-4923-9756-409a7bf79982 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:52:10.977709 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09dcbc-2870-4923-9756-409a7bf79982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:52:10.986485 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09dcbc-2870-4923-9756-409a7bf79982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:52:10.987878 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09dcbc-2870-4923-9756-409a7bf79982 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:52:10.996951 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1448/2898] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:52:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:52:11.256458 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74538f65-00ef-4c15-94e4-3f22397fead7 None None] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:52:11.257879 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-74538f65-00ef-4c15-94e4-3f22397fead7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:52:11.269883 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74538f65-00ef-4c15-94e4-3f22397fead7 None None] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:52:11.275456 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d804e2b-38f6-47c0-9334-7d1cc13bd8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:52:11.276317 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d804e2b-38f6-47c0-9334-7d1cc13bd8d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:52:11.276615 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d804e2b-38f6-47c0-9334-7d1cc13bd8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:52:11.276885 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d804e2b-38f6-47c0-9334-7d1cc13bd8d4 admin admin] PATH_INFO: `/v3/projects/701c8e12dee7459cb9453824e53111bd` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:52:11.278941 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d804e2b-38f6-47c0-9334-7d1cc13bd8d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=701c8e12dee7459cb9453824e53111bd)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:52:11.280865 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d804e2b-38f6-47c0-9334-7d1cc13bd8d4 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:52:11.326499 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-1d804e2b-38f6-47c0-9334-7d1cc13bd8d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '701c8e12dee7459cb9453824e53111bd', 'request_id': 'req-1d804e2b-38f6-47c0-9334-7d1cc13bd8d4'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:52:11.331606 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-1d804e2b-38f6-47c0-9334-7d1cc13bd8d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '701c8e12dee7459cb9453824e53111bd', 'request_id': 'req-1d804e2b-38f6-47c0-9334-7d1cc13bd8d4'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:52:11.338485 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-1d804e2b-38f6-47c0-9334-7d1cc13bd8d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '701c8e12dee7459cb9453824e53111bd', 'request_id': 'req-1d804e2b-38f6-47c0-9334-7d1cc13bd8d4'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:52:11.349122 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-1d804e2b-38f6-47c0-9334-7d1cc13bd8d4 admin admin] The token cache is being invalidate because project 701c8e12dee7459cb9453824e53111bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:52:11.349403 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-1d804e2b-38f6-47c0-9334-7d1cc13bd8d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:52:11.350047 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-1d804e2b-38f6-47c0-9334-7d1cc13bd8d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:52:11.351782 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1451/2899] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:52:11 2022] DELETE /identity/v3/projects/701c8e12dee7459cb9453824e53111bd => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:53:02.159338 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09dcbc-2870-4923-9756-409a7bf79982 service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:53:02.160736 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-bd09dcbc-2870-4923-9756-409a7bf79982 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:53:02.227696 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09dcbc-2870-4923-9756-409a7bf79982 service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:53:02.283009 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f86819-4652-47c4-8583-e2c3ce7401bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525f4699878f461e82f7f06ef60c176a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:53:02.283665 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f86819-4652-47c4-8583-e2c3ce7401bc service placement] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:53:02.283951 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f86819-4652-47c4-8583-e2c3ce7401bc service placement] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:53:02.284243 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f86819-4652-47c4-8583-e2c3ce7401bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:53:02.286038 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-07f86819-4652-47c4-8583-e2c3ce7401bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:53:02.297508 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f86819-4652-47c4-8583-e2c3ce7401bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:53:02.299114 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f86819-4652-47c4-8583-e2c3ce7401bc service placement] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:53:02.309103 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1449/2900] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:53:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:53:51.286956 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d804e2b-38f6-47c0-9334-7d1cc13bd8d4 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:53:51.288315 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-1d804e2b-38f6-47c0-9334-7d1cc13bd8d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:53:51.345517 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d804e2b-38f6-47c0-9334-7d1cc13bd8d4 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:53:51.349207 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac53334-0cc1-4e59-a511-9ccc7f51927b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e97d11fab3b4bb092f9623da4e40eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:53:51.349846 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac53334-0cc1-4e59-a511-9ccc7f51927b service cinder] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:53:51.350154 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac53334-0cc1-4e59-a511-9ccc7f51927b service cinder] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:53:51.350427 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac53334-0cc1-4e59-a511-9ccc7f51927b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:53:51.352177 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-5ac53334-0cc1-4e59-a511-9ccc7f51927b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:53:51.410128 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac53334-0cc1-4e59-a511-9ccc7f51927b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:53:51.411599 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac53334-0cc1-4e59-a511-9ccc7f51927b service cinder] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:53:51.420985 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1452/2901] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:53:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:54:03.400822 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865a6eb-ec3e-4754-8c21-78cea75fd222 None None] REQUEST_METHOD: `POST` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:54:03.401429 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865a6eb-ec3e-4754-8c21-78cea75fd222 None None] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:54:03.401429 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865a6eb-ec3e-4754-8c21-78cea75fd222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:54:03.418537 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.auth.core [None req-d865a6eb-ec3e-4754-8c21-78cea75fd222 None None] MFA Rules not processed for user `06be00f6a9ad465195c7606883b4160d`. Rule list: `[]` (Enabled: `True`). {{(pid=79816) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 09:54:03.419710 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-d865a6eb-ec3e-4754-8c21-78cea75fd222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:54:03.426466 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1450/2902] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 12 09:54:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 09:54:04.149164 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac53334-0cc1-4e59-a511-9ccc7f51927b service cinder] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:54:04.150505 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-5ac53334-0cc1-4e59-a511-9ccc7f51927b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:54:04.205076 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac53334-0cc1-4e59-a511-9ccc7f51927b service cinder] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:54:04.208662 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91a110-f2c3-4de1-8448-7244d59e99f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:54:04.209293 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91a110-f2c3-4de1-8448-7244d59e99f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:54:04.209571 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91a110-f2c3-4de1-8448-7244d59e99f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:54:04.209841 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91a110-f2c3-4de1-8448-7244d59e99f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:54:04.211610 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-ed91a110-f2c3-4de1-8448-7244d59e99f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:54:04.282826 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91a110-f2c3-4de1-8448-7244d59e99f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:54:04.284284 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91a110-f2c3-4de1-8448-7244d59e99f0 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:54:04.297595 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1453/2903] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:54:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:54:11.278896 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865a6eb-ec3e-4754-8c21-78cea75fd222 None None] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:54:11.288531 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865a6eb-ec3e-4754-8c21-78cea75fd222 None None] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:54:11.292104 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d8056-eeae-40be-8e5c-77ab864c740b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:54:11.292747 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d8056-eeae-40be-8e5c-77ab864c740b service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:54:11.293027 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d8056-eeae-40be-8e5c-77ab864c740b service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:54:11.293298 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d8056-eeae-40be-8e5c-77ab864c740b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:54:11.295067 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-104d8056-eeae-40be-8e5c-77ab864c740b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:54:11.308037 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d8056-eeae-40be-8e5c-77ab864c740b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:54:11.309445 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d8056-eeae-40be-8e5c-77ab864c740b service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:54:11.320319 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1451/2904] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:54:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:54:22.120967 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91a110-f2c3-4de1-8448-7244d59e99f0 service neutron] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:54:22.122415 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-ed91a110-f2c3-4de1-8448-7244d59e99f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:54:22.132833 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91a110-f2c3-4de1-8448-7244d59e99f0 service neutron] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:54:22.136430 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232a39b-6bbf-4334-87c8-5c5876cf2db0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:54:22.137059 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232a39b-6bbf-4334-87c8-5c5876cf2db0 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:54:22.137344 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232a39b-6bbf-4334-87c8-5c5876cf2db0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:54:22.137624 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232a39b-6bbf-4334-87c8-5c5876cf2db0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:54:22.139360 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-6232a39b-6bbf-4334-87c8-5c5876cf2db0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:54:22.200660 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232a39b-6bbf-4334-87c8-5c5876cf2db0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:54:22.202131 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232a39b-6bbf-4334-87c8-5c5876cf2db0 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:54:22.211455 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1454/2905] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:54:22 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:54:58.849189 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d8056-eeae-40be-8e5c-77ab864c740b service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:54:58.859113 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d8056-eeae-40be-8e5c-77ab864c740b service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:54:58.863206 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a67979-56b7-4211-90d0-7a84d8a03603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:54:58.863859 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a67979-56b7-4211-90d0-7a84d8a03603 service neutron] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:54:58.864152 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a67979-56b7-4211-90d0-7a84d8a03603 service neutron] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:54:58.864429 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a67979-56b7-4211-90d0-7a84d8a03603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:54:58.866239 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-87a67979-56b7-4211-90d0-7a84d8a03603 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:54:58.876431 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a67979-56b7-4211-90d0-7a84d8a03603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:54:58.877843 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a67979-56b7-4211-90d0-7a84d8a03603 service neutron] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:54:58.885772 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1452/2906] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:54:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:56:25.679559 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232a39b-6bbf-4334-87c8-5c5876cf2db0 service neutron] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:56:25.716833 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232a39b-6bbf-4334-87c8-5c5876cf2db0 service neutron] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:56:25.720507 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadf42e-474a-46f3-aa8e-24d51fa16e37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf7b793f84bd4a72a68d5ab65221e1a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:56:25.721127 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadf42e-474a-46f3-aa8e-24d51fa16e37 service neutron] REQUEST_METHOD: `GET` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:56:25.721406 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadf42e-474a-46f3-aa8e-24d51fa16e37 service neutron] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:56:25.721681 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadf42e-474a-46f3-aa8e-24d51fa16e37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:56:25.723489 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-6eadf42e-474a-46f3-aa8e-24d51fa16e37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:56:25.846612 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eadf42e-474a-46f3-aa8e-24d51fa16e37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:56:25.848039 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eadf42e-474a-46f3-aa8e-24d51fa16e37 service neutron] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:56:25.865955 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1455/2907] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:56:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 09:56:32.093941 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a67979-56b7-4211-90d0-7a84d8a03603 service neutron] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:56:32.095340 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-87a67979-56b7-4211-90d0-7a84d8a03603 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:56:32.123422 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a67979-56b7-4211-90d0-7a84d8a03603 service neutron] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:56:32.127956 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71f9ac-53ca-4fc5-b3f1-f5301e18e5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:56:32.128823 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71f9ac-53ca-4fc5-b3f1-f5301e18e5ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:56:32.129098 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71f9ac-53ca-4fc5-b3f1-f5301e18e5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:56:32.129368 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71f9ac-53ca-4fc5-b3f1-f5301e18e5ff admin admin] PATH_INFO: `/v3/users/06be00f6a9ad465195c7606883b4160d` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:56:32.130557 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71f9ac-53ca-4fc5-b3f1-f5301e18e5ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=06be00f6a9ad465195c7606883b4160d)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:56:32.132452 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71f9ac-53ca-4fc5-b3f1-f5301e18e5ff admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:56:32.176460 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-fa71f9ac-53ca-4fc5-b3f1-f5301e18e5ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06be00f6a9ad465195c7606883b4160d'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:56:32.188074 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-fa71f9ac-53ca-4fc5-b3f1-f5301e18e5ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06be00f6a9ad465195c7606883b4160d'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:56:32.188730 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-fa71f9ac-53ca-4fc5-b3f1-f5301e18e5ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06be00f6a9ad465195c7606883b4160d'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:56:32.195522 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-fa71f9ac-53ca-4fc5-b3f1-f5301e18e5ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06be00f6a9ad465195c7606883b4160d'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:56:32.202858 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-fa71f9ac-53ca-4fc5-b3f1-f5301e18e5ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06be00f6a9ad465195c7606883b4160d'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:56:32.208502 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1453/2908] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:56:32 2022] DELETE /identity/v3/users/06be00f6a9ad465195c7606883b4160d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 09:56:32.378193 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadf42e-474a-46f3-aa8e-24d51fa16e37 service neutron] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:56:32.389838 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadf42e-474a-46f3-aa8e-24d51fa16e37 service neutron] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:56:32.445553 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e5cbe-a6e2-4159-a3cf-8a4351c8ab13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:56:32.446445 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e5cbe-a6e2-4159-a3cf-8a4351c8ab13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:56:32.446724 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e5cbe-a6e2-4159-a3cf-8a4351c8ab13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:56:32.446994 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e5cbe-a6e2-4159-a3cf-8a4351c8ab13 admin admin] PATH_INFO: `/v3/projects/6e6bc2241970493783de557e3f690105` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:56:32.448154 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e5cbe-a6e2-4159-a3cf-8a4351c8ab13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e6bc2241970493783de557e3f690105)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:56:32.450728 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e5cbe-a6e2-4159-a3cf-8a4351c8ab13 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:56:32.492774 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d43e5cbe-a6e2-4159-a3cf-8a4351c8ab13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e6bc2241970493783de557e3f690105', 'request_id': 'req-d43e5cbe-a6e2-4159-a3cf-8a4351c8ab13'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:56:32.498496 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d43e5cbe-a6e2-4159-a3cf-8a4351c8ab13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e6bc2241970493783de557e3f690105', 'request_id': 'req-d43e5cbe-a6e2-4159-a3cf-8a4351c8ab13'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:56:32.506355 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d43e5cbe-a6e2-4159-a3cf-8a4351c8ab13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e6bc2241970493783de557e3f690105', 'request_id': 'req-d43e5cbe-a6e2-4159-a3cf-8a4351c8ab13'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:56:32.517267 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d43e5cbe-a6e2-4159-a3cf-8a4351c8ab13 admin admin] The token cache is being invalidate because project 6e6bc2241970493783de557e3f690105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:56:32.517547 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d43e5cbe-a6e2-4159-a3cf-8a4351c8ab13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:56:32.518180 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d43e5cbe-a6e2-4159-a3cf-8a4351c8ab13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:56:32.519946 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1456/2909] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:56:32 2022] DELETE /identity/v3/projects/6e6bc2241970493783de557e3f690105 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:56:32.524010 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71f9ac-53ca-4fc5-b3f1-f5301e18e5ff admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:56:32.525452 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-fa71f9ac-53ca-4fc5-b3f1-f5301e18e5ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:56:32.538144 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71f9ac-53ca-4fc5-b3f1-f5301e18e5ff admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:56:32.593268 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73639d-68b8-4a5e-9936-ee0e8c9a7813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:56:32.594171 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73639d-68b8-4a5e-9936-ee0e8c9a7813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:56:32.594461 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73639d-68b8-4a5e-9936-ee0e8c9a7813 admin admin] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:56:32.594727 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73639d-68b8-4a5e-9936-ee0e8c9a7813 admin admin] PATH_INFO: `/v3/users/21c163dfac4d47fb8c65ff2f2136e92b` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:56:32.595885 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b73639d-68b8-4a5e-9936-ee0e8c9a7813 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21c163dfac4d47fb8c65ff2f2136e92b)` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:56:32.597771 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b73639d-68b8-4a5e-9936-ee0e8c9a7813 admin admin] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:56:32.642106 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-9b73639d-68b8-4a5e-9936-ee0e8c9a7813 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21c163dfac4d47fb8c65ff2f2136e92b'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:56:32.653448 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-9b73639d-68b8-4a5e-9936-ee0e8c9a7813 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21c163dfac4d47fb8c65ff2f2136e92b'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:56:32.654119 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-9b73639d-68b8-4a5e-9936-ee0e8c9a7813 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21c163dfac4d47fb8c65ff2f2136e92b'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:56:32.661426 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-9b73639d-68b8-4a5e-9936-ee0e8c9a7813 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21c163dfac4d47fb8c65ff2f2136e92b'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:56:32.668088 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.notifications [None req-9b73639d-68b8-4a5e-9936-ee0e8c9a7813 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21c163dfac4d47fb8c65ff2f2136e92b'} {{(pid=79816) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:56:32.674345 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1454/2910] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 12 09:56:32 2022] DELETE /identity/v3/users/21c163dfac4d47fb8c65ff2f2136e92b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:56:32.840433 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e5cbe-a6e2-4159-a3cf-8a4351c8ab13 admin admin] Authenticating user token {{(pid=79815) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:56:32.841855 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.fernet_utils [None req-d43e5cbe-a6e2-4159-a3cf-8a4351c8ab13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79815) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:56:32.855820 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e5cbe-a6e2-4159-a3cf-8a4351c8ab13 admin admin] Validating token access rules against request {{(pid=79815) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:56:32.911642 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0567683-ac89-4b2a-b5cc-1696015cae09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025f1b162f424dda98fae8e2f23a6180', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '796065237e2244ba911db9225d3aa52c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79815) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:56:32.912418 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0567683-ac89-4b2a-b5cc-1696015cae09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:56:32.912694 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0567683-ac89-4b2a-b5cc-1696015cae09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:56:32.912963 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0567683-ac89-4b2a-b5cc-1696015cae09 admin admin] PATH_INFO: `/v3/projects/9629328eaaa04625b255cc18636c449b` {{(pid=79815) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:56:32.914168 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0567683-ac89-4b2a-b5cc-1696015cae09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9629328eaaa04625b255cc18636c449b)` {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:56:32.916055 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0567683-ac89-4b2a-b5cc-1696015cae09 admin admin] RBAC: Authorization granted {{(pid=79815) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:56:32.959154 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d0567683-ac89-4b2a-b5cc-1696015cae09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9629328eaaa04625b255cc18636c449b', 'request_id': 'req-d0567683-ac89-4b2a-b5cc-1696015cae09'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:56:32.964600 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d0567683-ac89-4b2a-b5cc-1696015cae09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9629328eaaa04625b255cc18636c449b', 'request_id': 'req-d0567683-ac89-4b2a-b5cc-1696015cae09'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:56:32.971927 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d0567683-ac89-4b2a-b5cc-1696015cae09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9629328eaaa04625b255cc18636c449b', 'request_id': 'req-d0567683-ac89-4b2a-b5cc-1696015cae09'} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:56:32.984091 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d0567683-ac89-4b2a-b5cc-1696015cae09 admin admin] The token cache is being invalidate because project 9629328eaaa04625b255cc18636c449b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79815) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 09:56:32.984378 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d0567683-ac89-4b2a-b5cc-1696015cae09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:56:32.985028 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: DEBUG keystone.notifications [None req-d0567683-ac89-4b2a-b5cc-1696015cae09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79815) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 09:56:32.986613 dv-cinder-837699-5-iscsi devstack@keystone.service[79815]: [pid: 79815|app: 0|req: 1457/2911] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 12 09:56:32 2022] DELETE /identity/v3/projects/9629328eaaa04625b255cc18636c449b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 09:58:04.118944 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73639d-68b8-4a5e-9936-ee0e8c9a7813 admin admin] Authenticating user token {{(pid=79816) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 09:58:04.120310 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-9b73639d-68b8-4a5e-9936-ee0e8c9a7813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:58:04.209454 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73639d-68b8-4a5e-9936-ee0e8c9a7813 admin admin] Validating token access rules against request {{(pid=79816) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 09:58:04.265001 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23fd41-4ff1-4e75-9bf7-3a143c4a5d0a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '525f4699878f461e82f7f06ef60c176a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cf4f2954dd44516b3e594ed440781cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79816) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 09:58:04.265683 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23fd41-4ff1-4e75-9bf7-3a143c4a5d0a service placement] REQUEST_METHOD: `GET` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 09:58:04.265992 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23fd41-4ff1-4e75-9bf7-3a143c4a5d0a service placement] SCRIPT_NAME: `/identity` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 09:58:04.266269 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23fd41-4ff1-4e75-9bf7-3a143c4a5d0a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79816) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 09:58:04.268024 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.fernet_utils [None req-ed23fd41-4ff1-4e75-9bf7-3a143c4a5d0a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79816) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 09:58:04.279005 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23fd41-4ff1-4e75-9bf7-3a143c4a5d0a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 09:58:04.280552 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23fd41-4ff1-4e75-9bf7-3a143c4a5d0a service placement] RBAC: Authorization granted {{(pid=79816) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 09:58:04.290144 dv-cinder-837699-5-iscsi devstack@keystone.service[79816]: [pid: 79816|app: 0|req: 1455/2912] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 12 09:58:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)